2024-05-04T00:10:31.886 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-04T00:10:31.886 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688442 --name pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/3 tasks/dbench validater/valgrind} -- /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688442/orig.config.yaml 2024-05-04T00:10:31.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-04T00:10:32.031 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688442 branch: wip-pdonnell-testing-20240503.163550-debug description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/3 tasks/dbench validater/valgrind} email: pdonnell@redhat.com first_in_suite: false job_id: '7688442' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-pdonnell-testing-20240503.163550-debug ceph: cephfs: max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow request - SLOW_OPS - MON_DOWN sha1: bd4e00a39d766328b458e4c953f4d722fed96a31 valgrind: exit_on_first_error: false mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: bd4e00a39d766328b458e4c953f4d722fed96a31 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240503.163550-debug sha1: bd4e00a39d766328b458e4c953f4d722fed96a31 owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 1842 sha1: bd4e00a39d766328b458e4c953f4d722fed96a31 sleep_before_teardown: 0 subset: 478/512 suite: fs suite_branch: wip-pdonnell-testing-20240503.163550-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bd4e00a39d766328b458e4c953f4d722fed96a31 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBlXbvxO9wd8rg/B/Ewb2Aj1cLbnGU5sypoN9DaAk4VAtGFnf5vFxeXo2b/X1iGGLS6Bw7QpIET6R8Sxpajh8ow= smithi163.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLNx3VE/CsM7gbIrU8+X66ZSHmKacnMUasflpx9Iw11Yq7mQBYvn0KTNjBTJKyGGMWnq/4HQHu8S/zySxloGmsE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-03_22:48:16 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-04T00:10:32.031 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa; will attempt to use it 2024-05-04T00:10:32.032 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa/tasks 2024-05-04T00:10:32.032 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-04T00:10:32.034 INFO:teuthology.task.internal:Checking packages... 2024-05-04T00:10:32.058 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bd4e00a39d766328b458e4c953f4d722fed96a31' 2024-05-04T00:10:32.058 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-04T00:10:32.058 INFO:teuthology.packaging:ref: None 2024-05-04T00:10:32.058 INFO:teuthology.packaging:tag: None 2024-05-04T00:10:32.058 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240503.163550-debug 2024-05-04T00:10:32.058 INFO:teuthology.packaging:sha1: bd4e00a39d766328b458e4c953f4d722fed96a31 2024-05-04T00:10:32.059 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-pdonnell-testing-20240503.163550-debug 2024-05-04T00:10:32.272 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3522-gbd4e00a3-1jammy 2024-05-04T00:10:32.273 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-04T00:10:32.280 INFO:teuthology.task.internal:no buildpackages task found 2024-05-04T00:10:32.280 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-04T00:10:32.310 INFO:teuthology.task.internal:Saving configuration 2024-05-04T00:10:32.328 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-04T00:10:32.336 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-04T00:10:32.361 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688442', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-04 00:04:13.446252', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJsX/0gczvOvCZPoVg8gtEMNVDhznJUth5vOplGcyyzG'} 2024-05-04T00:10:32.378 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688442', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-04 00:04:13.444519', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICd1rbjUaEQLHJTYoYC96xEdMb8tm3JQNUQJlLPkJ+jN'} 2024-05-04T00:10:32.378 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-04T00:10:32.384 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-05-04T00:10:32.384 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-05-04T00:10:32.384 INFO:teuthology.run_tasks:Running task console_log... 2024-05-04T00:10:32.474 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe2bdb043a0>, signals=[15]) 2024-05-04T00:10:32.474 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-04T00:10:32.480 INFO:teuthology.task.internal:Opening connections... 2024-05-04T00:10:32.480 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2024-05-04T00:10:32.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T00:10:32.565 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi163.front.sepia.ceph.com 2024-05-04T00:10:32.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T00:10:32.651 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-04T00:10:32.657 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2024-05-04T00:10:32.662 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2024-05-04T00:10:32.662 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-05-04T00:10:32.709 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-04T00:10:32.709 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Ubuntu" 2024-05-04T00:10:32.709 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="22.04" 2024-05-04T00:10:32.709 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-04T00:10:32.709 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_CODENAME=jammy 2024-05-04T00:10:32.710 INFO:teuthology.orchestra.run.smithi006.stdout:ID=ubuntu 2024-05-04T00:10:32.710 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE=debian 2024-05-04T00:10:32.710 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-04T00:10:32.710 INFO:teuthology.orchestra.run.smithi006.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-04T00:10:32.710 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-04T00:10:32.710 INFO:teuthology.orchestra.run.smithi006.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-04T00:10:32.710 INFO:teuthology.orchestra.run.smithi006.stdout:UBUNTU_CODENAME=jammy 2024-05-04T00:10:32.711 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-05-04T00:10:32.732 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2024-05-04T00:10:32.737 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2024-05-04T00:10:32.738 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-05-04T00:10:32.782 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-04T00:10:32.783 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu" 2024-05-04T00:10:32.783 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="22.04" 2024-05-04T00:10:32.783 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-04T00:10:32.783 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=jammy 2024-05-04T00:10:32.783 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu 2024-05-04T00:10:32.783 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian 2024-05-04T00:10:32.783 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-04T00:10:32.783 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-04T00:10:32.783 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-04T00:10:32.783 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-04T00:10:32.783 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=jammy 2024-05-04T00:10:32.784 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-05-04T00:10:32.807 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-04T00:10:32.817 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-04T00:10:32.897 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-04T00:10:32.897 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2024-05-04T00:10:32.900 DEBUG:teuthology.orchestra.run.smithi163:> test '!' -e /home/ubuntu/cephtest 2024-05-04T00:10:32.904 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-04T00:10:32.927 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-04T00:10:32.927 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2024-05-04T00:10:32.947 DEBUG:teuthology.orchestra.run.smithi163:> test -z $(ls -A /var/lib/ceph) 2024-05-04T00:10:32.957 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-04T00:10:33.012 INFO:teuthology.run_tasks:Running task kernel... 2024-05-04T00:10:33.026 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-04T00:10:33.027 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-04T00:10:33.027 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-04T00:10:33.027 DEBUG:teuthology.orchestra.run.smithi163:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-04T00:10:33.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T00:10:33.032 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-05-04T00:10:33.033 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T00:10:33.033 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2024-05-04T00:10:33.079 INFO:teuthology.orchestra.run.smithi163.stdout:5.15.0-56-generic 2024-05-04T00:10:33.079 INFO:teuthology.task.kernel:Running kernel on smithi163: 5.15.0-56-generic 2024-05-04T00:10:33.080 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-get clean 2024-05-04T00:10:33.081 INFO:teuthology.orchestra.run.smithi006.stdout:5.15.0-56-generic 2024-05-04T00:10:33.081 INFO:teuthology.task.kernel:Running kernel on smithi006: 5.15.0-56-generic 2024-05-04T00:10:33.081 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get clean 2024-05-04T00:10:33.205 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-get update 2024-05-04T00:10:33.218 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get update 2024-05-04T00:10:33.378 INFO:teuthology.orchestra.run.smithi163.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-04T00:10:33.384 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-04T00:10:33.454 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-04T00:10:33.485 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-04T00:10:33.535 INFO:teuthology.orchestra.run.smithi163.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-04T00:10:33.567 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-04T00:10:33.577 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-05-04T00:10:33.597 INFO:teuthology.orchestra.run.smithi163.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [453 kB] 2024-05-04T00:10:33.681 INFO:teuthology.orchestra.run.smithi163.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-05-04T00:10:33.687 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [453 kB] 2024-05-04T00:10:33.694 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-05-04T00:10:33.698 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-04T00:10:33.699 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-05-04T00:10:33.727 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-04T00:10:33.728 INFO:teuthology.orchestra.run.smithi006.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-05-04T00:10:33.732 INFO:teuthology.orchestra.run.smithi006.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-04T00:10:33.733 INFO:teuthology.orchestra.run.smithi006.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-05-04T00:10:33.743 INFO:teuthology.orchestra.run.smithi163.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-05-04T00:10:33.745 INFO:teuthology.orchestra.run.smithi006.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-05-04T00:10:33.748 INFO:teuthology.orchestra.run.smithi163.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-04T00:10:33.749 INFO:teuthology.orchestra.run.smithi163.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-04T00:10:33.750 INFO:teuthology.orchestra.run.smithi163.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-05-04T00:10:33.754 INFO:teuthology.orchestra.run.smithi006.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-04T00:10:33.756 INFO:teuthology.orchestra.run.smithi006.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-04T00:10:33.762 INFO:teuthology.orchestra.run.smithi006.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-04T00:10:33.763 INFO:teuthology.orchestra.run.smithi006.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-04T00:10:33.782 INFO:teuthology.orchestra.run.smithi163.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-05-04T00:10:33.786 INFO:teuthology.orchestra.run.smithi163.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-04T00:10:33.786 INFO:teuthology.orchestra.run.smithi006.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-04T00:10:33.786 INFO:teuthology.orchestra.run.smithi163.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-05-04T00:10:33.787 INFO:teuthology.orchestra.run.smithi006.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-04T00:10:33.793 INFO:teuthology.orchestra.run.smithi163.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-05-04T00:10:33.802 INFO:teuthology.orchestra.run.smithi163.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-04T00:10:33.804 INFO:teuthology.orchestra.run.smithi163.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-04T00:10:33.804 INFO:teuthology.orchestra.run.smithi163.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-04T00:10:33.805 INFO:teuthology.orchestra.run.smithi163.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-04T00:10:33.836 INFO:teuthology.orchestra.run.smithi163.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-04T00:10:33.836 INFO:teuthology.orchestra.run.smithi163.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-04T00:10:33.888 INFO:teuthology.orchestra.run.smithi163.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-04T00:10:33.929 INFO:teuthology.orchestra.run.smithi006.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-04T00:10:34.027 INFO:teuthology.orchestra.run.smithi163.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,612 kB] 2024-05-04T00:10:34.067 INFO:teuthology.orchestra.run.smithi006.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [619 kB] 2024-05-04T00:10:34.265 INFO:teuthology.orchestra.run.smithi006.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,612 kB] 2024-05-04T00:10:34.338 INFO:teuthology.orchestra.run.smithi163.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [619 kB] 2024-05-04T00:10:34.377 INFO:teuthology.orchestra.run.smithi163.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [304 kB] 2024-05-04T00:10:34.392 INFO:teuthology.orchestra.run.smithi163.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-04T00:10:34.393 INFO:teuthology.orchestra.run.smithi163.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-04T00:10:34.395 INFO:teuthology.orchestra.run.smithi163.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-05-04T00:10:34.418 INFO:teuthology.orchestra.run.smithi006.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [304 kB] 2024-05-04T00:10:34.433 INFO:teuthology.orchestra.run.smithi006.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-04T00:10:34.434 INFO:teuthology.orchestra.run.smithi006.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-05-04T00:10:34.456 INFO:teuthology.orchestra.run.smithi163.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-05-04T00:10:34.463 INFO:teuthology.orchestra.run.smithi163.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-04T00:10:34.495 INFO:teuthology.orchestra.run.smithi006.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-04T00:10:34.497 INFO:teuthology.orchestra.run.smithi006.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-05-04T00:10:34.504 INFO:teuthology.orchestra.run.smithi006.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-04T00:10:34.628 INFO:teuthology.orchestra.run.smithi163.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,072 kB] 2024-05-04T00:10:34.670 INFO:teuthology.orchestra.run.smithi006.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,072 kB] 2024-05-04T00:10:35.261 INFO:teuthology.orchestra.run.smithi163.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [701 kB] 2024-05-04T00:10:35.298 INFO:teuthology.orchestra.run.smithi163.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-04T00:10:35.299 INFO:teuthology.orchestra.run.smithi006.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [701 kB] 2024-05-04T00:10:35.311 INFO:teuthology.orchestra.run.smithi163.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-04T00:10:35.312 INFO:teuthology.orchestra.run.smithi163.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-04T00:10:35.313 INFO:teuthology.orchestra.run.smithi163.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-04T00:10:35.315 INFO:teuthology.orchestra.run.smithi163.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-04T00:10:35.315 INFO:teuthology.orchestra.run.smithi163.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-04T00:10:35.316 INFO:teuthology.orchestra.run.smithi163.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-04T00:10:35.336 INFO:teuthology.orchestra.run.smithi006.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-04T00:10:35.342 INFO:teuthology.orchestra.run.smithi163.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-04T00:10:35.345 INFO:teuthology.orchestra.run.smithi163.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-04T00:10:35.350 INFO:teuthology.orchestra.run.smithi006.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-04T00:10:35.350 INFO:teuthology.orchestra.run.smithi006.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-04T00:10:35.353 INFO:teuthology.orchestra.run.smithi006.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-04T00:10:35.353 INFO:teuthology.orchestra.run.smithi006.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-04T00:10:35.354 INFO:teuthology.orchestra.run.smithi006.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-04T00:10:35.355 INFO:teuthology.orchestra.run.smithi006.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-04T00:10:35.381 INFO:teuthology.orchestra.run.smithi006.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-04T00:10:35.384 INFO:teuthology.orchestra.run.smithi006.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-04T00:10:35.510 INFO:teuthology.orchestra.run.smithi163.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-04T00:10:35.549 INFO:teuthology.orchestra.run.smithi006.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-04T00:10:35.593 INFO:teuthology.orchestra.run.smithi163.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-04T00:10:35.631 INFO:teuthology.orchestra.run.smithi006.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-04T00:10:35.674 INFO:teuthology.orchestra.run.smithi163.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-04T00:10:35.713 INFO:teuthology.orchestra.run.smithi006.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-04T00:10:35.755 INFO:teuthology.orchestra.run.smithi163.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-04T00:10:35.767 INFO:teuthology.orchestra.run.smithi006.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-04T00:10:35.786 INFO:teuthology.orchestra.run.smithi163.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-04T00:10:35.817 INFO:teuthology.orchestra.run.smithi006.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-04T00:10:40.132 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 13.3 MB in 3s (5,269 kB/s) 2024-05-04T00:10:40.387 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 13.3 MB in 3s (5,257 kB/s) 2024-05-04T00:10:41.531 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2024-05-04T00:10:41.548 DEBUG:teuthology.orchestra.run.smithi163:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-04T00:10:41.608 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2024-05-04T00:10:41.714 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2024-05-04T00:10:41.731 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-04T00:10:41.793 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2024-05-04T00:10:41.810 INFO:teuthology.orchestra.run.smithi163.stdout:Building dependency tree... 2024-05-04T00:10:41.810 INFO:teuthology.orchestra.run.smithi163.stdout:Reading state information... 2024-05-04T00:10:41.984 INFO:teuthology.orchestra.run.smithi163.stdout:The following packages were automatically installed and are no longer required: 2024-05-04T00:10:41.984 INFO:teuthology.orchestra.run.smithi163.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-04T00:10:41.985 INFO:teuthology.orchestra.run.smithi163.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-04T00:10:41.985 INFO:teuthology.orchestra.run.smithi163.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-04T00:10:41.985 INFO:teuthology.orchestra.run.smithi163.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-04T00:10:41.985 INFO:teuthology.orchestra.run.smithi163.stdout: python2.7-minimal 2024-05-04T00:10:41.985 INFO:teuthology.orchestra.run.smithi163.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-04T00:10:41.986 INFO:teuthology.orchestra.run.smithi163.stdout:The following additional packages will be installed: 2024-05-04T00:10:41.986 INFO:teuthology.orchestra.run.smithi163.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-05-04T00:10:41.987 INFO:teuthology.orchestra.run.smithi163.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-05-04T00:10:41.987 INFO:teuthology.orchestra.run.smithi163.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-05-04T00:10:41.988 INFO:teuthology.orchestra.run.smithi163.stdout:Suggested packages: 2024-05-04T00:10:41.988 INFO:teuthology.orchestra.run.smithi163.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-04T00:10:41.988 INFO:teuthology.orchestra.run.smithi163.stdout:Recommended packages: 2024-05-04T00:10:41.988 INFO:teuthology.orchestra.run.smithi163.stdout: thermald 2024-05-04T00:10:41.997 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2024-05-04T00:10:41.997 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2024-05-04T00:10:42.047 INFO:teuthology.orchestra.run.smithi163.stdout:The following NEW packages will be installed: 2024-05-04T00:10:42.048 INFO:teuthology.orchestra.run.smithi163.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-05-04T00:10:42.048 INFO:teuthology.orchestra.run.smithi163.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-05-04T00:10:42.048 INFO:teuthology.orchestra.run.smithi163.stdout: linux-modules-extra-5.15.0-105-generic 2024-05-04T00:10:42.049 INFO:teuthology.orchestra.run.smithi163.stdout:The following packages will be upgraded: 2024-05-04T00:10:42.050 INFO:teuthology.orchestra.run.smithi163.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-04T00:10:42.177 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages were automatically installed and are no longer required: 2024-05-04T00:10:42.177 INFO:teuthology.orchestra.run.smithi006.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-04T00:10:42.177 INFO:teuthology.orchestra.run.smithi006.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-04T00:10:42.178 INFO:teuthology.orchestra.run.smithi006.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-04T00:10:42.178 INFO:teuthology.orchestra.run.smithi006.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-04T00:10:42.178 INFO:teuthology.orchestra.run.smithi006.stdout: python2.7-minimal 2024-05-04T00:10:42.178 INFO:teuthology.orchestra.run.smithi006.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-04T00:10:42.179 INFO:teuthology.orchestra.run.smithi006.stdout:The following additional packages will be installed: 2024-05-04T00:10:42.179 INFO:teuthology.orchestra.run.smithi006.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-05-04T00:10:42.179 INFO:teuthology.orchestra.run.smithi006.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-05-04T00:10:42.180 INFO:teuthology.orchestra.run.smithi006.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-05-04T00:10:42.181 INFO:teuthology.orchestra.run.smithi006.stdout:Suggested packages: 2024-05-04T00:10:42.181 INFO:teuthology.orchestra.run.smithi006.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-04T00:10:42.181 INFO:teuthology.orchestra.run.smithi006.stdout:Recommended packages: 2024-05-04T00:10:42.181 INFO:teuthology.orchestra.run.smithi006.stdout: thermald 2024-05-04T00:10:42.228 INFO:teuthology.orchestra.run.smithi006.stdout:The following NEW packages will be installed: 2024-05-04T00:10:42.229 INFO:teuthology.orchestra.run.smithi006.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-05-04T00:10:42.229 INFO:teuthology.orchestra.run.smithi006.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-05-04T00:10:42.229 INFO:teuthology.orchestra.run.smithi006.stdout: linux-modules-extra-5.15.0-105-generic 2024-05-04T00:10:42.230 INFO:teuthology.orchestra.run.smithi163.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-04T00:10:42.230 INFO:teuthology.orchestra.run.smithi163.stdout:Need to get 113 MB of archives. 2024-05-04T00:10:42.230 INFO:teuthology.orchestra.run.smithi163.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-04T00:10:42.230 INFO:teuthology.orchestra.run.smithi163.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-05-04T00:10:42.230 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages will be upgraded: 2024-05-04T00:10:42.231 INFO:teuthology.orchestra.run.smithi006.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-04T00:10:42.289 INFO:teuthology.orchestra.run.smithi006.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-04T00:10:42.289 INFO:teuthology.orchestra.run.smithi006.stdout:Need to get 113 MB of archives. 2024-05-04T00:10:42.289 INFO:teuthology.orchestra.run.smithi006.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-04T00:10:42.290 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-05-04T00:10:42.793 INFO:teuthology.orchestra.run.smithi006.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-05-04T00:10:42.971 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-05-04T00:10:43.651 INFO:teuthology.orchestra.run.smithi163.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-05-04T00:10:44.003 INFO:teuthology.orchestra.run.smithi163.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-05-04T00:10:44.898 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-05-04T00:10:44.898 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-05-04T00:10:44.898 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-05-04T00:10:45.096 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-05-04T00:10:45.136 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-05-04T00:10:45.538 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 113 MB in 3s (39.1 MB/s) 2024-05-04T00:10:45.672 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-05-04T00:10:46.282 INFO:teuthology.orchestra.run.smithi163.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-05-04T00:10:46.283 INFO:teuthology.orchestra.run.smithi163.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-05-04T00:10:46.283 INFO:teuthology.orchestra.run.smithi163.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-05-04T00:10:46.749 INFO:teuthology.orchestra.run.smithi163.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-05-04T00:10:46.835 INFO:teuthology.orchestra.run.smithi163.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-05-04T00:10:47.225 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 113 MB in 5s (23.7 MB/s) 2024-05-04T00:10:47.407 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-05-04T00:10:47.641 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-04T00:10:47.645 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-05-04T00:10:47.862 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-04T00:10:49.381 INFO:teuthology.orchestra.run.smithi163.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-04T00:10:49.386 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-05-04T00:10:49.472 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-04T00:10:49.897 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-05-04T00:10:49.919 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-05-04T00:10:50.017 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-04T00:10:50.433 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-05-04T00:10:50.454 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-05-04T00:10:50.483 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-04T00:10:51.876 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-05-04T00:10:51.897 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-05-04T00:10:51.985 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-04T00:10:52.438 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-05-04T00:10:52.458 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-05-04T00:10:52.521 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-04T00:10:56.884 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-05-04T00:10:57.011 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-05-04T00:10:57.345 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-05-04T00:10:57.456 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-05-04T00:10:57.709 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-05-04T00:10:57.732 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-05-04T00:10:57.776 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-05-04T00:10:59.146 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-05-04T00:10:59.274 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-05-04T00:10:59.633 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-05-04T00:10:59.761 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-05-04T00:11:00.022 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-05-04T00:11:00.033 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-05-04T00:11:00.064 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-05-04T00:11:03.456 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-05-04T00:11:03.493 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-05-04T00:11:03.530 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-04T00:11:05.847 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-05-04T00:11:05.883 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-05-04T00:11:05.913 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-04T00:11:06.193 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-05-04T00:11:06.309 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-05-04T00:11:06.710 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-05-04T00:11:06.839 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-04T00:11:06.957 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-05-04T00:11:07.085 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-04T00:11:08.465 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-05-04T00:11:08.560 INFO:teuthology.orchestra.run.smithi006.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-04T00:11:08.560 INFO:teuthology.orchestra.run.smithi006.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-04T00:11:08.560 INFO:teuthology.orchestra.run.smithi006.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-05-04T00:11:08.560 INFO:teuthology.orchestra.run.smithi006.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-05-04T00:11:08.564 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-05-04T00:11:08.714 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-04T00:11:08.928 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-05-04T00:11:09.711 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-04T00:11:09.811 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-05-04T00:11:09.940 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-04T00:11:10.131 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-04T00:11:11.276 INFO:teuthology.orchestra.run.smithi163.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-04T00:11:11.277 INFO:teuthology.orchestra.run.smithi163.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-04T00:11:11.277 INFO:teuthology.orchestra.run.smithi163.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-05-04T00:11:11.277 INFO:teuthology.orchestra.run.smithi163.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-05-04T00:11:11.433 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-04T00:11:11.516 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-05-04T00:11:11.642 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-05-04T00:11:11.768 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-04T00:11:11.836 INFO:teuthology.orchestra.run.smithi006.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-04T00:11:11.836 INFO:teuthology.orchestra.run.smithi006.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-05-04T00:11:12.835 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-04T00:11:14.210 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-05-04T00:11:14.311 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-05-04T00:11:14.420 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-04T00:11:14.483 INFO:teuthology.orchestra.run.smithi163.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-04T00:11:14.483 INFO:teuthology.orchestra.run.smithi163.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-05-04T00:11:26.293 INFO:teuthology.orchestra.run.smithi006.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-04T00:11:26.294 INFO:teuthology.orchestra.run.smithi006.stdout:Sourcing file `/etc/default/grub' 2024-05-04T00:11:26.308 INFO:teuthology.orchestra.run.smithi006.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-04T00:11:26.335 INFO:teuthology.orchestra.run.smithi006.stdout:Generating grub configuration file ... 2024-05-04T00:11:26.654 INFO:teuthology.orchestra.run.smithi006.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-05-04T00:11:26.675 INFO:teuthology.orchestra.run.smithi006.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-05-04T00:11:27.113 INFO:teuthology.orchestra.run.smithi006.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-04T00:11:27.119 INFO:teuthology.orchestra.run.smithi006.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-04T00:11:27.189 INFO:teuthology.orchestra.run.smithi006.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-04T00:11:27.195 INFO:teuthology.orchestra.run.smithi006.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-04T00:11:27.347 INFO:teuthology.orchestra.run.smithi006.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-04T00:11:27.348 INFO:teuthology.orchestra.run.smithi006.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-04T00:11:27.348 INFO:teuthology.orchestra.run.smithi006.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-04T00:11:27.393 INFO:teuthology.orchestra.run.smithi006.stdout:done 2024-05-04T00:11:27.806 DEBUG:teuthology.orchestra.run.smithi006:> dpkg -s linux-image-generic 2024-05-04T00:11:27.830 INFO:teuthology.orchestra.run.smithi006.stdout:Package: linux-image-generic 2024-05-04T00:11:27.830 INFO:teuthology.orchestra.run.smithi006.stdout:Status: install ok installed 2024-05-04T00:11:27.830 INFO:teuthology.orchestra.run.smithi006.stdout:Priority: optional 2024-05-04T00:11:27.830 INFO:teuthology.orchestra.run.smithi006.stdout:Section: kernel 2024-05-04T00:11:27.830 INFO:teuthology.orchestra.run.smithi006.stdout:Installed-Size: 21 2024-05-04T00:11:27.830 INFO:teuthology.orchestra.run.smithi006.stdout:Maintainer: Ubuntu Kernel Team 2024-05-04T00:11:27.830 INFO:teuthology.orchestra.run.smithi006.stdout:Architecture: amd64 2024-05-04T00:11:27.830 INFO:teuthology.orchestra.run.smithi006.stdout:Source: linux-meta 2024-05-04T00:11:27.831 INFO:teuthology.orchestra.run.smithi006.stdout:Version: 5.15.0.105.102 2024-05-04T00:11:27.831 INFO:teuthology.orchestra.run.smithi006.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-04T00:11:27.831 INFO:teuthology.orchestra.run.smithi006.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-04T00:11:27.831 INFO:teuthology.orchestra.run.smithi006.stdout:Recommends: thermald 2024-05-04T00:11:27.831 INFO:teuthology.orchestra.run.smithi006.stdout:Description: Generic Linux kernel image 2024-05-04T00:11:27.831 INFO:teuthology.orchestra.run.smithi006.stdout: This package will always depend on the latest generic kernel image 2024-05-04T00:11:27.831 INFO:teuthology.orchestra.run.smithi006.stdout: available. 2024-05-04T00:11:27.831 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-05-04T00:11:27.831 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-04T00:11:27.831 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-04T00:11:27.832 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-04T00:11:27.832 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi006.front.sepia.ceph.com, path=None, version=distro) 2024-05-04T00:11:27.832 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get clean 2024-05-04T00:11:28.002 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get update 2024-05-04T00:11:28.118 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-04T00:11:28.258 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-04T00:11:28.344 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-04T00:11:28.425 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-04T00:11:28.573 INFO:teuthology.orchestra.run.smithi163.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-04T00:11:28.573 INFO:teuthology.orchestra.run.smithi163.stdout:Sourcing file `/etc/default/grub' 2024-05-04T00:11:28.592 INFO:teuthology.orchestra.run.smithi163.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-04T00:11:28.601 INFO:teuthology.orchestra.run.smithi163.stdout:Generating grub configuration file ... 2024-05-04T00:11:28.868 INFO:teuthology.orchestra.run.smithi163.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-05-04T00:11:28.896 INFO:teuthology.orchestra.run.smithi163.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-05-04T00:11:29.204 INFO:teuthology.orchestra.run.smithi163.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-04T00:11:29.209 INFO:teuthology.orchestra.run.smithi163.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-04T00:11:29.286 INFO:teuthology.orchestra.run.smithi163.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-04T00:11:29.292 INFO:teuthology.orchestra.run.smithi163.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-04T00:11:29.451 INFO:teuthology.orchestra.run.smithi163.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-04T00:11:29.451 INFO:teuthology.orchestra.run.smithi163.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-04T00:11:29.451 INFO:teuthology.orchestra.run.smithi163.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-04T00:11:29.484 INFO:teuthology.orchestra.run.smithi163.stdout:done 2024-05-04T00:11:29.540 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2024-05-04T00:11:29.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-04T00:11:29.623 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2024-05-04T00:11:29.828 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2024-05-04T00:11:29.828 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2024-05-04T00:11:29.939 DEBUG:teuthology.orchestra.run.smithi163:> dpkg -s linux-image-generic 2024-05-04T00:11:29.956 INFO:teuthology.orchestra.run.smithi163.stdout:Package: linux-image-generic 2024-05-04T00:11:29.956 INFO:teuthology.orchestra.run.smithi163.stdout:Status: install ok installed 2024-05-04T00:11:29.956 INFO:teuthology.orchestra.run.smithi163.stdout:Priority: optional 2024-05-04T00:11:29.956 INFO:teuthology.orchestra.run.smithi163.stdout:Section: kernel 2024-05-04T00:11:29.956 INFO:teuthology.orchestra.run.smithi163.stdout:Installed-Size: 21 2024-05-04T00:11:29.956 INFO:teuthology.orchestra.run.smithi163.stdout:Maintainer: Ubuntu Kernel Team 2024-05-04T00:11:29.956 INFO:teuthology.orchestra.run.smithi163.stdout:Architecture: amd64 2024-05-04T00:11:29.957 INFO:teuthology.orchestra.run.smithi163.stdout:Source: linux-meta 2024-05-04T00:11:29.957 INFO:teuthology.orchestra.run.smithi163.stdout:Version: 5.15.0.105.102 2024-05-04T00:11:29.957 INFO:teuthology.orchestra.run.smithi163.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-04T00:11:29.957 INFO:teuthology.orchestra.run.smithi163.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-04T00:11:29.957 INFO:teuthology.orchestra.run.smithi163.stdout:Recommends: thermald 2024-05-04T00:11:29.957 INFO:teuthology.orchestra.run.smithi163.stdout:Description: Generic Linux kernel image 2024-05-04T00:11:29.957 INFO:teuthology.orchestra.run.smithi163.stdout: This package will always depend on the latest generic kernel image 2024-05-04T00:11:29.957 INFO:teuthology.orchestra.run.smithi163.stdout: available. 2024-05-04T00:11:29.957 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-05-04T00:11:29.958 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-04T00:11:29.958 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-04T00:11:29.958 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-04T00:11:29.958 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi163.front.sepia.ceph.com, path=None, version=distro) 2024-05-04T00:11:29.958 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-get clean 2024-05-04T00:11:30.016 INFO:teuthology.orchestra.run.smithi006.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-05-04T00:11:30.016 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages were automatically installed and are no longer required: 2024-05-04T00:11:30.016 INFO:teuthology.orchestra.run.smithi006.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-04T00:11:30.016 INFO:teuthology.orchestra.run.smithi006.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-04T00:11:30.016 INFO:teuthology.orchestra.run.smithi006.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-04T00:11:30.017 INFO:teuthology.orchestra.run.smithi006.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-04T00:11:30.017 INFO:teuthology.orchestra.run.smithi006.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-04T00:11:30.017 INFO:teuthology.orchestra.run.smithi006.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-04T00:11:30.060 INFO:teuthology.orchestra.run.smithi006.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-04T00:11:30.062 DEBUG:teuthology.orchestra.run.smithi006:> dpkg -s linux-image-generic 2024-05-04T00:11:30.079 INFO:teuthology.orchestra.run.smithi006.stdout:Package: linux-image-generic 2024-05-04T00:11:30.079 INFO:teuthology.orchestra.run.smithi006.stdout:Status: install ok installed 2024-05-04T00:11:30.079 INFO:teuthology.orchestra.run.smithi006.stdout:Priority: optional 2024-05-04T00:11:30.079 INFO:teuthology.orchestra.run.smithi006.stdout:Section: kernel 2024-05-04T00:11:30.079 INFO:teuthology.orchestra.run.smithi006.stdout:Installed-Size: 21 2024-05-04T00:11:30.079 INFO:teuthology.orchestra.run.smithi006.stdout:Maintainer: Ubuntu Kernel Team 2024-05-04T00:11:30.079 INFO:teuthology.orchestra.run.smithi006.stdout:Architecture: amd64 2024-05-04T00:11:30.079 INFO:teuthology.orchestra.run.smithi006.stdout:Source: linux-meta 2024-05-04T00:11:30.079 INFO:teuthology.orchestra.run.smithi006.stdout:Version: 5.15.0.105.102 2024-05-04T00:11:30.079 INFO:teuthology.orchestra.run.smithi006.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-04T00:11:30.079 INFO:teuthology.orchestra.run.smithi006.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-04T00:11:30.079 INFO:teuthology.orchestra.run.smithi006.stdout:Recommends: thermald 2024-05-04T00:11:30.080 INFO:teuthology.orchestra.run.smithi006.stdout:Description: Generic Linux kernel image 2024-05-04T00:11:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: This package will always depend on the latest generic kernel image 2024-05-04T00:11:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: available. 2024-05-04T00:11:30.080 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2024-05-04T00:11:30.125 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.XRlPoPt8n0 2024-05-04T00:11:30.125 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /boot/grub/grub.cfg /tmp/tmp.XRlPoPt8n0 2024-05-04T00:11:30.138 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-get update 2024-05-04T00:11:30.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.XRlPoPt8n0 2024-05-04T00:11:30.283 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-04T00:11:30.308 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-04T00:11:30.312 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.XRlPoPt8n0 is 10KB 2024-05-04T00:11:30.325 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.XRlPoPt8n0 2024-05-04T00:11:30.331 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-04T00:11:30.342 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-04T00:11:30.369 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-04T00:11:30.385 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:11:30.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-04T00:11:30.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-04T00:11:30.472 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-05-04T00:11:30.472 DEBUG:teuthology.orchestra.run.smithi006:> sudo update-grub 2024-05-04T00:11:31.654 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2024-05-04T00:11:31.673 DEBUG:teuthology.orchestra.run.smithi163:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-04T00:11:31.676 INFO:teuthology.orchestra.run.smithi006.stderr:Sourcing file `/etc/default/grub' 2024-05-04T00:11:31.678 INFO:teuthology.orchestra.run.smithi006.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-04T00:11:31.680 INFO:teuthology.orchestra.run.smithi006.stderr:Generating grub configuration file ... 2024-05-04T00:11:31.724 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2024-05-04T00:11:31.902 INFO:teuthology.orchestra.run.smithi163.stdout:Building dependency tree... 2024-05-04T00:11:31.902 INFO:teuthology.orchestra.run.smithi163.stdout:Reading state information... 2024-05-04T00:11:31.961 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-05-04T00:11:31.967 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-05-04T00:11:32.060 INFO:teuthology.orchestra.run.smithi163.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-05-04T00:11:32.060 INFO:teuthology.orchestra.run.smithi163.stdout:The following packages were automatically installed and are no longer required: 2024-05-04T00:11:32.060 INFO:teuthology.orchestra.run.smithi163.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-04T00:11:32.060 INFO:teuthology.orchestra.run.smithi163.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-04T00:11:32.060 INFO:teuthology.orchestra.run.smithi163.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-04T00:11:32.060 INFO:teuthology.orchestra.run.smithi163.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-04T00:11:32.060 INFO:teuthology.orchestra.run.smithi163.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-04T00:11:32.060 INFO:teuthology.orchestra.run.smithi163.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-04T00:11:32.100 INFO:teuthology.orchestra.run.smithi163.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-04T00:11:32.101 DEBUG:teuthology.orchestra.run.smithi163:> dpkg -s linux-image-generic 2024-05-04T00:11:32.160 INFO:teuthology.orchestra.run.smithi163.stdout:Package: linux-image-generic 2024-05-04T00:11:32.160 INFO:teuthology.orchestra.run.smithi163.stdout:Status: install ok installed 2024-05-04T00:11:32.160 INFO:teuthology.orchestra.run.smithi163.stdout:Priority: optional 2024-05-04T00:11:32.160 INFO:teuthology.orchestra.run.smithi163.stdout:Section: kernel 2024-05-04T00:11:32.160 INFO:teuthology.orchestra.run.smithi163.stdout:Installed-Size: 21 2024-05-04T00:11:32.161 INFO:teuthology.orchestra.run.smithi163.stdout:Maintainer: Ubuntu Kernel Team 2024-05-04T00:11:32.161 INFO:teuthology.orchestra.run.smithi163.stdout:Architecture: amd64 2024-05-04T00:11:32.161 INFO:teuthology.orchestra.run.smithi163.stdout:Source: linux-meta 2024-05-04T00:11:32.161 INFO:teuthology.orchestra.run.smithi163.stdout:Version: 5.15.0.105.102 2024-05-04T00:11:32.161 INFO:teuthology.orchestra.run.smithi163.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-04T00:11:32.161 INFO:teuthology.orchestra.run.smithi163.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-04T00:11:32.161 INFO:teuthology.orchestra.run.smithi163.stdout:Recommends: thermald 2024-05-04T00:11:32.161 INFO:teuthology.orchestra.run.smithi163.stdout:Description: Generic Linux kernel image 2024-05-04T00:11:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: This package will always depend on the latest generic kernel image 2024-05-04T00:11:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: available. 2024-05-04T00:11:32.161 DEBUG:teuthology.orchestra.run.smithi163:> mktemp 2024-05-04T00:11:32.206 INFO:teuthology.orchestra.run.smithi163.stdout:/tmp/tmp.cWpNkYusEy 2024-05-04T00:11:32.206 DEBUG:teuthology.orchestra.run.smithi163:> sudo cp /boot/grub/grub.cfg /tmp/tmp.cWpNkYusEy 2024-05-04T00:11:32.262 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0666 /tmp/tmp.cWpNkYusEy 2024-05-04T00:11:32.292 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-04T00:11:32.299 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-04T00:11:32.344 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-04T00:11:32.350 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-04T00:11:32.382 DEBUG:teuthology.orchestra.remote:smithi163:/tmp/tmp.cWpNkYusEy is 10KB 2024-05-04T00:11:32.394 DEBUG:teuthology.orchestra.run.smithi163:> rm -fr /tmp/tmp.cWpNkYusEy 2024-05-04T00:11:32.400 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-04T00:11:32.458 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:11:32.458 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-04T00:11:32.458 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-04T00:11:32.480 INFO:teuthology.orchestra.run.smithi006.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-04T00:11:32.480 INFO:teuthology.orchestra.run.smithi006.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-04T00:11:32.480 INFO:teuthology.orchestra.run.smithi006.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-04T00:11:32.491 INFO:teuthology.orchestra.run.smithi006.stderr:done 2024-05-04T00:11:32.500 DEBUG:teuthology.orchestra.run.smithi006:> sudo shutdown -r now 2024-05-04T00:11:32.525 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-05-04T00:11:32.525 DEBUG:teuthology.orchestra.run.smithi163:> sudo update-grub 2024-05-04T00:11:33.714 INFO:teuthology.orchestra.run.smithi163.stderr:Sourcing file `/etc/default/grub' 2024-05-04T00:11:33.715 INFO:teuthology.orchestra.run.smithi163.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-04T00:11:33.717 INFO:teuthology.orchestra.run.smithi163.stderr:Generating grub configuration file ... 2024-05-04T00:11:33.899 INFO:teuthology.orchestra.run.smithi163.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-05-04T00:11:33.905 INFO:teuthology.orchestra.run.smithi163.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-05-04T00:11:34.113 INFO:teuthology.orchestra.run.smithi163.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-04T00:11:34.118 INFO:teuthology.orchestra.run.smithi163.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-04T00:11:34.155 INFO:teuthology.orchestra.run.smithi163.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-04T00:11:34.160 INFO:teuthology.orchestra.run.smithi163.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-04T00:11:34.283 INFO:teuthology.orchestra.run.smithi163.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-04T00:11:34.283 INFO:teuthology.orchestra.run.smithi163.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-04T00:11:34.283 INFO:teuthology.orchestra.run.smithi163.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-04T00:11:34.305 INFO:teuthology.orchestra.run.smithi163.stderr:done 2024-05-04T00:11:34.314 DEBUG:teuthology.orchestra.run.smithi163:> sudo shutdown -r now 2024-05-04T00:12:02.530 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-04T00:12:02.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-05-04T00:12:02.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T00:12:04.318 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-04T00:12:04.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-05-04T00:12:04.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T00:12:37.023 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-05-04T00:12:38.814 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-05-04T00:12:46.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-05-04T00:12:46.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T00:12:47.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-05-04T00:12:47.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T00:12:50.878 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-05-04T00:13:02.884 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-05-04T00:13:02.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T00:13:46.045 DEBUG:teuthology.orchestra.remote:timed out 2024-05-04T00:13:58.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-05-04T00:13:58.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T00:13:58.301 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-05-04T00:13:58.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-05-04T00:13:58.841 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-05-04T00:13:58.842 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-05-04T00:13:58.891 INFO:teuthology.orchestra.run.smithi006.stdout:5.15.0-105-generic 2024-05-04T00:13:58.892 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-05-04T00:13:58.892 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-04T00:13:58.892 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-04T00:13:59.893 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-04T00:13:59.893 DEBUG:teuthology.orchestra.run.smithi006:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-04T00:13:59.974 INFO:teuthology.orchestra.run.smithi006.stdout:ttyS1 2024-05-04T00:13:59.992 DEBUG:teuthology.parallel:result is None 2024-05-04T00:14:02.887 DEBUG:teuthology.orchestra.remote:timed out 2024-05-04T00:14:17.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-05-04T00:14:17.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T00:14:18.221 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-05-04T00:14:18.767 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-05-04T00:14:18.768 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-05-04T00:14:18.768 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2024-05-04T00:14:18.814 INFO:teuthology.orchestra.run.smithi163.stdout:5.15.0-105-generic 2024-05-04T00:14:18.815 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-05-04T00:14:18.815 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-04T00:14:18.815 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-04T00:14:19.816 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-04T00:14:19.816 DEBUG:teuthology.orchestra.run.smithi163:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-04T00:14:20.135 INFO:teuthology.orchestra.run.smithi163.stdout:ttyS1 2024-05-04T00:14:20.161 DEBUG:teuthology.parallel:result is None 2024-05-04T00:14:20.161 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-04T00:14:20.173 INFO:teuthology.task.internal:Creating test directory... 2024-05-04T00:14:20.173 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-04T00:14:20.176 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-04T00:14:20.181 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-04T00:14:20.216 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-04T00:14:20.249 INFO:teuthology.task.internal:Creating archive directory... 2024-05-04T00:14:20.250 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-04T00:14:20.252 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-04T00:14:20.276 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-04T00:14:20.282 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-04T00:14:20.282 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-04T00:14:20.311 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-04T00:14:20.333 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-04T00:14:20.334 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-04T00:14:20.342 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-04T00:14:20.343 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-04T00:14:20.345 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-04T00:14:20.352 INFO:teuthology.task.internal:Configuring sudo... 2024-05-04T00:14:20.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-04T00:14:20.391 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-04T00:14:20.404 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-04T00:14:20.412 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-04T00:14:20.413 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-04T00:14:20.448 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-04T00:14:20.453 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-04T00:14:20.498 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-04T00:14:20.546 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:14:20.547 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-04T00:14:20.608 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-04T00:14:20.613 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-04T00:14:20.663 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:14:20.663 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-04T00:14:20.738 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2024-05-04T00:14:20.740 DEBUG:teuthology.orchestra.run.smithi163:> sudo service rsyslog restart 2024-05-04T00:14:20.816 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-04T00:14:20.824 INFO:teuthology.task.internal:Starting timer... 2024-05-04T00:14:20.824 INFO:teuthology.run_tasks:Running task pcp... 2024-05-04T00:14:20.886 INFO:teuthology.run_tasks:Running task selinux... 2024-05-04T00:14:20.923 DEBUG:teuthology.task.selinux:Excluding smithi006: OS 'ubuntu' does not support SELinux 2024-05-04T00:14:20.923 DEBUG:teuthology.task.selinux:Excluding smithi163: OS 'ubuntu' does not support SELinux 2024-05-04T00:14:20.924 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-04T00:14:20.924 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-04T00:14:20.924 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-04T00:14:20.924 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-04T00:14:20.952 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-04T00:14:20.957 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-04T00:14:21.083 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-04T00:14:21.098 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-04T00:14:21.099 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi163.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-04T00:21:30.276 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi163.front.sepia.ceph.com')] 2024-05-04T00:21:30.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-05-04T00:21:30.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T00:21:30.370 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-05-04T00:21:30.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-05-04T00:21:30.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-05-04T00:21:30.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T00:21:30.533 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-05-04T00:21:30.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-05-04T00:21:30.607 INFO:teuthology.run_tasks:Running task clock... 2024-05-04T00:21:30.909 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-04T00:21:30.910 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-04T00:21:30.910 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-04T00:21:30.913 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-04T00:21:30.913 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-04T00:21:30.937 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-04T00:21:30.937 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: Command line: ntpd -gq 2024-05-04T00:21:30.937 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: ---------------------------------------------------- 2024-05-04T00:21:30.937 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: ntp-4 is maintained by Network Time Foundation, 2024-05-04T00:21:30.937 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-04T00:21:30.937 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: corporation. Support and training for ntp-4 are 2024-05-04T00:21:30.938 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: available at https://www.nwtime.org/support 2024-05-04T00:21:30.938 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: ---------------------------------------------------- 2024-05-04T00:21:30.938 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: proto: precision = 0.046 usec (-24) 2024-05-04T00:21:30.938 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: basedate set to 2022-02-04 2024-05-04T00:21:30.938 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: gps base set to 2022-02-06 (week 2196) 2024-05-04T00:21:30.939 INFO:teuthology.orchestra.run.smithi006.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-04T00:21:30.939 INFO:teuthology.orchestra.run.smithi006.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-04T00:21:30.940 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-04T00:21:30.940 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: restrict ::: KOD does nothing without LIMITED. 2024-05-04T00:21:30.940 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: Listen and drop on 0 v6wildcard [::]:123 2024-05-04T00:21:30.940 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-04T00:21:30.940 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: Listen normally on 2 lo 127.0.0.1:123 2024-05-04T00:21:30.940 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: Listen normally on 3 ens1f0 172.21.15.6:123 2024-05-04T00:21:30.940 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: Listen normally on 4 lo [::1]:123 2024-05-04T00:21:30.940 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15e4%4]:123 2024-05-04T00:21:30.940 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:30 ntpd[17177]: Listening on routing socket on fd #22 for interface updates 2024-05-04T00:21:30.944 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-04T00:21:30.944 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: Command line: ntpd -gq 2024-05-04T00:21:30.944 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: ---------------------------------------------------- 2024-05-04T00:21:30.944 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: ntp-4 is maintained by Network Time Foundation, 2024-05-04T00:21:30.944 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-04T00:21:30.944 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: corporation. Support and training for ntp-4 are 2024-05-04T00:21:30.944 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: available at https://www.nwtime.org/support 2024-05-04T00:21:30.944 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: ---------------------------------------------------- 2024-05-04T00:21:30.945 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: proto: precision = 0.043 usec (-24) 2024-05-04T00:21:30.945 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: basedate set to 2022-02-04 2024-05-04T00:21:30.945 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: gps base set to 2022-02-06 (week 2196) 2024-05-04T00:21:30.945 INFO:teuthology.orchestra.run.smithi163.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-04T00:21:30.946 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-04T00:21:30.946 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: restrict ::: KOD does nothing without LIMITED. 2024-05-04T00:21:30.946 INFO:teuthology.orchestra.run.smithi163.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-04T00:21:30.947 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: Listen and drop on 0 v6wildcard [::]:123 2024-05-04T00:21:30.947 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-04T00:21:30.947 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: Listen normally on 2 lo 127.0.0.1:123 2024-05-04T00:21:30.947 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: Listen normally on 3 enp3s0f1 172.21.15.163:123 2024-05-04T00:21:30.947 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: Listen normally on 4 lo [::1]:123 2024-05-04T00:21:30.947 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7d5b%5]:123 2024-05-04T00:21:30.947 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:30 ntpd[17263]: Listening on routing socket on fd #22 for interface updates 2024-05-04T00:21:31.938 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:31 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:31.938 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:31 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:31.938 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:31 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:31.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:31 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:31.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:31 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:31.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:31 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:31.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:31 ntpd[17177]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-04T00:21:31.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:31 ntpd[17177]: can't open /var/log/ntpstats/peerstats.20240504: Permission denied 2024-05-04T00:21:31.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:31 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:31.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:31 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:31.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:31 ntpd[17177]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-04T00:21:31.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:31 ntpd[17177]: can't open /var/log/ntpstats/peerstats.20240504: Permission denied 2024-05-04T00:21:31.945 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:31 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:31.945 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:31 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:31.945 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:31 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:31.945 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:31 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:31.945 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:31 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:31.945 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:31 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:31.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:31 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:31.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:31 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:31.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:31 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-04T00:21:31.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:31 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240504: Permission denied 2024-05-04T00:21:31.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:31 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:31.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:31 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:31.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:31 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-04T00:21:31.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:31 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240504: Permission denied 2024-05-04T00:21:32.938 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:32 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:32.938 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:32 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:33.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:33 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:33.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:33 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:33.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:33 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:33.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:33 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:33.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:33 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:33.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:33 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:33.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:33 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:33.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:33 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:33.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:33 ntpd[17177]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-04T00:21:33.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:33 ntpd[17177]: can't open /var/log/ntpstats/peerstats.20240504: Permission denied 2024-05-04T00:21:33.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:33 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:33.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:33 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:33.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:33 ntpd[17177]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-04T00:21:33.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:33 ntpd[17177]: can't open /var/log/ntpstats/peerstats.20240504: Permission denied 2024-05-04T00:21:33.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:33 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:33.941 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:33 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:33.941 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:33 ntpd[17177]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-04T00:21:33.941 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:33 ntpd[17177]: can't open /var/log/ntpstats/peerstats.20240504: Permission denied 2024-05-04T00:21:33.945 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:33 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:33.945 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:33 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:33.945 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:33 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:33.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:33 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:33.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:33 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:33.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:33 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:33.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:33 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-04T00:21:33.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:33 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240504: Permission denied 2024-05-04T00:21:33.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:33 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:33.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:33 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:33.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:33 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-04T00:21:33.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:33 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240504: Permission denied 2024-05-04T00:21:35.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:35 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:35.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:35 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:35.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:35 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:35.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:35 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:35.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:35 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:35.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:35 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:35.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:35 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:35.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:35 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:35.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:35 ntpd[17177]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-04T00:21:35.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:35 ntpd[17177]: can't open /var/log/ntpstats/peerstats.20240504: Permission denied 2024-05-04T00:21:35.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:35 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:35.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:35 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:35.941 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:35 ntpd[17177]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-04T00:21:35.941 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:35 ntpd[17177]: can't open /var/log/ntpstats/peerstats.20240504: Permission denied 2024-05-04T00:21:35.941 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:35 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:35.941 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:35 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:35.941 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:35 ntpd[17177]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-04T00:21:35.941 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:35 ntpd[17177]: can't open /var/log/ntpstats/peerstats.20240504: Permission denied 2024-05-04T00:21:35.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:35 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:35.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:35 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:35.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:35 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:35.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:35 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:35.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:35 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:35.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:35 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:35.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:35 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:35.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:35 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:35.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:35 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-04T00:21:35.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:35 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240504: Permission denied 2024-05-04T00:21:35.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:35 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:35.947 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:35 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:35.947 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:35 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-04T00:21:35.947 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:35 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240504: Permission denied 2024-05-04T00:21:35.947 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:35 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:35.947 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:35 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:35.947 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:35 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-04T00:21:35.947 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:35 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240504: Permission denied 2024-05-04T00:21:37.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:37 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:37.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:37 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:37.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:37 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:37.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:37 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:37.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:37 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:37.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:37 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:37.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:37 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:37.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:37 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:37.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:37 ntpd[17177]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-04T00:21:37.939 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:37 ntpd[17177]: can't open /var/log/ntpstats/peerstats.20240504: Permission denied 2024-05-04T00:21:37.940 INFO:teuthology.orchestra.run.smithi006.stdout: 4 May 00:21:37 ntpd[17177]: ntpd: time slew -0.000069 s 2024-05-04T00:21:37.940 INFO:teuthology.orchestra.run.smithi006.stdout:ntpd: time slew -0.000069s 2024-05-04T00:21:37.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:37 ntpd[17177]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-04T00:21:37.940 INFO:teuthology.orchestra.run.smithi006.stderr: 4 May 00:21:37 ntpd[17177]: can't open /var/log/ntpstats/loopstats.20240504: Permission denied 2024-05-04T00:21:37.945 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:37 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:37.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:37 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:37.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:37 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:37.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:37 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:37.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:37 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:37.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:37 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:37.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:37 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:37.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:37 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:37.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:37 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-04T00:21:37.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:37 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240504: Permission denied 2024-05-04T00:21:37.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:37 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-04T00:21:37.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:37 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240504: Permission denied 2024-05-04T00:21:37.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:37 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-04T00:21:37.946 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:37 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240504: Permission denied 2024-05-04T00:21:37.947 INFO:teuthology.orchestra.run.smithi163.stdout: 4 May 00:21:37 ntpd[17263]: ntpd: time slew -0.000241 s 2024-05-04T00:21:37.947 INFO:teuthology.orchestra.run.smithi163.stdout:ntpd: time slew -0.000241s 2024-05-04T00:21:37.947 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:37 ntpd[17263]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-04T00:21:37.947 INFO:teuthology.orchestra.run.smithi163.stderr: 4 May 00:21:37 ntpd[17263]: can't open /var/log/ntpstats/loopstats.20240504: Permission denied 2024-05-04T00:21:37.989 INFO:teuthology.orchestra.run.smithi006.stdout: remote refid st t when poll reach delay offset jitter 2024-05-04T00:21:37.989 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================== 2024-05-04T00:21:37.989 INFO:teuthology.orchestra.run.smithi006.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-04T00:21:37.989 INFO:teuthology.orchestra.run.smithi006.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-04T00:21:37.989 INFO:teuthology.orchestra.run.smithi006.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-04T00:21:37.989 INFO:teuthology.orchestra.run.smithi006.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-04T00:21:38.003 INFO:teuthology.orchestra.run.smithi163.stdout: remote refid st t when poll reach delay offset jitter 2024-05-04T00:21:38.003 INFO:teuthology.orchestra.run.smithi163.stdout:============================================================================== 2024-05-04T00:21:38.003 INFO:teuthology.orchestra.run.smithi163.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-04T00:21:38.003 INFO:teuthology.orchestra.run.smithi163.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-04T00:21:38.003 INFO:teuthology.orchestra.run.smithi163.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-04T00:21:38.003 INFO:teuthology.orchestra.run.smithi163.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-04T00:21:38.004 INFO:teuthology.run_tasks:Running task install... 2024-05-04T00:21:38.012 DEBUG:teuthology.task.install:project ceph 2024-05-04T00:21:38.012 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31'}} 2024-05-04T00:21:38.012 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31'} 2024-05-04T00:21:38.012 INFO:teuthology.task.install:Using flavor: default 2024-05-04T00:21:38.020 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-05-04T00:21:38.020 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-04T00:21:38.020 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-key list | grep Ceph 2024-05-04T00:21:38.021 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-key list | grep Ceph 2024-05-04T00:21:38.090 INFO:teuthology.orchestra.run.smithi006.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-04T00:21:38.107 INFO:teuthology.orchestra.run.smithi163.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-04T00:21:38.118 INFO:teuthology.orchestra.run.smithi006.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-04T00:21:38.119 INFO:teuthology.orchestra.run.smithi006.stdout:uid [ unknown] Ceph.com (release key) 2024-05-04T00:21:38.119 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-04T00:21:38.119 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-04T00:21:38.119 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bd4e00a39d766328b458e4c953f4d722fed96a31 2024-05-04T00:21:38.135 INFO:teuthology.orchestra.run.smithi163.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-04T00:21:38.135 INFO:teuthology.orchestra.run.smithi163.stdout:uid [ unknown] Ceph.com (release key) 2024-05-04T00:21:38.136 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-04T00:21:38.136 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-04T00:21:38.136 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bd4e00a39d766328b458e4c953f4d722fed96a31 2024-05-04T00:21:38.343 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default/ 2024-05-04T00:21:38.343 INFO:teuthology.task.install.deb:Package version is 19.0.0-3522-gbd4e00a3-1jammy 2024-05-04T00:21:38.347 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default/ 2024-05-04T00:21:38.348 INFO:teuthology.task.install.deb:Package version is 19.0.0-3522-gbd4e00a3-1jammy 2024-05-04T00:21:38.459 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:21:38.459 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-04T00:21:38.473 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-get update 2024-05-04T00:21:38.516 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:21:38.516 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-04T00:21:38.531 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get update 2024-05-04T00:21:38.646 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-04T00:21:38.660 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-04T00:21:38.661 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-04T00:21:38.680 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-04T00:21:38.709 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-04T00:21:38.755 INFO:teuthology.orchestra.run.smithi006.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy InRelease 2024-05-04T00:21:38.756 INFO:teuthology.orchestra.run.smithi163.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy InRelease 2024-05-04T00:21:38.797 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-04T00:21:38.812 INFO:teuthology.orchestra.run.smithi163.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-04T00:21:38.819 INFO:teuthology.orchestra.run.smithi006.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-04T00:21:38.821 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-04T00:21:38.841 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-04T00:21:38.850 INFO:teuthology.orchestra.run.smithi163.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-04T00:21:38.869 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,411 B] 2024-05-04T00:21:38.887 INFO:teuthology.orchestra.run.smithi163.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,411 B] 2024-05-04T00:21:38.902 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-04T00:21:38.929 INFO:teuthology.orchestra.run.smithi163.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-04T00:21:38.984 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-04T00:21:39.005 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 29.2 kB in 0s (82.5 kB/s) 2024-05-04T00:21:39.130 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 29.2 kB in 0s (70.6 kB/s) 2024-05-04T00:21:39.933 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2024-05-04T00:21:39.949 DEBUG:teuthology.orchestra.run.smithi163:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3522-gbd4e00a3-1jammy cephadm=19.0.0-3522-gbd4e00a3-1jammy ceph-mds=19.0.0-3522-gbd4e00a3-1jammy ceph-mgr=19.0.0-3522-gbd4e00a3-1jammy ceph-common=19.0.0-3522-gbd4e00a3-1jammy ceph-fuse=19.0.0-3522-gbd4e00a3-1jammy ceph-test=19.0.0-3522-gbd4e00a3-1jammy ceph-volume=19.0.0-3522-gbd4e00a3-1jammy radosgw=19.0.0-3522-gbd4e00a3-1jammy python3-rados=19.0.0-3522-gbd4e00a3-1jammy python3-rgw=19.0.0-3522-gbd4e00a3-1jammy python3-cephfs=19.0.0-3522-gbd4e00a3-1jammy python3-rbd=19.0.0-3522-gbd4e00a3-1jammy libcephfs2=19.0.0-3522-gbd4e00a3-1jammy libcephfs-dev=19.0.0-3522-gbd4e00a3-1jammy librados2=19.0.0-3522-gbd4e00a3-1jammy librbd1=19.0.0-3522-gbd4e00a3-1jammy rbd-fuse=19.0.0-3522-gbd4e00a3-1jammy ceph-common-dbg=19.0.0-3522-gbd4e00a3-1jammy ceph-fuse-dbg=19.0.0-3522-gbd4e00a3-1jammy ceph-mds-dbg=19.0.0-3522-gbd4e00a3-1jammy ceph-mgr-dbg=19.0.0-3522-gbd4e00a3-1jammy ceph-mon-dbg=19.0.0-3522-gbd4e00a3-1jammy ceph-osd-dbg=19.0.0-3522-gbd4e00a3-1jammy ceph-test-dbg=19.0.0-3522-gbd4e00a3-1jammy libcephfs2-dbg=19.0.0-3522-gbd4e00a3-1jammy librados2-dbg=19.0.0-3522-gbd4e00a3-1jammy libradosstriper1-dbg=19.0.0-3522-gbd4e00a3-1jammy librbd1-dbg=19.0.0-3522-gbd4e00a3-1jammy librgw2-dbg=19.0.0-3522-gbd4e00a3-1jammy radosgw-dbg=19.0.0-3522-gbd4e00a3-1jammy rbd-fuse-dbg=19.0.0-3522-gbd4e00a3-1jammy rbd-mirror-dbg=19.0.0-3522-gbd4e00a3-1jammy rbd-nbd-dbg=19.0.0-3522-gbd4e00a3-1jammy python3-cephfs=19.0.0-3522-gbd4e00a3-1jammy cephfs-shell=19.0.0-3522-gbd4e00a3-1jammy cephfs-top=19.0.0-3522-gbd4e00a3-1jammy cephfs-mirror=19.0.0-3522-gbd4e00a3-1jammy 2024-05-04T00:21:40.001 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2024-05-04T00:21:40.121 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2024-05-04T00:21:40.135 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3522-gbd4e00a3-1jammy cephadm=19.0.0-3522-gbd4e00a3-1jammy ceph-mds=19.0.0-3522-gbd4e00a3-1jammy ceph-mgr=19.0.0-3522-gbd4e00a3-1jammy ceph-common=19.0.0-3522-gbd4e00a3-1jammy ceph-fuse=19.0.0-3522-gbd4e00a3-1jammy ceph-test=19.0.0-3522-gbd4e00a3-1jammy ceph-volume=19.0.0-3522-gbd4e00a3-1jammy radosgw=19.0.0-3522-gbd4e00a3-1jammy python3-rados=19.0.0-3522-gbd4e00a3-1jammy python3-rgw=19.0.0-3522-gbd4e00a3-1jammy python3-cephfs=19.0.0-3522-gbd4e00a3-1jammy python3-rbd=19.0.0-3522-gbd4e00a3-1jammy libcephfs2=19.0.0-3522-gbd4e00a3-1jammy libcephfs-dev=19.0.0-3522-gbd4e00a3-1jammy librados2=19.0.0-3522-gbd4e00a3-1jammy librbd1=19.0.0-3522-gbd4e00a3-1jammy rbd-fuse=19.0.0-3522-gbd4e00a3-1jammy ceph-common-dbg=19.0.0-3522-gbd4e00a3-1jammy ceph-fuse-dbg=19.0.0-3522-gbd4e00a3-1jammy ceph-mds-dbg=19.0.0-3522-gbd4e00a3-1jammy ceph-mgr-dbg=19.0.0-3522-gbd4e00a3-1jammy ceph-mon-dbg=19.0.0-3522-gbd4e00a3-1jammy ceph-osd-dbg=19.0.0-3522-gbd4e00a3-1jammy ceph-test-dbg=19.0.0-3522-gbd4e00a3-1jammy libcephfs2-dbg=19.0.0-3522-gbd4e00a3-1jammy librados2-dbg=19.0.0-3522-gbd4e00a3-1jammy libradosstriper1-dbg=19.0.0-3522-gbd4e00a3-1jammy librbd1-dbg=19.0.0-3522-gbd4e00a3-1jammy librgw2-dbg=19.0.0-3522-gbd4e00a3-1jammy radosgw-dbg=19.0.0-3522-gbd4e00a3-1jammy rbd-fuse-dbg=19.0.0-3522-gbd4e00a3-1jammy rbd-mirror-dbg=19.0.0-3522-gbd4e00a3-1jammy rbd-nbd-dbg=19.0.0-3522-gbd4e00a3-1jammy python3-cephfs=19.0.0-3522-gbd4e00a3-1jammy cephfs-shell=19.0.0-3522-gbd4e00a3-1jammy cephfs-top=19.0.0-3522-gbd4e00a3-1jammy cephfs-mirror=19.0.0-3522-gbd4e00a3-1jammy 2024-05-04T00:21:40.177 INFO:teuthology.orchestra.run.smithi163.stdout:Building dependency tree... 2024-05-04T00:21:40.178 INFO:teuthology.orchestra.run.smithi163.stdout:Reading state information... 2024-05-04T00:21:40.187 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2024-05-04T00:21:40.349 INFO:teuthology.orchestra.run.smithi163.stdout:The following packages were automatically installed and are no longer required: 2024-05-04T00:21:40.350 INFO:teuthology.orchestra.run.smithi163.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-04T00:21:40.350 INFO:teuthology.orchestra.run.smithi163.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-04T00:21:40.350 INFO:teuthology.orchestra.run.smithi163.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-04T00:21:40.350 INFO:teuthology.orchestra.run.smithi163.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-04T00:21:40.350 INFO:teuthology.orchestra.run.smithi163.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-04T00:21:40.350 INFO:teuthology.orchestra.run.smithi163.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-04T00:21:40.352 INFO:teuthology.orchestra.run.smithi163.stdout:The following additional packages will be installed: 2024-05-04T00:21:40.352 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-04T00:21:40.352 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-04T00:21:40.352 INFO:teuthology.orchestra.run.smithi163.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-04T00:21:40.352 INFO:teuthology.orchestra.run.smithi163.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-04T00:21:40.352 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-04T00:21:40.352 INFO:teuthology.orchestra.run.smithi163.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-04T00:21:40.352 INFO:teuthology.orchestra.run.smithi163.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-04T00:21:40.352 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-04T00:21:40.352 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-04T00:21:40.352 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-04T00:21:40.352 INFO:teuthology.orchestra.run.smithi163.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-04T00:21:40.353 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-04T00:21:40.353 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-04T00:21:40.353 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-04T00:21:40.353 INFO:teuthology.orchestra.run.smithi163.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-04T00:21:40.353 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-04T00:21:40.353 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-04T00:21:40.353 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-04T00:21:40.353 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-04T00:21:40.353 INFO:teuthology.orchestra.run.smithi163.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-04T00:21:40.353 INFO:teuthology.orchestra.run.smithi163.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-04T00:21:40.353 INFO:teuthology.orchestra.run.smithi163.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-04T00:21:40.353 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-04T00:21:40.353 INFO:teuthology.orchestra.run.smithi163.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2024-05-04T00:21:40.354 INFO:teuthology.orchestra.run.smithi163.stdout:Suggested packages: 2024-05-04T00:21:40.354 INFO:teuthology.orchestra.run.smithi163.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-04T00:21:40.354 INFO:teuthology.orchestra.run.smithi163.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-04T00:21:40.354 INFO:teuthology.orchestra.run.smithi163.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-04T00:21:40.354 INFO:teuthology.orchestra.run.smithi163.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-04T00:21:40.354 INFO:teuthology.orchestra.run.smithi163.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-04T00:21:40.354 INFO:teuthology.orchestra.run.smithi163.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-04T00:21:40.354 INFO:teuthology.orchestra.run.smithi163.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-04T00:21:40.354 INFO:teuthology.orchestra.run.smithi163.stdout:Recommended packages: 2024-05-04T00:21:40.354 INFO:teuthology.orchestra.run.smithi163.stdout: btrfs-tools 2024-05-04T00:21:40.367 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2024-05-04T00:21:40.367 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2024-05-04T00:21:40.481 INFO:teuthology.orchestra.run.smithi163.stdout:The following NEW packages will be installed: 2024-05-04T00:21:40.481 INFO:teuthology.orchestra.run.smithi163.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-05-04T00:21:40.481 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-05-04T00:21:40.482 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-05-04T00:21:40.482 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-05-04T00:21:40.482 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2024-05-04T00:21:40.482 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2024-05-04T00:21:40.482 INFO:teuthology.orchestra.run.smithi163.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-04T00:21:40.482 INFO:teuthology.orchestra.run.smithi163.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2024-05-04T00:21:40.482 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2024-05-04T00:21:40.483 INFO:teuthology.orchestra.run.smithi163.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-04T00:21:40.483 INFO:teuthology.orchestra.run.smithi163.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-04T00:21:40.483 INFO:teuthology.orchestra.run.smithi163.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-04T00:21:40.483 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-04T00:21:40.483 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-04T00:21:40.483 INFO:teuthology.orchestra.run.smithi163.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-04T00:21:40.483 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-04T00:21:40.484 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-04T00:21:40.484 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-04T00:21:40.484 INFO:teuthology.orchestra.run.smithi163.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-04T00:21:40.484 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-04T00:21:40.484 INFO:teuthology.orchestra.run.smithi163.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-04T00:21:40.484 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-04T00:21:40.484 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-04T00:21:40.484 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-04T00:21:40.484 INFO:teuthology.orchestra.run.smithi163.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-04T00:21:40.484 INFO:teuthology.orchestra.run.smithi163.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-04T00:21:40.484 INFO:teuthology.orchestra.run.smithi163.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-04T00:21:40.484 INFO:teuthology.orchestra.run.smithi163.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-04T00:21:40.484 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-05-04T00:21:40.484 INFO:teuthology.orchestra.run.smithi163.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-05-04T00:21:40.484 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-05-04T00:21:40.547 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages were automatically installed and are no longer required: 2024-05-04T00:21:40.547 INFO:teuthology.orchestra.run.smithi006.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-04T00:21:40.547 INFO:teuthology.orchestra.run.smithi006.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-04T00:21:40.547 INFO:teuthology.orchestra.run.smithi006.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-04T00:21:40.548 INFO:teuthology.orchestra.run.smithi006.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-04T00:21:40.548 INFO:teuthology.orchestra.run.smithi006.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-04T00:21:40.548 INFO:teuthology.orchestra.run.smithi006.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-04T00:21:40.550 INFO:teuthology.orchestra.run.smithi006.stdout:The following additional packages will be installed: 2024-05-04T00:21:40.550 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-04T00:21:40.550 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-04T00:21:40.550 INFO:teuthology.orchestra.run.smithi006.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-04T00:21:40.550 INFO:teuthology.orchestra.run.smithi006.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-04T00:21:40.550 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-04T00:21:40.550 INFO:teuthology.orchestra.run.smithi006.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-04T00:21:40.550 INFO:teuthology.orchestra.run.smithi006.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-04T00:21:40.550 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-04T00:21:40.550 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-04T00:21:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-04T00:21:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-04T00:21:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-04T00:21:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-04T00:21:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-04T00:21:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-04T00:21:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-04T00:21:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-04T00:21:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-04T00:21:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-04T00:21:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-04T00:21:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-04T00:21:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-04T00:21:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-04T00:21:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2024-05-04T00:21:40.552 INFO:teuthology.orchestra.run.smithi006.stdout:Suggested packages: 2024-05-04T00:21:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-04T00:21:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-04T00:21:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-04T00:21:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-04T00:21:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-04T00:21:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-04T00:21:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-04T00:21:40.553 INFO:teuthology.orchestra.run.smithi006.stdout:Recommended packages: 2024-05-04T00:21:40.553 INFO:teuthology.orchestra.run.smithi006.stdout: btrfs-tools 2024-05-04T00:21:40.640 INFO:teuthology.orchestra.run.smithi163.stdout:0 upgraded, 142 newly installed, 0 to remove and 303 not upgraded. 2024-05-04T00:21:40.640 INFO:teuthology.orchestra.run.smithi163.stdout:Need to get 3,630 MB of archives. 2024-05-04T00:21:40.640 INFO:teuthology.orchestra.run.smithi163.stdout:After this operation, 4,678 MB of additional disk space will be used. 2024-05-04T00:21:40.640 INFO:teuthology.orchestra.run.smithi163.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3522-gbd4e00a3-1jammy [3,525 kB] 2024-05-04T00:21:40.671 INFO:teuthology.orchestra.run.smithi163.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-04T00:21:40.682 INFO:teuthology.orchestra.run.smithi006.stdout:The following NEW packages will be installed: 2024-05-04T00:21:40.683 INFO:teuthology.orchestra.run.smithi006.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-05-04T00:21:40.683 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-05-04T00:21:40.683 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-05-04T00:21:40.683 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-05-04T00:21:40.684 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2024-05-04T00:21:40.685 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2024-05-04T00:21:40.685 INFO:teuthology.orchestra.run.smithi006.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-04T00:21:40.685 INFO:teuthology.orchestra.run.smithi006.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2024-05-04T00:21:40.685 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2024-05-04T00:21:40.685 INFO:teuthology.orchestra.run.smithi006.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-04T00:21:40.685 INFO:teuthology.orchestra.run.smithi006.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-04T00:21:40.685 INFO:teuthology.orchestra.run.smithi006.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-04T00:21:40.685 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-04T00:21:40.685 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-04T00:21:40.685 INFO:teuthology.orchestra.run.smithi006.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-04T00:21:40.685 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-04T00:21:40.685 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-04T00:21:40.685 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-04T00:21:40.686 INFO:teuthology.orchestra.run.smithi006.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-04T00:21:40.686 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-04T00:21:40.686 INFO:teuthology.orchestra.run.smithi006.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-04T00:21:40.686 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-04T00:21:40.686 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-04T00:21:40.686 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-04T00:21:40.686 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-04T00:21:40.686 INFO:teuthology.orchestra.run.smithi006.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-04T00:21:40.686 INFO:teuthology.orchestra.run.smithi006.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-04T00:21:40.686 INFO:teuthology.orchestra.run.smithi006.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-04T00:21:40.686 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-05-04T00:21:40.686 INFO:teuthology.orchestra.run.smithi006.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-05-04T00:21:40.686 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-05-04T00:21:40.753 INFO:teuthology.orchestra.run.smithi163.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-04T00:21:40.799 INFO:teuthology.orchestra.run.smithi163.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-04T00:21:40.831 INFO:teuthology.orchestra.run.smithi006.stdout:0 upgraded, 142 newly installed, 0 to remove and 303 not upgraded. 2024-05-04T00:21:40.832 INFO:teuthology.orchestra.run.smithi006.stdout:Need to get 3,630 MB of archives. 2024-05-04T00:21:40.832 INFO:teuthology.orchestra.run.smithi006.stdout:After this operation, 4,678 MB of additional disk space will be used. 2024-05-04T00:21:40.832 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3522-gbd4e00a3-1jammy [3,525 kB] 2024-05-04T00:21:40.874 INFO:teuthology.orchestra.run.smithi006.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-04T00:21:40.927 INFO:teuthology.orchestra.run.smithi163.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3522-gbd4e00a3-1jammy [3,287 kB] 2024-05-04T00:21:40.957 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-04T00:21:40.994 INFO:teuthology.orchestra.run.smithi163.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-04T00:21:41.002 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-04T00:21:41.092 INFO:teuthology.orchestra.run.smithi163.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-04T00:21:41.104 INFO:teuthology.orchestra.run.smithi163.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-04T00:21:41.130 INFO:teuthology.orchestra.run.smithi163.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3522-gbd4e00a3-1jammy [727 kB] 2024-05-04T00:21:41.153 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3522-gbd4e00a3-1jammy [3,287 kB] 2024-05-04T00:21:41.157 INFO:teuthology.orchestra.run.smithi163.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-04T00:21:41.168 INFO:teuthology.orchestra.run.smithi163.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3522-gbd4e00a3-1jammy [356 kB] 2024-05-04T00:21:41.181 INFO:teuthology.orchestra.run.smithi163.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3522-gbd4e00a3-1jammy [32.8 kB] 2024-05-04T00:21:41.182 INFO:teuthology.orchestra.run.smithi163.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3522-gbd4e00a3-1jammy [180 kB] 2024-05-04T00:21:41.187 INFO:teuthology.orchestra.run.smithi163.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3522-gbd4e00a3-1jammy [67.4 kB] 2024-05-04T00:21:41.197 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-04T00:21:41.200 INFO:teuthology.orchestra.run.smithi163.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3522-gbd4e00a3-1jammy [330 kB] 2024-05-04T00:21:41.216 INFO:teuthology.orchestra.run.smithi163.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3522-gbd4e00a3-1jammy [7,190 kB] 2024-05-04T00:21:41.295 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-04T00:21:41.308 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-04T00:21:41.331 INFO:teuthology.orchestra.run.smithi163.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-04T00:21:41.339 INFO:teuthology.orchestra.run.smithi163.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-04T00:21:41.360 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-04T00:21:41.367 INFO:teuthology.orchestra.run.smithi163.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-04T00:21:41.376 INFO:teuthology.orchestra.run.smithi163.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-04T00:21:41.406 INFO:teuthology.orchestra.run.smithi006.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3522-gbd4e00a3-1jammy [727 kB] 2024-05-04T00:21:41.459 INFO:teuthology.orchestra.run.smithi006.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3522-gbd4e00a3-1jammy [356 kB] 2024-05-04T00:21:41.499 INFO:teuthology.orchestra.run.smithi006.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3522-gbd4e00a3-1jammy [32.8 kB] 2024-05-04T00:21:41.500 INFO:teuthology.orchestra.run.smithi006.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3522-gbd4e00a3-1jammy [180 kB] 2024-05-04T00:21:41.508 INFO:teuthology.orchestra.run.smithi006.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3522-gbd4e00a3-1jammy [67.4 kB] 2024-05-04T00:21:41.511 INFO:teuthology.orchestra.run.smithi006.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3522-gbd4e00a3-1jammy [330 kB] 2024-05-04T00:21:41.533 INFO:teuthology.orchestra.run.smithi006.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-04T00:21:41.540 INFO:teuthology.orchestra.run.smithi163.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-04T00:21:41.542 INFO:teuthology.orchestra.run.smithi006.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-04T00:21:41.570 INFO:teuthology.orchestra.run.smithi006.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-04T00:21:41.573 INFO:teuthology.orchestra.run.smithi006.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3522-gbd4e00a3-1jammy [7,190 kB] 2024-05-04T00:21:41.578 INFO:teuthology.orchestra.run.smithi006.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-04T00:21:41.610 INFO:teuthology.orchestra.run.smithi163.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3522-gbd4e00a3-1jammy [112 kB] 2024-05-04T00:21:41.612 INFO:teuthology.orchestra.run.smithi163.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3522-gbd4e00a3-1jammy [471 kB] 2024-05-04T00:21:41.627 INFO:teuthology.orchestra.run.smithi163.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3522-gbd4e00a3-1jammy [25.6 MB] 2024-05-04T00:21:41.743 INFO:teuthology.orchestra.run.smithi006.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-04T00:21:42.114 INFO:teuthology.orchestra.run.smithi163.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-04T00:21:42.129 INFO:teuthology.orchestra.run.smithi163.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-04T00:21:42.144 INFO:teuthology.orchestra.run.smithi163.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-04T00:21:42.153 INFO:teuthology.orchestra.run.smithi163.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-04T00:21:42.153 INFO:teuthology.orchestra.run.smithi163.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-04T00:21:42.170 INFO:teuthology.orchestra.run.smithi163.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-04T00:21:42.208 INFO:teuthology.orchestra.run.smithi163.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-04T00:21:42.221 INFO:teuthology.orchestra.run.smithi163.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-04T00:21:42.225 INFO:teuthology.orchestra.run.smithi163.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-04T00:21:42.226 INFO:teuthology.orchestra.run.smithi163.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-04T00:21:42.314 INFO:teuthology.orchestra.run.smithi006.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-04T00:21:42.351 INFO:teuthology.orchestra.run.smithi006.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-04T00:21:42.372 INFO:teuthology.orchestra.run.smithi006.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3522-gbd4e00a3-1jammy [112 kB] 2024-05-04T00:21:42.375 INFO:teuthology.orchestra.run.smithi006.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3522-gbd4e00a3-1jammy [471 kB] 2024-05-04T00:21:42.396 INFO:teuthology.orchestra.run.smithi163.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-04T00:21:42.428 INFO:teuthology.orchestra.run.smithi006.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3522-gbd4e00a3-1jammy [25.6 MB] 2024-05-04T00:21:42.479 INFO:teuthology.orchestra.run.smithi163.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-04T00:21:42.501 INFO:teuthology.orchestra.run.smithi163.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-04T00:21:42.561 INFO:teuthology.orchestra.run.smithi163.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-04T00:21:42.573 INFO:teuthology.orchestra.run.smithi006.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-04T00:21:42.581 INFO:teuthology.orchestra.run.smithi006.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-04T00:21:42.582 INFO:teuthology.orchestra.run.smithi006.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-04T00:21:42.598 INFO:teuthology.orchestra.run.smithi006.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-04T00:21:42.600 INFO:teuthology.orchestra.run.smithi163.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-04T00:21:42.614 INFO:teuthology.orchestra.run.smithi006.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-04T00:21:42.622 INFO:teuthology.orchestra.run.smithi163.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-04T00:21:42.627 INFO:teuthology.orchestra.run.smithi006.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-04T00:21:42.631 INFO:teuthology.orchestra.run.smithi006.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-04T00:21:42.632 INFO:teuthology.orchestra.run.smithi006.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-04T00:21:42.649 INFO:teuthology.orchestra.run.smithi163.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-04T00:21:42.802 INFO:teuthology.orchestra.run.smithi006.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-04T00:21:42.833 INFO:teuthology.orchestra.run.smithi163.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-04T00:21:42.848 INFO:teuthology.orchestra.run.smithi163.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-04T00:21:42.856 INFO:teuthology.orchestra.run.smithi163.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-04T00:21:42.861 INFO:teuthology.orchestra.run.smithi163.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-04T00:21:42.885 INFO:teuthology.orchestra.run.smithi006.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-04T00:21:42.891 INFO:teuthology.orchestra.run.smithi006.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-04T00:21:42.967 INFO:teuthology.orchestra.run.smithi006.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-04T00:21:42.993 INFO:teuthology.orchestra.run.smithi006.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-04T00:21:42.994 INFO:teuthology.orchestra.run.smithi163.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3522-gbd4e00a3-1jammy [4,918 kB] 2024-05-04T00:21:43.009 INFO:teuthology.orchestra.run.smithi006.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-04T00:21:43.025 INFO:teuthology.orchestra.run.smithi006.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-04T00:21:43.048 INFO:teuthology.orchestra.run.smithi163.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-04T00:21:43.133 INFO:teuthology.orchestra.run.smithi163.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-04T00:21:43.145 INFO:teuthology.orchestra.run.smithi163.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3522-gbd4e00a3-1jammy [244 kB] 2024-05-04T00:21:43.149 INFO:teuthology.orchestra.run.smithi163.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-04T00:21:43.159 INFO:teuthology.orchestra.run.smithi163.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3522-gbd4e00a3-1jammy [125 kB] 2024-05-04T00:21:43.163 INFO:teuthology.orchestra.run.smithi163.stdout:Get:52 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3522-gbd4e00a3-1jammy [1,542 kB] 2024-05-04T00:21:43.210 INFO:teuthology.orchestra.run.smithi006.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-04T00:21:43.227 INFO:teuthology.orchestra.run.smithi006.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-04T00:21:43.234 INFO:teuthology.orchestra.run.smithi006.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-04T00:21:43.237 INFO:teuthology.orchestra.run.smithi163.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3522-gbd4e00a3-1jammy [6,149 kB] 2024-05-04T00:21:43.238 INFO:teuthology.orchestra.run.smithi006.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-04T00:21:43.338 INFO:teuthology.orchestra.run.smithi163.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-04T00:21:43.388 INFO:teuthology.orchestra.run.smithi163.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-04T00:21:43.401 INFO:teuthology.orchestra.run.smithi163.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-04T00:21:43.423 INFO:teuthology.orchestra.run.smithi006.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-04T00:21:43.506 INFO:teuthology.orchestra.run.smithi006.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-04T00:21:43.523 INFO:teuthology.orchestra.run.smithi006.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-04T00:21:43.558 INFO:teuthology.orchestra.run.smithi163.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3522-gbd4e00a3-1jammy [22.5 MB] 2024-05-04T00:21:43.560 INFO:teuthology.orchestra.run.smithi163.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-04T00:21:43.561 INFO:teuthology.orchestra.run.smithi163.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-04T00:21:43.565 INFO:teuthology.orchestra.run.smithi163.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-04T00:21:43.570 INFO:teuthology.orchestra.run.smithi163.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-04T00:21:43.584 INFO:teuthology.orchestra.run.smithi163.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-04T00:21:43.709 INFO:teuthology.orchestra.run.smithi006.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-04T00:21:43.760 INFO:teuthology.orchestra.run.smithi006.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-04T00:21:43.774 INFO:teuthology.orchestra.run.smithi163.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-04T00:21:43.774 INFO:teuthology.orchestra.run.smithi006.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-04T00:21:43.933 INFO:teuthology.orchestra.run.smithi006.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-04T00:21:43.934 INFO:teuthology.orchestra.run.smithi006.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-04T00:21:43.939 INFO:teuthology.orchestra.run.smithi006.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-04T00:21:43.943 INFO:teuthology.orchestra.run.smithi006.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-04T00:21:43.958 INFO:teuthology.orchestra.run.smithi006.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-04T00:21:44.059 INFO:teuthology.orchestra.run.smithi163.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-04T00:21:44.143 INFO:teuthology.orchestra.run.smithi006.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-04T00:21:44.228 INFO:teuthology.orchestra.run.smithi163.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-04T00:21:44.325 INFO:teuthology.orchestra.run.smithi163.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-04T00:21:44.407 INFO:teuthology.orchestra.run.smithi006.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-04T00:21:44.525 INFO:teuthology.orchestra.run.smithi006.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-04T00:21:44.569 INFO:teuthology.orchestra.run.smithi006.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-04T00:21:44.651 INFO:teuthology.orchestra.run.smithi006.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-04T00:21:44.663 INFO:teuthology.orchestra.run.smithi006.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-04T00:21:44.676 INFO:teuthology.orchestra.run.smithi006.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-04T00:21:44.716 INFO:teuthology.orchestra.run.smithi006.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-04T00:21:44.793 INFO:teuthology.orchestra.run.smithi163.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-04T00:21:44.795 INFO:teuthology.orchestra.run.smithi163.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3522-gbd4e00a3-1jammy [14.0 kB] 2024-05-04T00:21:44.796 INFO:teuthology.orchestra.run.smithi163.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3522-gbd4e00a3-1jammy [857 kB] 2024-05-04T00:21:44.812 INFO:teuthology.orchestra.run.smithi163.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3522-gbd4e00a3-1jammy [2,369 kB] 2024-05-04T00:21:44.834 INFO:teuthology.orchestra.run.smithi006.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3522-gbd4e00a3-1jammy [4,918 kB] 2024-05-04T00:21:44.853 INFO:teuthology.orchestra.run.smithi163.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3522-gbd4e00a3-1jammy [792 kB] 2024-05-04T00:21:44.867 INFO:teuthology.orchestra.run.smithi163.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-04T00:21:44.889 INFO:teuthology.orchestra.run.smithi163.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3522-gbd4e00a3-1jammy [148 kB] 2024-05-04T00:21:44.911 INFO:teuthology.orchestra.run.smithi163.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3522-gbd4e00a3-1jammy [2,279 kB] 2024-05-04T00:21:44.941 INFO:teuthology.orchestra.run.smithi163.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-04T00:21:44.979 INFO:teuthology.orchestra.run.smithi006.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-04T00:21:44.981 INFO:teuthology.orchestra.run.smithi006.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-04T00:21:44.984 INFO:teuthology.orchestra.run.smithi006.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-04T00:21:45.013 INFO:teuthology.orchestra.run.smithi163.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3522-gbd4e00a3-1jammy [8,625 kB] 2024-05-04T00:21:45.149 INFO:teuthology.orchestra.run.smithi006.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-04T00:21:45.211 INFO:teuthology.orchestra.run.smithi006.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3522-gbd4e00a3-1jammy [244 kB] 2024-05-04T00:21:45.249 INFO:teuthology.orchestra.run.smithi006.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3522-gbd4e00a3-1jammy [125 kB] 2024-05-04T00:21:45.270 INFO:teuthology.orchestra.run.smithi006.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3522-gbd4e00a3-1jammy [1,542 kB] 2024-05-04T00:21:45.306 INFO:teuthology.orchestra.run.smithi163.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-04T00:21:45.403 INFO:teuthology.orchestra.run.smithi006.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3522-gbd4e00a3-1jammy [6,149 kB] 2024-05-04T00:21:45.461 INFO:teuthology.orchestra.run.smithi163.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3522-gbd4e00a3-1jammy [14.2 kB] 2024-05-04T00:21:45.462 INFO:teuthology.orchestra.run.smithi163.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3522-gbd4e00a3-1jammy [44.9 MB] 2024-05-04T00:21:45.487 INFO:teuthology.orchestra.run.smithi006.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-04T00:21:45.969 INFO:teuthology.orchestra.run.smithi006.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-04T00:21:45.972 INFO:teuthology.orchestra.run.smithi006.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3522-gbd4e00a3-1jammy [22.5 MB] 2024-05-04T00:21:45.981 INFO:teuthology.orchestra.run.smithi006.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-04T00:21:45.981 INFO:teuthology.orchestra.run.smithi006.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-04T00:21:46.052 INFO:teuthology.orchestra.run.smithi006.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-04T00:21:46.053 INFO:teuthology.orchestra.run.smithi006.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-04T00:21:46.055 INFO:teuthology.orchestra.run.smithi006.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-04T00:21:46.057 INFO:teuthology.orchestra.run.smithi006.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-04T00:21:46.058 INFO:teuthology.orchestra.run.smithi006.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-04T00:21:46.226 INFO:teuthology.orchestra.run.smithi006.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-04T00:21:46.322 INFO:teuthology.orchestra.run.smithi006.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-04T00:21:46.417 INFO:teuthology.orchestra.run.smithi006.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-04T00:21:46.663 INFO:teuthology.orchestra.run.smithi006.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-04T00:21:46.706 INFO:teuthology.orchestra.run.smithi006.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-04T00:21:46.731 INFO:teuthology.orchestra.run.smithi006.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-04T00:21:46.739 INFO:teuthology.orchestra.run.smithi006.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-04T00:21:46.783 INFO:teuthology.orchestra.run.smithi006.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-04T00:21:46.808 INFO:teuthology.orchestra.run.smithi006.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-04T00:21:46.810 INFO:teuthology.orchestra.run.smithi006.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-04T00:21:46.817 INFO:teuthology.orchestra.run.smithi006.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-04T00:21:46.984 INFO:teuthology.orchestra.run.smithi006.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-04T00:21:47.519 INFO:teuthology.orchestra.run.smithi006.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-04T00:21:47.525 INFO:teuthology.orchestra.run.smithi006.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-04T00:21:47.565 INFO:teuthology.orchestra.run.smithi006.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-04T00:21:47.565 INFO:teuthology.orchestra.run.smithi006.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-04T00:21:47.572 INFO:teuthology.orchestra.run.smithi006.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-04T00:21:47.574 INFO:teuthology.orchestra.run.smithi006.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-04T00:21:47.615 INFO:teuthology.orchestra.run.smithi006.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-04T00:21:47.624 INFO:teuthology.orchestra.run.smithi006.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-04T00:21:47.696 INFO:teuthology.orchestra.run.smithi006.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-04T00:21:47.698 INFO:teuthology.orchestra.run.smithi006.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-04T00:21:47.791 INFO:teuthology.orchestra.run.smithi163.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3522-gbd4e00a3-1jammy [124 kB] 2024-05-04T00:21:47.794 INFO:teuthology.orchestra.run.smithi163.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3522-gbd4e00a3-1jammy [236 kB] 2024-05-04T00:21:47.799 INFO:teuthology.orchestra.run.smithi163.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3522-gbd4e00a3-1jammy [33.9 kB] 2024-05-04T00:21:47.801 INFO:teuthology.orchestra.run.smithi163.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3522-gbd4e00a3-1jammy [23.4 kB] 2024-05-04T00:21:47.852 INFO:teuthology.orchestra.run.smithi163.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3522-gbd4e00a3-1jammy [38.9 kB] 2024-05-04T00:21:47.853 INFO:teuthology.orchestra.run.smithi163.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3522-gbd4e00a3-1jammy [14.1 MB] 2024-05-04T00:21:47.862 INFO:teuthology.orchestra.run.smithi006.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-04T00:21:48.298 INFO:teuthology.orchestra.run.smithi006.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-04T00:21:48.359 INFO:teuthology.orchestra.run.smithi163.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3522-gbd4e00a3-1jammy [92.6 kB] 2024-05-04T00:21:48.361 INFO:teuthology.orchestra.run.smithi163.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-3522-gbd4e00a3-1jammy [3,125 kB] 2024-05-04T00:21:48.363 INFO:teuthology.orchestra.run.smithi006.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-04T00:21:48.397 INFO:teuthology.orchestra.run.smithi006.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3522-gbd4e00a3-1jammy [14.0 kB] 2024-05-04T00:21:48.397 INFO:teuthology.orchestra.run.smithi006.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3522-gbd4e00a3-1jammy [857 kB] 2024-05-04T00:21:48.414 INFO:teuthology.orchestra.run.smithi006.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3522-gbd4e00a3-1jammy [2,369 kB] 2024-05-04T00:21:48.499 INFO:teuthology.orchestra.run.smithi163.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-3522-gbd4e00a3-1jammy [181 kB] 2024-05-04T00:21:48.504 INFO:teuthology.orchestra.run.smithi163.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [717 MB] 2024-05-04T00:21:48.668 INFO:teuthology.orchestra.run.smithi006.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3522-gbd4e00a3-1jammy [792 kB] 2024-05-04T00:21:48.749 INFO:teuthology.orchestra.run.smithi006.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3522-gbd4e00a3-1jammy [148 kB] 2024-05-04T00:21:48.779 INFO:teuthology.orchestra.run.smithi006.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3522-gbd4e00a3-1jammy [2,279 kB] 2024-05-04T00:21:49.020 INFO:teuthology.orchestra.run.smithi006.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3522-gbd4e00a3-1jammy [8,625 kB] 2024-05-04T00:21:49.958 INFO:teuthology.orchestra.run.smithi006.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3522-gbd4e00a3-1jammy [14.2 kB] 2024-05-04T00:21:49.958 INFO:teuthology.orchestra.run.smithi006.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3522-gbd4e00a3-1jammy [44.9 MB] 2024-05-04T00:21:55.495 INFO:teuthology.orchestra.run.smithi163.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-04T00:21:55.684 INFO:teuthology.orchestra.run.smithi163.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-04T00:21:55.939 INFO:teuthology.orchestra.run.smithi163.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-04T00:21:55.940 INFO:teuthology.orchestra.run.smithi006.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3522-gbd4e00a3-1jammy [124 kB] 2024-05-04T00:21:55.943 INFO:teuthology.orchestra.run.smithi006.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3522-gbd4e00a3-1jammy [236 kB] 2024-05-04T00:21:55.948 INFO:teuthology.orchestra.run.smithi006.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3522-gbd4e00a3-1jammy [33.9 kB] 2024-05-04T00:21:55.949 INFO:teuthology.orchestra.run.smithi006.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3522-gbd4e00a3-1jammy [23.4 kB] 2024-05-04T00:21:56.000 INFO:teuthology.orchestra.run.smithi006.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3522-gbd4e00a3-1jammy [38.9 kB] 2024-05-04T00:21:56.002 INFO:teuthology.orchestra.run.smithi006.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3522-gbd4e00a3-1jammy [14.1 MB] 2024-05-04T00:21:56.144 INFO:teuthology.orchestra.run.smithi163.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-04T00:21:56.483 INFO:teuthology.orchestra.run.smithi163.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-04T00:21:56.882 INFO:teuthology.orchestra.run.smithi163.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-04T00:21:56.892 INFO:teuthology.orchestra.run.smithi163.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-04T00:21:56.893 INFO:teuthology.orchestra.run.smithi163.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-04T00:21:56.963 INFO:teuthology.orchestra.run.smithi163.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-04T00:21:56.963 INFO:teuthology.orchestra.run.smithi163.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-04T00:21:56.965 INFO:teuthology.orchestra.run.smithi163.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-04T00:21:56.966 INFO:teuthology.orchestra.run.smithi163.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-04T00:21:56.968 INFO:teuthology.orchestra.run.smithi163.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-04T00:21:57.133 INFO:teuthology.orchestra.run.smithi163.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-04T00:21:57.234 INFO:teuthology.orchestra.run.smithi163.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-04T00:21:57.325 INFO:teuthology.orchestra.run.smithi163.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-04T00:21:57.566 INFO:teuthology.orchestra.run.smithi163.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-04T00:21:57.608 INFO:teuthology.orchestra.run.smithi163.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-04T00:21:57.633 INFO:teuthology.orchestra.run.smithi163.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-04T00:21:57.641 INFO:teuthology.orchestra.run.smithi163.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-04T00:21:57.668 INFO:teuthology.orchestra.run.smithi006.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3522-gbd4e00a3-1jammy [92.6 kB] 2024-05-04T00:21:57.670 INFO:teuthology.orchestra.run.smithi006.stdout:Get:125 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-3522-gbd4e00a3-1jammy [3,125 kB] 2024-05-04T00:21:57.686 INFO:teuthology.orchestra.run.smithi163.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-04T00:21:57.711 INFO:teuthology.orchestra.run.smithi163.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-04T00:21:57.712 INFO:teuthology.orchestra.run.smithi163.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-04T00:21:57.719 INFO:teuthology.orchestra.run.smithi163.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-04T00:21:57.886 INFO:teuthology.orchestra.run.smithi163.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-04T00:21:58.288 INFO:teuthology.orchestra.run.smithi006.stdout:Get:126 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-3522-gbd4e00a3-1jammy [181 kB] 2024-05-04T00:21:58.350 INFO:teuthology.orchestra.run.smithi006.stdout:Get:127 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [717 MB] 2024-05-04T00:21:58.426 INFO:teuthology.orchestra.run.smithi163.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-04T00:21:58.431 INFO:teuthology.orchestra.run.smithi163.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-04T00:21:58.471 INFO:teuthology.orchestra.run.smithi163.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-04T00:21:58.472 INFO:teuthology.orchestra.run.smithi163.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-04T00:21:58.478 INFO:teuthology.orchestra.run.smithi163.stdout:Get:119 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-04T00:21:58.481 INFO:teuthology.orchestra.run.smithi163.stdout:Get:120 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-04T00:21:58.521 INFO:teuthology.orchestra.run.smithi163.stdout:Get:121 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-04T00:21:58.531 INFO:teuthology.orchestra.run.smithi163.stdout:Get:122 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-04T00:21:58.603 INFO:teuthology.orchestra.run.smithi163.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-04T00:21:58.604 INFO:teuthology.orchestra.run.smithi163.stdout:Get:124 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-04T00:21:58.770 INFO:teuthology.orchestra.run.smithi163.stdout:Get:125 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-04T00:21:59.221 INFO:teuthology.orchestra.run.smithi163.stdout:Get:126 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-04T00:21:59.237 INFO:teuthology.orchestra.run.smithi163.stdout:Get:127 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-04T00:22:38.188 INFO:teuthology.orchestra.run.smithi163.stdout:Get:128 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [18.2 MB] 2024-05-04T00:22:39.337 INFO:teuthology.orchestra.run.smithi163.stdout:Get:129 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [79.8 MB] 2024-05-04T00:22:45.259 INFO:teuthology.orchestra.run.smithi163.stdout:Get:130 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [42.4 MB] 2024-05-04T00:22:50.911 INFO:teuthology.orchestra.run.smithi163.stdout:Get:131 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [156 MB] 2024-05-04T00:22:56.714 INFO:teuthology.orchestra.run.smithi006.stdout:Get:128 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [18.2 MB] 2024-05-04T00:22:57.453 INFO:teuthology.orchestra.run.smithi006.stdout:Get:129 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [79.8 MB] 2024-05-04T00:23:01.081 INFO:teuthology.orchestra.run.smithi006.stdout:Get:130 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [42.4 MB] 2024-05-04T00:23:03.015 INFO:teuthology.orchestra.run.smithi006.stdout:Get:131 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [156 MB] 2024-05-04T00:23:08.450 INFO:teuthology.orchestra.run.smithi163.stdout:Get:132 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [530 MB] 2024-05-04T00:23:10.271 INFO:teuthology.orchestra.run.smithi006.stdout:Get:132 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [530 MB] 2024-05-04T00:23:36.491 INFO:teuthology.orchestra.run.smithi006.stdout:Get:133 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [1,054 MB] 2024-05-04T00:24:15.221 INFO:teuthology.orchestra.run.smithi163.stdout:Get:133 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [1,054 MB] 2024-05-04T00:24:24.342 INFO:teuthology.orchestra.run.smithi006.stdout:Get:134 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [16.2 MB] 2024-05-04T00:24:25.083 INFO:teuthology.orchestra.run.smithi006.stdout:Get:135 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [85.1 MB] 2024-05-04T00:24:29.602 INFO:teuthology.orchestra.run.smithi006.stdout:Get:136 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [11.4 MB] 2024-05-04T00:24:29.973 INFO:teuthology.orchestra.run.smithi006.stdout:Get:137 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [105 MB] 2024-05-04T00:24:35.488 INFO:teuthology.orchestra.run.smithi006.stdout:Get:138 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [180 MB] 2024-05-04T00:24:43.849 INFO:teuthology.orchestra.run.smithi006.stdout:Get:139 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [353 MB] 2024-05-04T00:25:02.539 INFO:teuthology.orchestra.run.smithi006.stdout:Get:140 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [1,758 kB] 2024-05-04T00:25:02.572 INFO:teuthology.orchestra.run.smithi006.stdout:Get:141 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [99.7 MB] 2024-05-04T00:25:13.768 INFO:teuthology.orchestra.run.smithi006.stdout:Get:142 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [3,102 kB] 2024-05-04T00:25:14.483 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 3,630 MB in 3min 33s (17.0 MB/s) 2024-05-04T00:25:14.622 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-04T00:25:14.722 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-05-04T00:25:14.727 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-04T00:25:14.770 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-04T00:25:15.073 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-04T00:25:15.100 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-04T00:25:15.140 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-04T00:25:15.409 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cmd2. 2024-05-04T00:25:15.436 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-04T00:25:15.468 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-04T00:25:15.846 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-04T00:25:15.872 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-04T00:25:15.954 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-04T00:25:16.270 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-04T00:25:16.293 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-04T00:25:16.335 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-04T00:25:16.661 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-04T00:25:16.688 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-04T00:25:16.728 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-04T00:25:17.205 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-04T00:25:17.232 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-04T00:25:17.281 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-04T00:25:17.650 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-04T00:25:17.677 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-04T00:25:17.708 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-04T00:25:18.045 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-04T00:25:18.072 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-04T00:25:18.111 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-04T00:25:18.464 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-04T00:25:18.491 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-04T00:25:18.531 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-04T00:25:18.851 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librados2. 2024-05-04T00:25:18.877 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../010-librados2_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:18.917 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librados2 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:19.495 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librbd1. 2024-05-04T00:25:19.521 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../011-librbd1_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:19.562 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librbd1 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:20.040 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libcephfs2. 2024-05-04T00:25:20.066 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:20.106 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libcephfs2 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:20.400 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rados. 2024-05-04T00:25:20.427 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:20.467 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rados (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:20.778 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-04T00:25:20.805 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:25:20.836 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-ceph-argparse (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:21.038 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cephfs. 2024-05-04T00:25:21.065 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:21.105 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cephfs (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:21.416 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-04T00:25:21.443 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:25:21.483 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-ceph-common (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:21.819 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-prettytable. 2024-05-04T00:25:21.846 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-04T00:25:21.894 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-04T00:25:22.155 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rbd. 2024-05-04T00:25:22.182 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:22.222 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rbd (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:22.508 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-04T00:25:22.534 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-04T00:25:22.566 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-04T00:25:22.835 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-04T00:25:22.851 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-04T00:25:22.893 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-04T00:25:23.196 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-04T00:25:23.212 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-04T00:25:23.254 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-04T00:25:23.608 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package lua5.1. 2024-05-04T00:25:23.637 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-04T00:25:23.674 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-04T00:25:23.985 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package lua-any. 2024-05-04T00:25:24.001 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-04T00:25:24.036 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-04T00:25:24.255 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package zip. 2024-05-04T00:25:24.282 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-04T00:25:24.321 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking zip (3.0-12build2) ... 2024-05-04T00:25:24.641 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package unzip. 2024-05-04T00:25:24.668 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-04T00:25:24.708 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-04T00:25:25.103 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package luarocks. 2024-05-04T00:25:25.130 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-04T00:25:25.170 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-04T00:25:25.511 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librgw2. 2024-05-04T00:25:25.537 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../027-librgw2_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:25.577 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librgw2 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:26.205 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rgw. 2024-05-04T00:25:26.220 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:26.263 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rgw (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:26.607 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-04T00:25:26.634 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-04T00:25:26.674 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-04T00:25:26.935 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libradosstriper1. 2024-05-04T00:25:26.952 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:26.985 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libradosstriper1 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:27.413 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-common. 2024-05-04T00:25:27.440 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:27.480 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-common (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:29.027 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-base. 2024-05-04T00:25:29.054 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:29.103 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-base (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:29.664 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-04T00:25:29.691 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-04T00:25:29.722 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-04T00:25:30.000 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cheroot. 2024-05-04T00:25:30.027 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-04T00:25:30.067 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-04T00:25:30.386 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-04T00:25:30.413 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-04T00:25:30.462 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-04T00:25:30.764 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-04T00:25:30.791 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-04T00:25:30.831 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-04T00:25:31.100 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-04T00:25:31.116 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-04T00:25:31.158 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-04T00:25:31.461 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-tempora. 2024-05-04T00:25:31.488 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-04T00:25:31.519 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-04T00:25:31.814 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-portend. 2024-05-04T00:25:31.841 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-04T00:25:31.895 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-04T00:25:32.200 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-04T00:25:32.227 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-04T00:25:32.266 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-04T00:25:32.570 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-04T00:25:32.596 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-04T00:25:32.636 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-04T00:25:32.981 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-natsort. 2024-05-04T00:25:33.008 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-04T00:25:33.048 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-04T00:25:33.368 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-logutils. 2024-05-04T00:25:33.394 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-04T00:25:33.434 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-04T00:25:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-04T00:25:33.747 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-04T00:25:33.795 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-04T00:25:34.039 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-mako. 2024-05-04T00:25:34.066 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-04T00:25:34.106 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-04T00:25:34.434 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-04T00:25:34.461 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-04T00:25:34.501 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-04T00:25:34.803 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-04T00:25:34.830 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-04T00:25:34.879 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-04T00:25:35.215 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-webob. 2024-05-04T00:25:35.242 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-04T00:25:35.281 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-04T00:25:35.366 INFO:teuthology.orchestra.run.smithi163.stdout:Get:134 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [16.2 MB] 2024-05-04T00:25:35.593 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-waitress. 2024-05-04T00:25:35.619 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-04T00:25:35.654 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-04T00:25:35.848 INFO:teuthology.orchestra.run.smithi163.stdout:Get:135 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [85.1 MB] 2024-05-04T00:25:35.928 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-tempita. 2024-05-04T00:25:35.944 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-04T00:25:35.987 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-04T00:25:36.290 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-paste. 2024-05-04T00:25:36.317 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-04T00:25:36.356 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-04T00:25:36.659 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-04T00:25:36.675 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-04T00:25:36.709 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-04T00:25:37.004 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-04T00:25:37.031 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-04T00:25:37.070 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-04T00:25:37.373 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-webtest. 2024-05-04T00:25:37.401 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-04T00:25:37.440 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-04T00:25:37.759 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pecan. 2024-05-04T00:25:37.786 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-04T00:25:37.826 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-04T00:25:38.206 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-certifi. 2024-05-04T00:25:38.233 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-04T00:25:38.272 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-04T00:25:38.592 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-idna. 2024-05-04T00:25:38.619 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-05-04T00:25:38.658 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-04T00:25:38.994 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-urllib3. 2024-05-04T00:25:39.022 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-04T00:25:39.061 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-04T00:25:39.072 INFO:teuthology.orchestra.run.smithi163.stdout:Get:136 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [11.4 MB] 2024-05-04T00:25:39.333 INFO:teuthology.orchestra.run.smithi163.stdout:Get:137 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [105 MB] 2024-05-04T00:25:39.381 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-requests. 2024-05-04T00:25:39.408 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-04T00:25:39.447 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-04T00:25:39.750 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-04T00:25:39.778 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-04T00:25:39.817 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-04T00:25:40.053 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-04T00:25:40.069 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:25:40.103 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:40.475 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-04T00:25:40.502 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:40.541 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:40.827 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-04T00:25:40.843 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-04T00:25:40.877 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-04T00:25:41.155 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-openssl. 2024-05-04T00:25:41.182 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-04T00:25:41.221 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-04T00:25:41.541 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr. 2024-05-04T00:25:41.569 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:41.607 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:42.019 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mon. 2024-05-04T00:25:42.046 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:42.085 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mon (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:42.747 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-osd. 2024-05-04T00:25:42.775 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:42.813 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-osd (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:43.267 INFO:teuthology.orchestra.run.smithi163.stdout:Get:138 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [180 MB] 2024-05-04T00:25:44.017 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph. 2024-05-04T00:25:44.044 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../068-ceph_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:44.083 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:44.402 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-fuse. 2024-05-04T00:25:44.430 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:44.469 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-fuse (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:44.806 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mds. 2024-05-04T00:25:44.833 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:44.864 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mds (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:45.225 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package cephadm. 2024-05-04T00:25:45.252 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../071-cephadm_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:45.291 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking cephadm (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:45.561 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-04T00:25:45.588 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-04T00:25:45.627 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-04T00:25:45.955 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-04T00:25:45.982 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-04T00:25:46.021 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-04T00:25:47.068 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-babel. 2024-05-04T00:25:47.096 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-04T00:25:47.134 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-04T00:25:47.462 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jinja2. 2024-05-04T00:25:47.489 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-04T00:25:47.529 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-04T00:25:47.874 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-04T00:25:47.901 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:25:47.940 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:48.285 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-04T00:25:48.312 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-04T00:25:48.351 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-04T00:25:48.612 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-routes. 2024-05-04T00:25:48.628 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-04T00:25:48.662 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-04T00:25:48.934 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-04T00:25:48.950 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:25:48.984 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:50.089 INFO:teuthology.orchestra.run.smithi163.stdout:Get:139 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [353 MB] 2024-05-04T00:25:50.214 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-04T00:25:50.242 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-04T00:25:50.272 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-04T00:25:50.743 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-joblib. 2024-05-04T00:25:50.763 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-04T00:25:50.801 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-04T00:25:51.171 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-04T00:25:51.198 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-04T00:25:51.339 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-04T00:25:51.634 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-sklearn. 2024-05-04T00:25:51.661 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-04T00:25:51.692 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-04T00:25:52.359 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-04T00:25:52.387 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:25:52.425 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:53.371 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cachetools. 2024-05-04T00:25:53.398 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-04T00:25:53.437 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-04T00:25:53.739 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-04T00:25:53.767 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-04T00:25:53.806 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-04T00:25:54.126 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-04T00:25:54.154 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-04T00:25:54.409 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-04T00:25:54.696 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rsa. 2024-05-04T00:25:54.723 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-04T00:25:54.762 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-04T00:25:55.083 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-google-auth. 2024-05-04T00:25:55.110 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-04T00:25:55.149 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-04T00:25:55.427 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-04T00:25:55.455 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-04T00:25:55.494 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-04T00:25:55.813 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-websocket. 2024-05-04T00:25:55.841 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-04T00:25:55.880 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-04T00:25:56.200 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-04T00:25:56.228 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-04T00:25:56.266 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-04T00:25:56.914 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-04T00:25:56.942 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:25:56.980 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:25:57.258 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-04T00:25:57.274 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-04T00:25:57.307 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-04T00:25:57.595 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-04T00:25:57.622 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-04T00:25:57.652 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-04T00:25:57.905 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package jq. 2024-05-04T00:25:57.933 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-04T00:25:57.971 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-04T00:25:58.224 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package socat. 2024-05-04T00:25:58.241 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-04T00:25:58.273 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-04T00:25:58.544 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package xmlstarlet. 2024-05-04T00:25:58.560 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-04T00:25:58.594 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-04T00:25:58.914 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-test. 2024-05-04T00:25:58.931 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:25:58.972 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-test (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:01.202 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-volume. 2024-05-04T00:26:01.230 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:26:01.268 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-volume (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:01.656 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-04T00:26:01.683 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:01.722 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking cephfs-mirror (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:02.009 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-colorama. 2024-05-04T00:26:02.036 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-04T00:26:02.067 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-04T00:26:02.302 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package cephfs-shell. 2024-05-04T00:26:02.319 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:26:02.360 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking cephfs-shell (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:02.621 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package cephfs-top. 2024-05-04T00:26:02.638 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:26:02.679 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking cephfs-top (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:02.932 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-04T00:26:02.960 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:02.998 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libcephfs-dev (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:03.276 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-04T00:26:03.293 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-04T00:26:03.326 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-04T00:26:03.495 INFO:teuthology.orchestra.run.smithi163.stdout:Get:140 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [1,758 kB] 2024-05-04T00:26:03.528 INFO:teuthology.orchestra.run.smithi163.stdout:Get:141 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [99.7 MB] 2024-05-04T00:26:03.647 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-04T00:26:03.675 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-04T00:26:03.714 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-04T00:26:04.026 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package nvme-cli. 2024-05-04T00:26:04.054 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-04T00:26:04.084 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-04T00:26:04.439 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package pkg-config. 2024-05-04T00:26:04.464 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-04T00:26:04.497 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-04T00:26:04.742 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-04T00:26:04.758 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-04T00:26:04.800 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-04T00:26:05.195 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-04T00:26:05.223 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-04T00:26:05.261 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-04T00:26:05.564 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pastescript. 2024-05-04T00:26:05.592 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-04T00:26:05.630 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-04T00:26:05.992 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pluggy. 2024-05-04T00:26:06.020 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-04T00:26:06.058 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-04T00:26:06.370 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-psutil. 2024-05-04T00:26:06.398 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-04T00:26:06.436 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-04T00:26:06.764 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-py. 2024-05-04T00:26:06.792 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-04T00:26:06.830 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-04T00:26:07.151 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pygments. 2024-05-04T00:26:07.179 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-04T00:26:07.218 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-04T00:26:07.391 INFO:teuthology.orchestra.run.smithi163.stdout:Get:142 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-3522-gbd4e00a3-1jammy [3,102 kB] 2024-05-04T00:26:07.679 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-04T00:26:07.707 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-04T00:26:07.746 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-04T00:26:07.990 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-toml. 2024-05-04T00:26:08.018 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-04T00:26:08.048 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-04T00:26:08.066 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 3,630 MB in 4min 27s (13.6 MB/s) 2024-05-04T00:26:08.189 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-04T00:26:08.276 INFO:teuthology.orchestra.run.smithi163.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-05-04T00:26:08.282 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-04T00:26:08.330 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-04T00:26:08.360 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pytest. 2024-05-04T00:26:08.388 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-04T00:26:08.426 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-04T00:26:08.566 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-04T00:26:08.581 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-04T00:26:08.615 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-04T00:26:08.721 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-simplejson. 2024-05-04T00:26:08.749 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-04T00:26:08.779 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-04T00:26:08.935 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-cmd2. 2024-05-04T00:26:08.961 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-04T00:26:09.010 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-04T00:26:09.015 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-04T00:26:09.043 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-04T00:26:09.074 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-04T00:26:09.346 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-04T00:26:09.373 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-04T00:26:09.455 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-04T00:26:09.800 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-04T00:26:09.826 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-04T00:26:09.836 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package radosgw. 2024-05-04T00:26:09.864 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../122-radosgw_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:09.866 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-04T00:26:09.902 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking radosgw (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:10.230 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-04T00:26:10.257 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-04T00:26:10.296 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-04T00:26:10.741 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-04T00:26:10.768 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-04T00:26:10.816 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-04T00:26:10.997 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package rbd-fuse. 2024-05-04T00:26:11.013 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:11.055 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking rbd-fuse (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:11.228 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-04T00:26:11.254 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-04T00:26:11.294 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-04T00:26:11.350 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package rbd-mirror. 2024-05-04T00:26:11.378 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:11.407 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking rbd-mirror (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:11.648 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-04T00:26:11.673 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-04T00:26:11.714 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-04T00:26:11.843 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package rbd-nbd. 2024-05-04T00:26:11.861 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:11.902 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking rbd-nbd (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:12.034 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-04T00:26:12.060 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-04T00:26:12.092 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-04T00:26:12.146 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-common-dbg. 2024-05-04T00:26:12.174 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:12.212 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-common-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:12.378 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package librados2. 2024-05-04T00:26:12.404 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../010-librados2_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:12.444 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librados2 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:12.906 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package librbd1. 2024-05-04T00:26:12.932 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../011-librbd1_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:12.972 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librbd1 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:13.415 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libcephfs2. 2024-05-04T00:26:13.436 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:13.467 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libcephfs2 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:13.719 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-rados. 2024-05-04T00:26:13.735 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:13.769 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-rados (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:14.089 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-04T00:26:14.115 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:26:14.155 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-ceph-argparse (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:14.432 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-cephfs. 2024-05-04T00:26:14.456 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:14.499 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-cephfs (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:14.785 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-04T00:26:14.811 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:26:14.851 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-ceph-common (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:15.146 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-prettytable. 2024-05-04T00:26:15.173 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-04T00:26:15.205 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-04T00:26:15.441 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-rbd. 2024-05-04T00:26:15.464 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:15.499 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-rbd (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:15.835 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-04T00:26:15.861 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-04T00:26:15.902 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-04T00:26:16.179 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-04T00:26:16.194 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-04T00:26:16.246 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-04T00:26:16.523 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-04T00:26:16.539 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-04T00:26:16.582 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-04T00:26:16.868 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package lua5.1. 2024-05-04T00:26:16.895 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-04T00:26:16.926 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-04T00:26:17.230 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package lua-any. 2024-05-04T00:26:17.256 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-04T00:26:17.296 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-04T00:26:17.549 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package zip. 2024-05-04T00:26:17.576 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-04T00:26:17.648 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking zip (3.0-12build2) ... 2024-05-04T00:26:18.076 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package unzip. 2024-05-04T00:26:18.100 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-04T00:26:18.135 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-04T00:26:18.489 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package luarocks. 2024-05-04T00:26:18.515 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-04T00:26:18.555 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-04T00:26:18.954 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package librgw2. 2024-05-04T00:26:18.981 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../027-librgw2_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:19.021 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librgw2 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:19.558 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-05-04T00:26:19.586 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:19.624 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-fuse-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:19.640 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-rgw. 2024-05-04T00:26:19.667 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:19.715 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-rgw (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:20.085 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-04T00:26:20.111 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-04T00:26:20.151 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-04T00:26:20.335 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-05-04T00:26:20.363 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:20.401 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mds-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:20.462 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libradosstriper1. 2024-05-04T00:26:20.489 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:20.529 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libradosstriper1 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:20.958 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-common. 2024-05-04T00:26:20.984 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:21.032 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-common (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:21.454 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-05-04T00:26:21.471 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:21.504 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:22.148 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-05-04T00:26:22.164 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:22.206 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mon-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:22.595 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-base. 2024-05-04T00:26:22.622 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:22.671 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-base (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:23.283 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-04T00:26:23.309 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-04T00:26:23.341 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-04T00:26:23.619 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-cheroot. 2024-05-04T00:26:23.645 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-04T00:26:23.686 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-04T00:26:23.958 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-05-04T00:26:23.975 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:24.017 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-osd-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:24.022 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-04T00:26:24.048 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-04T00:26:24.089 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-04T00:26:24.391 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-04T00:26:24.418 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-04T00:26:24.458 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-04T00:26:24.736 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-04T00:26:24.762 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-04T00:26:24.827 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-04T00:26:25.105 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-tempora. 2024-05-04T00:26:25.131 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-04T00:26:25.172 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-04T00:26:25.474 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-portend. 2024-05-04T00:26:25.501 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-04T00:26:25.541 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-04T00:26:25.845 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-04T00:26:25.870 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-04T00:26:25.910 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-04T00:26:26.188 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-04T00:26:26.204 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-04T00:26:26.238 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-04T00:26:26.592 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-natsort. 2024-05-04T00:26:26.618 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-04T00:26:26.658 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-04T00:26:27.003 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-logutils. 2024-05-04T00:26:27.029 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-04T00:26:27.069 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-04T00:26:27.406 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-04T00:26:27.433 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-04T00:26:27.472 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-04T00:26:27.792 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-mako. 2024-05-04T00:26:27.819 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-04T00:26:27.858 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-04T00:26:28.178 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-04T00:26:28.205 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-04T00:26:28.245 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-04T00:26:28.614 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-04T00:26:28.641 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-04T00:26:28.681 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-04T00:26:28.984 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-webob. 2024-05-04T00:26:29.011 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-04T00:26:29.050 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-04T00:26:29.405 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-waitress. 2024-05-04T00:26:29.430 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-04T00:26:29.469 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-test-dbg. 2024-05-04T00:26:29.473 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-04T00:26:29.486 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:29.527 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-test-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:29.764 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-tempita. 2024-05-04T00:26:29.788 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-04T00:26:29.831 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-04T00:26:30.134 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-paste. 2024-05-04T00:26:30.160 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-04T00:26:30.200 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-04T00:26:30.537 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-04T00:26:30.563 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-04T00:26:30.604 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-04T00:26:30.856 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-04T00:26:30.871 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-04T00:26:30.906 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-04T00:26:31.201 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-webtest. 2024-05-04T00:26:31.227 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-04T00:26:31.267 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-04T00:26:31.562 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pecan. 2024-05-04T00:26:31.588 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-04T00:26:31.628 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-04T00:26:32.000 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-certifi. 2024-05-04T00:26:32.026 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-04T00:26:32.066 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-04T00:26:32.394 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-idna. 2024-05-04T00:26:32.420 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-05-04T00:26:32.461 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-04T00:26:32.755 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-urllib3. 2024-05-04T00:26:32.771 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-04T00:26:32.805 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-04T00:26:33.075 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-requests. 2024-05-04T00:26:33.090 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-04T00:26:33.125 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-04T00:26:33.419 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-04T00:26:33.446 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-04T00:26:33.486 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-04T00:26:33.756 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-04T00:26:33.782 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:26:33.822 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:34.219 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-04T00:26:34.245 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:34.285 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:34.613 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-04T00:26:34.640 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-04T00:26:34.671 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-04T00:26:34.966 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-openssl. 2024-05-04T00:26:34.992 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-04T00:26:35.032 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-04T00:26:35.377 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr. 2024-05-04T00:26:35.403 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:35.445 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:35.855 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mon. 2024-05-04T00:26:35.882 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:35.921 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mon (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:36.475 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-osd. 2024-05-04T00:26:36.501 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:36.541 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-osd (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:37.628 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph. 2024-05-04T00:26:37.643 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../068-ceph_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:37.686 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:38.005 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-fuse. 2024-05-04T00:26:38.031 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:38.071 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-fuse (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:38.400 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mds. 2024-05-04T00:26:38.426 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:38.458 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mds (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:38.836 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package cephadm. 2024-05-04T00:26:38.862 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../071-cephadm_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:38.902 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking cephadm (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:39.222 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-04T00:26:39.249 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-04T00:26:39.288 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-04T00:26:39.607 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-04T00:26:39.623 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-04T00:26:39.665 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-04T00:26:39.994 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-05-04T00:26:40.011 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:40.044 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libcephfs2-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:40.471 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librados2-dbg. 2024-05-04T00:26:40.488 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:40.538 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librados2-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:40.679 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-babel. 2024-05-04T00:26:40.695 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-04T00:26:40.728 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-04T00:26:41.015 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-jinja2. 2024-05-04T00:26:41.042 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-04T00:26:41.073 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-04T00:26:41.376 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-04T00:26:41.389 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:26:41.417 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:41.616 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-05-04T00:26:41.644 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:41.690 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libradosstriper1-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:41.713 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-04T00:26:41.739 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-04T00:26:41.771 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-04T00:26:42.059 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librbd1-dbg. 2024-05-04T00:26:42.065 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-routes. 2024-05-04T00:26:42.088 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:42.092 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-04T00:26:42.126 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librbd1-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:42.132 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-04T00:26:42.477 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-04T00:26:42.504 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:26:42.543 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:43.354 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librgw2-dbg. 2024-05-04T00:26:43.382 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:43.420 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librgw2-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:43.832 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-04T00:26:43.848 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-04T00:26:43.890 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-04T00:26:44.385 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-joblib. 2024-05-04T00:26:44.412 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-04T00:26:44.451 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-04T00:26:44.771 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-04T00:26:44.799 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-04T00:26:44.923 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-04T00:26:45.185 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-sklearn. 2024-05-04T00:26:45.212 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-04T00:26:45.243 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-04T00:26:45.639 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package radosgw-dbg. 2024-05-04T00:26:45.655 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:45.697 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking radosgw-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:45.870 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-04T00:26:45.896 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:26:45.935 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:46.882 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-cachetools. 2024-05-04T00:26:46.907 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-04T00:26:46.946 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-04T00:26:47.226 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-04T00:26:47.253 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-04T00:26:47.292 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-04T00:26:47.596 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-04T00:26:47.623 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-04T00:26:47.654 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-04T00:26:47.932 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-rsa. 2024-05-04T00:26:47.959 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-04T00:26:47.989 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-04T00:26:48.318 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-google-auth. 2024-05-04T00:26:48.346 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-04T00:26:48.585 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-04T00:26:48.904 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-04T00:26:48.932 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-04T00:26:48.963 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-04T00:26:49.249 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-websocket. 2024-05-04T00:26:49.276 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-04T00:26:49.315 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-04T00:26:49.491 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-05-04T00:26:49.508 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:49.558 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking rbd-fuse-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:49.635 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-04T00:26:49.663 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-04T00:26:49.702 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-04T00:26:49.861 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-05-04T00:26:49.891 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:49.935 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking rbd-mirror-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:50.324 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-04T00:26:50.352 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:26:50.390 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:50.718 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-04T00:26:50.746 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-04T00:26:50.784 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-04T00:26:51.095 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-04T00:26:51.112 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-04T00:26:51.145 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-04T00:26:51.162 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-05-04T00:26:51.179 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:51.212 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking rbd-nbd-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:51.406 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package jq. 2024-05-04T00:26:51.422 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-04T00:26:51.464 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-04T00:26:51.568 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-04T00:26:51.717 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package socat. 2024-05-04T00:26:51.733 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-04T00:26:51.775 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-04T00:26:51.817 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-04T00:26:51.918 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-04T00:26:52.086 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package xmlstarlet. 2024-05-04T00:26:52.102 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-04T00:26:52.145 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-04T00:26:52.188 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-04T00:26:52.498 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-test. 2024-05-04T00:26:52.514 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:52.538 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-04T00:26:52.548 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-test (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:52.946 INFO:teuthology.orchestra.run.smithi006.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-04T00:26:53.012 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up cephadm (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:53.545 INFO:teuthology.orchestra.run.smithi006.stdout:Adding system user cephadm....done 2024-05-04T00:26:53.701 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-04T00:26:53.969 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-04T00:26:54.228 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-04T00:26:54.354 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-04T00:26:54.614 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-04T00:26:54.853 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-volume. 2024-05-04T00:26:54.880 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:26:54.881 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-04T00:26:54.919 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-volume (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:55.008 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-04T00:26:55.248 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-04T00:26:55.276 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:55.314 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking cephfs-mirror (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:55.318 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-04T00:26:55.643 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-colorama. 2024-05-04T00:26:55.670 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-04T00:26:55.695 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-04T00:26:55.708 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-04T00:26:55.954 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-04T00:26:55.969 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package cephfs-shell. 2024-05-04T00:26:55.985 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:26:56.027 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking cephfs-shell (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:56.213 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-04T00:26:56.280 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package cephfs-top. 2024-05-04T00:26:56.296 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3522-gbd4e00a3-1jammy_all.deb ... 2024-05-04T00:26:56.329 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking cephfs-top (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:56.490 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-04T00:26:56.557 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-04T00:26:56.572 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:26:56.607 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libcephfs-dev (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:56.750 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-04T00:26:56.910 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-04T00:26:56.937 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-04T00:26:56.976 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-04T00:26:57.001 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-04T00:26:57.252 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-04T00:26:57.314 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-04T00:26:57.342 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-04T00:26:57.380 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-04T00:26:57.511 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-ceph-argparse (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:26:57.726 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package nvme-cli. 2024-05-04T00:26:57.754 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-04T00:26:57.771 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-04T00:26:57.792 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-04T00:26:57.896 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-04T00:26:58.031 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-04T00:26:58.189 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package pkg-config. 2024-05-04T00:26:58.216 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-04T00:26:58.246 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-04T00:26:58.299 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-04T00:26:58.425 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-04T00:26:58.458 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-04T00:26:58.485 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-04T00:26:58.524 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-04T00:26:58.684 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-04T00:26:58.902 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-04T00:26:58.918 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-04T00:26:58.960 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-04T00:26:59.073 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-04T00:26:59.115 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-04T00:26:59.179 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-04T00:26:59.280 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pastescript. 2024-05-04T00:26:59.308 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-04T00:26:59.314 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-04T00:26:59.346 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-04T00:26:59.666 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pluggy. 2024-05-04T00:26:59.690 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-04T00:26:59.694 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-04T00:26:59.732 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-04T00:26:59.816 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-04T00:27:00.044 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-psutil. 2024-05-04T00:27:00.072 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-04T00:27:00.084 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-04T00:27:00.110 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-04T00:27:00.335 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-04T00:27:00.438 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-py. 2024-05-04T00:27:00.466 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-04T00:27:00.504 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-04T00:27:00.653 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up zip (3.0-12build2) ... 2024-05-04T00:27:00.804 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-04T00:27:00.824 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pygments. 2024-05-04T00:27:00.852 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-04T00:27:00.890 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-04T00:27:01.353 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-04T00:27:01.381 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-04T00:27:01.419 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-04T00:27:01.498 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-04T00:27:01.689 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-toml. 2024-05-04T00:27:01.716 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-04T00:27:01.746 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-04T00:27:01.765 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-04T00:27:01.891 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-04T00:27:01.999 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pytest. 2024-05-04T00:27:02.017 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-04T00:27:02.027 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-04T00:27:02.065 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-04T00:27:02.310 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-04T00:27:02.419 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-simplejson. 2024-05-04T00:27:02.447 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-04T00:27:02.477 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-04T00:27:02.678 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-04T00:27:02.704 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-04T00:27:02.720 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-04T00:27:02.754 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-04T00:27:02.929 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-04T00:27:03.314 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-04T00:27:03.483 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package radosgw. 2024-05-04T00:27:03.511 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../122-radosgw_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:03.558 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking radosgw (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:03.615 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-04T00:27:03.925 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-04T00:27:04.276 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-04T00:27:04.511 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package rbd-fuse. 2024-05-04T00:27:04.518 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-04T00:27:04.527 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:04.569 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking rbd-fuse (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:04.661 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-ceph-common (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:04.905 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package rbd-mirror. 2024-05-04T00:27:04.933 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:04.971 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-idna (3.3-1) ... 2024-05-04T00:27:04.971 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking rbd-mirror (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:05.308 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-04T00:27:05.408 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package rbd-nbd. 2024-05-04T00:27:05.435 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:05.474 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking rbd-nbd (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:05.735 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-common-dbg. 2024-05-04T00:27:05.751 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:05.793 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-common-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:06.513 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-04T00:27:06.765 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-04T00:27:06.900 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-04T00:27:07.159 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-04T00:27:07.285 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-04T00:27:07.394 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-04T00:27:07.704 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-04T00:27:07.964 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-04T00:27:08.223 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-04T00:27:08.349 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-04T00:27:08.684 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-04T00:27:08.930 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-04T00:27:09.170 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-04T00:27:09.429 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-04T00:27:09.680 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-04T00:27:09.948 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-04T00:27:10.083 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-04T00:27:10.359 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-04T00:27:10.460 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-04T00:27:10.728 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-04T00:27:11.029 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-04T00:27:11.302 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-04T00:27:11.414 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-04T00:27:11.540 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-04T00:27:11.638 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-04T00:27:11.892 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-04T00:27:12.018 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-04T00:27:12.445 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-04T00:27:12.704 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-04T00:27:12.830 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-04T00:27:13.090 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-04T00:27:13.163 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-05-04T00:27:13.180 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:13.216 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-04T00:27:13.221 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-fuse-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:13.559 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-04T00:27:13.648 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-05-04T00:27:13.665 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:13.707 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mds-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:13.851 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-04T00:27:14.102 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-04T00:27:14.298 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-04T00:27:14.574 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-04T00:27:14.667 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-05-04T00:27:14.684 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:14.725 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:14.859 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-04T00:27:15.118 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-04T00:27:15.420 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-05-04T00:27:15.448 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:15.486 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mon-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:15.495 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-04T00:27:15.772 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-04T00:27:16.383 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-04T00:27:16.608 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librados2 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:16.734 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:16.860 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-04T00:27:17.188 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libcephfs2 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:17.238 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-05-04T00:27:17.254 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:17.296 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-osd-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:17.314 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libradosstriper1 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:17.440 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-04T00:27:17.725 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librados2-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:17.851 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librbd1 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:17.977 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libcephfs2-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:18.095 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-modules-core (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:18.196 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-fuse (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:18.415 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-04T00:27:18.415 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-04T00:27:18.872 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libradosstriper1-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:18.998 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libcephfs-dev (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:19.124 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-fuse-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:19.250 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rados (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:19.385 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librgw2 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:19.511 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up cephfs-top (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:19.629 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-04T00:27:20.867 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librbd1-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:20.983 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rbd (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:21.085 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librgw2-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:21.194 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up rbd-fuse (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:21.336 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up rbd-nbd (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:21.462 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rgw (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:21.589 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cephfs (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:21.714 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up rbd-nbd-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:21.840 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up cephfs-shell (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:21.966 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up rbd-fuse-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:22.084 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-common (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:22.586 INFO:teuthology.orchestra.run.smithi006.stdout:Adding group ceph....done 2024-05-04T00:27:22.724 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-test-dbg. 2024-05-04T00:27:22.752 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:22.790 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-test-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:22.970 INFO:teuthology.orchestra.run.smithi006.stdout:Adding system user ceph....done 2024-05-04T00:27:23.214 INFO:teuthology.orchestra.run.smithi006.stdout:Setting system user ceph properties....done 2024-05-04T00:27:23.229 INFO:teuthology.orchestra.run.smithi006.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-04T00:27:23.376 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-04T00:27:23.736 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-04T00:27:24.186 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up cephfs-mirror (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:24.394 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-04T00:27:24.394 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-04T00:27:24.854 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-test (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:24.979 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up radosgw (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:25.451 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-04T00:27:25.451 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-04T00:27:25.898 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-base (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:26.256 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-04T00:27:26.718 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mds (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:26.930 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-04T00:27:26.931 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-04T00:27:27.395 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-common-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:27.564 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up rbd-mirror (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:27.868 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-05-04T00:27:27.869 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-05-04T00:27:28.338 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:28.632 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-04T00:27:28.632 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-04T00:27:29.091 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mds-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:29.218 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up radosgw-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:29.343 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-test-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:29.470 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-osd (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:29.735 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-04T00:27:29.735 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-04T00:27:30.221 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:30.347 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-osd-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:30.473 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up rbd-mirror-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:30.599 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:30.734 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:30.860 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mon (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:31.064 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-04T00:27:31.064 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-04T00:27:31.561 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-cephadm (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:31.763 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:31.889 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-dashboard (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:32.040 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mon-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:32.166 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-volume (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:32.519 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-04T00:27:32.620 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-04T00:27:32.756 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-04T00:27:33.264 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-05-04T00:27:33.280 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:33.322 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libcephfs2-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:33.497 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-04T00:27:33.724 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package librados2-dbg. 2024-05-04T00:27:33.740 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:33.774 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librados2-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:34.166 INFO:teuthology.orchestra.run.smithi006.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-04T00:27:34.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-04T00:27:34.277 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2024-05-04T00:27:34.487 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2024-05-04T00:27:34.487 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2024-05-04T00:27:34.691 INFO:teuthology.orchestra.run.smithi006.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-04T00:27:34.692 INFO:teuthology.orchestra.run.smithi006.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-04T00:27:34.692 INFO:teuthology.orchestra.run.smithi006.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-04T00:27:34.692 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages were automatically installed and are no longer required: 2024-05-04T00:27:34.692 INFO:teuthology.orchestra.run.smithi006.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-04T00:27:34.692 INFO:teuthology.orchestra.run.smithi006.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-04T00:27:34.692 INFO:teuthology.orchestra.run.smithi006.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-04T00:27:34.692 INFO:teuthology.orchestra.run.smithi006.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-04T00:27:34.693 INFO:teuthology.orchestra.run.smithi006.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-04T00:27:34.693 INFO:teuthology.orchestra.run.smithi006.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-04T00:27:34.693 INFO:teuthology.orchestra.run.smithi006.stdout:The following additional packages will be installed: 2024-05-04T00:27:34.693 INFO:teuthology.orchestra.run.smithi006.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-04T00:27:34.693 INFO:teuthology.orchestra.run.smithi006.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-04T00:27:34.694 INFO:teuthology.orchestra.run.smithi006.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-04T00:27:34.694 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-04T00:27:34.694 INFO:teuthology.orchestra.run.smithi006.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-04T00:27:34.695 INFO:teuthology.orchestra.run.smithi006.stdout:Suggested packages: 2024-05-04T00:27:34.696 INFO:teuthology.orchestra.run.smithi006.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-04T00:27:34.696 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-04T00:27:34.696 INFO:teuthology.orchestra.run.smithi006.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-04T00:27:34.740 INFO:teuthology.orchestra.run.smithi006.stdout:The following NEW packages will be installed: 2024-05-04T00:27:34.741 INFO:teuthology.orchestra.run.smithi006.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-04T00:27:34.741 INFO:teuthology.orchestra.run.smithi006.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-04T00:27:34.741 INFO:teuthology.orchestra.run.smithi006.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-04T00:27:34.741 INFO:teuthology.orchestra.run.smithi006.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-04T00:27:34.742 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-04T00:27:34.742 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-04T00:27:34.742 INFO:teuthology.orchestra.run.smithi006.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-04T00:27:34.743 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages will be upgraded: 2024-05-04T00:27:34.743 INFO:teuthology.orchestra.run.smithi006.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-04T00:27:34.804 INFO:teuthology.orchestra.run.smithi006.stdout:4 upgraded, 39 newly installed, 0 to remove and 299 not upgraded. 2024-05-04T00:27:34.805 INFO:teuthology.orchestra.run.smithi006.stdout:Need to get 55.7 MB of archives. 2024-05-04T00:27:34.805 INFO:teuthology.orchestra.run.smithi006.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-04T00:27:34.805 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-04T00:27:34.860 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-05-04T00:27:34.880 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:34.918 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libradosstriper1-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:34.969 INFO:teuthology.orchestra.run.smithi006.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-04T00:27:34.976 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-04T00:27:35.017 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-04T00:27:35.018 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-04T00:27:35.019 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-04T00:27:35.030 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-04T00:27:35.031 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-04T00:27:35.033 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-04T00:27:35.035 INFO:teuthology.orchestra.run.smithi006.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-04T00:27:35.035 INFO:teuthology.orchestra.run.smithi006.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-04T00:27:35.037 INFO:teuthology.orchestra.run.smithi006.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-04T00:27:35.043 INFO:teuthology.orchestra.run.smithi006.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-04T00:27:35.059 INFO:teuthology.orchestra.run.smithi006.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-04T00:27:35.060 INFO:teuthology.orchestra.run.smithi006.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-04T00:27:35.061 INFO:teuthology.orchestra.run.smithi006.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-04T00:27:35.287 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package librbd1-dbg. 2024-05-04T00:27:35.303 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:35.336 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librbd1-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:35.425 INFO:teuthology.orchestra.run.smithi006.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-04T00:27:35.427 INFO:teuthology.orchestra.run.smithi006.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-04T00:27:35.485 INFO:teuthology.orchestra.run.smithi006.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-04T00:27:35.489 INFO:teuthology.orchestra.run.smithi006.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-04T00:27:35.489 INFO:teuthology.orchestra.run.smithi006.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-04T00:27:35.495 INFO:teuthology.orchestra.run.smithi006.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-04T00:27:35.497 INFO:teuthology.orchestra.run.smithi006.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-04T00:27:35.506 INFO:teuthology.orchestra.run.smithi006.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-04T00:27:35.507 INFO:teuthology.orchestra.run.smithi006.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-04T00:27:35.535 INFO:teuthology.orchestra.run.smithi006.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-04T00:27:35.535 INFO:teuthology.orchestra.run.smithi006.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-04T00:27:35.548 INFO:teuthology.orchestra.run.smithi006.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-04T00:27:35.569 INFO:teuthology.orchestra.run.smithi006.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-04T00:27:35.572 INFO:teuthology.orchestra.run.smithi006.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-04T00:27:35.573 INFO:teuthology.orchestra.run.smithi006.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-04T00:27:35.573 INFO:teuthology.orchestra.run.smithi006.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-04T00:27:35.574 INFO:teuthology.orchestra.run.smithi006.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-04T00:27:35.594 INFO:teuthology.orchestra.run.smithi006.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-04T00:27:35.596 INFO:teuthology.orchestra.run.smithi006.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-04T00:27:35.862 INFO:teuthology.orchestra.run.smithi006.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-04T00:27:35.863 INFO:teuthology.orchestra.run.smithi006.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-04T00:27:35.863 INFO:teuthology.orchestra.run.smithi006.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-04T00:27:35.863 INFO:teuthology.orchestra.run.smithi006.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-04T00:27:35.863 INFO:teuthology.orchestra.run.smithi006.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-04T00:27:35.863 INFO:teuthology.orchestra.run.smithi006.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-04T00:27:35.876 INFO:teuthology.orchestra.run.smithi006.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-04T00:27:35.876 INFO:teuthology.orchestra.run.smithi006.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-04T00:27:36.298 INFO:teuthology.orchestra.run.smithi006.stdout:Preconfiguring packages ... 2024-05-04T00:27:36.456 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 55.7 MB in 1s (49.6 MB/s) 2024-05-04T00:27:36.581 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package librgw2-dbg. 2024-05-04T00:27:36.597 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:36.639 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librgw2-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:36.721 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174290 files and directories currently installed.) 2024-05-04T00:27:36.727 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-04T00:27:37.015 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-04T00:27:37.644 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-04T00:27:38.614 INFO:teuthology.orchestra.run.smithi006.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-04T00:27:38.694 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package radosgw-dbg. 2024-05-04T00:27:38.719 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:38.758 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking radosgw-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:38.895 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package flex. 2024-05-04T00:27:39.001 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174290 files and directories currently installed.) 2024-05-04T00:27:39.007 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-04T00:27:39.051 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-04T00:27:39.527 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-04T00:27:39.665 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-04T00:27:40.094 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-04T00:27:40.596 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174363 files and directories currently installed.) 2024-05-04T00:27:40.602 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-04T00:27:40.723 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-04T00:27:41.108 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-04T00:27:41.221 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-04T00:27:41.533 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-04T00:27:41.881 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package bison. 2024-05-04T00:27:41.986 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174363 files and directories currently installed.) 2024-05-04T00:27:41.992 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-04T00:27:42.808 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-04T00:27:42.808 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-04T00:27:42.809 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-04T00:27:42.809 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-04T00:27:42.809 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-05-04T00:27:42.809 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:42.809 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking rbd-fuse-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:42.809 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-05-04T00:27:42.809 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:42.813 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package dump. 2024-05-04T00:27:42.829 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking rbd-mirror-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:42.841 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-04T00:27:42.879 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking dump (0.4b47-3) ... 2024-05-04T00:27:43.166 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package indent. 2024-05-04T00:27:43.194 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-04T00:27:43.233 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-04T00:27:43.494 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-04T00:27:43.511 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-04T00:27:43.544 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-04T00:27:43.864 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-04T00:27:43.893 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-04T00:27:43.931 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-04T00:27:44.056 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-05-04T00:27:44.072 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-3522-gbd4e00a3-1jammy_amd64.deb ... 2024-05-04T00:27:44.114 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking rbd-nbd-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:44.192 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-04T00:27:44.209 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-04T00:27:44.250 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-04T00:27:44.453 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-04T00:27:44.562 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-04T00:27:44.591 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-04T00:27:44.621 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-04T00:27:44.711 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-04T00:27:44.812 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-04T00:27:44.856 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-04T00:27:44.873 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-04T00:27:44.915 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-04T00:27:45.043 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-04T00:27:45.167 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libjson-perl. 2024-05-04T00:27:45.185 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-04T00:27:45.226 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-04T00:27:45.373 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-04T00:27:45.546 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-04T00:27:45.574 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-04T00:27:45.604 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-04T00:27:45.823 INFO:teuthology.orchestra.run.smithi163.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-04T00:27:45.930 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up cephadm (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:46.789 INFO:teuthology.orchestra.run.smithi163.stdout:Adding system user cephadm....done 2024-05-04T00:27:46.945 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-04T00:27:47.246 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-04T00:27:47.506 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-04T00:27:47.632 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-04T00:27:47.775 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-04T00:27:47.803 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-04T00:27:47.841 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-04T00:27:47.899 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-04T00:27:48.119 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-04T00:27:48.136 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-04T00:27:48.158 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-04T00:27:48.178 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-04T00:27:48.276 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-04T00:27:48.480 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-04T00:27:48.509 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-04T00:27:48.555 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-04T00:27:48.578 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-04T00:27:48.922 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-04T00:27:48.934 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-04T00:27:48.962 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-04T00:27:49.000 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-04T00:27:49.181 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-04T00:27:49.328 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-04T00:27:49.357 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-04T00:27:49.395 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-04T00:27:49.440 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-04T00:27:49.716 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-04T00:27:49.723 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-04T00:27:49.751 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-04T00:27:49.781 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-04T00:27:49.968 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-04T00:27:50.109 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-04T00:27:50.137 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-04T00:27:50.175 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-04T00:27:50.228 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-04T00:27:50.462 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-04T00:27:50.480 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-04T00:27:50.497 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-04T00:27:50.538 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-04T00:27:50.713 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-ceph-argparse (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:50.791 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-04T00:27:50.808 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-04T00:27:50.849 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-04T00:27:50.955 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-04T00:27:51.081 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-04T00:27:51.207 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-04T00:27:51.361 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-04T00:27:51.391 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-04T00:27:51.428 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-04T00:27:51.466 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-04T00:27:51.593 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-04T00:27:51.773 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package modemmanager. 2024-05-04T00:27:51.802 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-04T00:27:51.839 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-04T00:27:51.852 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-04T00:27:52.247 INFO:teuthology.orchestra.run.smithi163.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-04T00:27:52.274 INFO:teuthology.orchestra.run.smithi163.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-04T00:27:52.355 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-04T00:27:52.438 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package network-manager. 2024-05-04T00:27:52.466 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-04T00:27:52.481 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-04T00:27:52.513 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-04T00:27:52.849 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-04T00:27:52.975 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-04T00:27:53.172 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ppp. 2024-05-04T00:27:53.200 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-04T00:27:53.235 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-04T00:27:53.428 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-04T00:27:53.502 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-04T00:27:53.795 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up zip (3.0-12build2) ... 2024-05-04T00:27:53.801 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package pptp-linux. 2024-05-04T00:27:53.818 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-04T00:27:53.860 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-04T00:27:53.896 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-04T00:27:54.113 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-04T00:27:54.129 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-04T00:27:54.180 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-04T00:27:54.573 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-04T00:27:54.658 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-04T00:27:54.686 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-04T00:27:54.741 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql-client-common (238) ... 2024-05-04T00:27:54.832 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-04T00:27:55.020 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-04T00:27:55.048 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-04T00:27:55.086 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-04T00:27:55.271 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-04T00:27:55.468 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-04T00:27:55.608 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql-common. 2024-05-04T00:27:55.636 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-04T00:27:55.693 INFO:teuthology.orchestra.run.smithi006.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-04T00:27:55.722 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql-common (238) ... 2024-05-04T00:27:55.777 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-04T00:27:56.153 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-04T00:27:56.173 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql-14. 2024-05-04T00:27:56.202 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-04T00:27:56.243 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-04T00:27:56.396 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-04T00:27:56.772 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-04T00:27:57.057 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-04T00:27:57.358 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-04T00:27:57.501 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql. 2024-05-04T00:27:57.519 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-04T00:27:57.551 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql (14+238) ... 2024-05-04T00:27:57.701 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-04T00:27:57.770 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql-client. 2024-05-04T00:27:57.799 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-04T00:27:57.845 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql-client (14+238) ... 2024-05-04T00:27:57.952 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-04T00:27:58.061 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-ceph-common (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:27:58.081 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-04T00:27:58.098 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-04T00:27:58.139 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-04T00:27:58.346 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-idna (3.3-1) ... 2024-05-04T00:27:58.459 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package tcl8.6. 2024-05-04T00:27:58.487 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-04T00:27:58.525 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-04T00:27:58.647 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-04T00:27:58.803 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package tcl. 2024-05-04T00:27:58.820 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-04T00:27:58.866 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-04T00:27:59.240 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package wpasupplicant. 2024-05-04T00:27:59.268 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-04T00:27:59.306 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-04T00:27:59.660 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-04T00:27:59.677 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-04T00:27:59.718 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-04T00:27:59.778 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-04T00:28:00.004 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-04T00:28:00.039 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-04T00:28:00.068 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-04T00:28:00.123 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-04T00:28:00.138 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-04T00:28:00.406 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-04T00:28:00.419 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql-client-common (238) ... 2024-05-04T00:28:00.532 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-04T00:28:00.628 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-04T00:28:00.658 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-04T00:28:00.754 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-04T00:28:00.889 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-04T00:28:00.968 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-04T00:28:01.015 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-04T00:28:01.124 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-04T00:28:01.236 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-04T00:28:01.250 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-04T00:28:01.461 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-04T00:28:01.562 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-04T00:28:01.796 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-04T00:28:01.881 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-04T00:28:01.881 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-04T00:28:02.131 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-04T00:28:02.261 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-04T00:28:02.261 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-04T00:28:02.399 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-04T00:28:02.659 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-04T00:28:02.742 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-04T00:28:02.868 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-04T00:28:02.909 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-04T00:28:03.011 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-04T00:28:03.137 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-04T00:28:03.177 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-04T00:28:03.263 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-04T00:28:03.278 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-04T00:28:03.398 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-04T00:28:03.507 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-04T00:28:03.546 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-04T00:28:03.625 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-04T00:28:03.664 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-04T00:28:03.956 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-04T00:28:04.274 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-04T00:28:04.281 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-04T00:28:04.407 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up dump (0.4b47-3) ... 2024-05-04T00:28:04.492 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-04T00:28:04.534 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-04T00:28:04.559 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-04T00:28:04.660 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-04T00:28:04.684 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-04T00:28:04.780 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-04T00:28:04.852 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-04T00:28:04.853 INFO:teuthology.orchestra.run.smithi163.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-04T00:28:04.979 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-04T00:28:05.089 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-04T00:28:05.104 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-04T00:28:05.195 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-04T00:28:05.232 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-04T00:28:05.265 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-04T00:28:05.391 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-04T00:28:05.550 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-04T00:28:05.626 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-04T00:28:05.676 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-04T00:28:05.802 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-04T00:28:05.885 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-04T00:28:05.970 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql-client (14+238) ... 2024-05-04T00:28:05.986 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-04T00:28:06.097 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-04T00:28:06.221 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-04T00:28:06.339 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-04T00:28:06.604 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:28:06.604 INFO:teuthology.orchestra.run.smithi006.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-04T00:28:06.604 INFO:teuthology.orchestra.run.smithi006.stdout:which means they are currently configured by ifupdown: 2024-05-04T00:28:06.604 INFO:teuthology.orchestra.run.smithi006.stdout:- ens1f0 2024-05-04T00:28:06.604 INFO:teuthology.orchestra.run.smithi006.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-04T00:28:06.604 INFO:teuthology.orchestra.run.smithi006.stdout:remove their configuration from /etc/network/interfaces. 2024-05-04T00:28:06.604 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:28:06.665 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-04T00:28:06.731 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-04T00:28:06.983 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-04T00:28:07.029 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-04T00:28:07.259 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-04T00:28:07.338 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-04T00:28:07.488 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-04T00:28:07.765 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-04T00:28:07.841 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-04T00:28:07.977 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-04T00:28:08.026 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-04T00:28:08.284 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-04T00:28:08.461 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-04T00:28:08.586 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql-common (238) ... 2024-05-04T00:28:08.653 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-04T00:28:08.929 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-04T00:28:09.257 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-04T00:28:09.383 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librados2 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:09.509 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:09.511 INFO:teuthology.orchestra.run.smithi006.stdout:Adding user postgres to group ssl-cert 2024-05-04T00:28:09.627 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-04T00:28:09.745 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:28:09.745 INFO:teuthology.orchestra.run.smithi006.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-04T00:28:09.914 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libcephfs2 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:09.939 INFO:teuthology.orchestra.run.smithi006.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-04T00:28:09.940 INFO:teuthology.orchestra.run.smithi006.stdout:Removing obsolete dictionary files: 2024-05-04T00:28:10.040 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libradosstriper1 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:10.166 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-04T00:28:10.451 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librados2-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:10.494 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-04T00:28:10.577 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librbd1 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:10.678 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libcephfs2-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:10.779 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-modules-core (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:10.855 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-04T00:28:10.889 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-fuse (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:11.102 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-04T00:28:11.102 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-04T00:28:11.189 INFO:teuthology.orchestra.run.smithi006.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-04T00:28:11.222 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-04T00:28:11.280 INFO:teuthology.orchestra.run.smithi006.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-04T00:28:11.280 INFO:teuthology.orchestra.run.smithi006.stdout:This user must also own the server process. 2024-05-04T00:28:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:28:11.281 INFO:teuthology.orchestra.run.smithi006.stdout:The database cluster will be initialized with locale "en_US". 2024-05-04T00:28:11.281 INFO:teuthology.orchestra.run.smithi006.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-04T00:28:11.281 INFO:teuthology.orchestra.run.smithi006.stdout:The default text search configuration will be set to "english". 2024-05-04T00:28:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:28:11.281 INFO:teuthology.orchestra.run.smithi006.stdout:Data page checksums are disabled. 2024-05-04T00:28:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:28:11.281 INFO:teuthology.orchestra.run.smithi006.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-04T00:28:11.281 INFO:teuthology.orchestra.run.smithi006.stdout:creating subdirectories ... ok 2024-05-04T00:28:11.281 INFO:teuthology.orchestra.run.smithi006.stdout:selecting dynamic shared memory implementation ... posix 2024-05-04T00:28:11.294 INFO:teuthology.orchestra.run.smithi006.stdout:selecting default max_connections ... 100 2024-05-04T00:28:11.316 INFO:teuthology.orchestra.run.smithi006.stdout:selecting default shared_buffers ... 128MB 2024-05-04T00:28:11.326 INFO:teuthology.orchestra.run.smithi006.stdout:selecting default time zone ... Etc/UTC 2024-05-04T00:28:11.327 INFO:teuthology.orchestra.run.smithi006.stdout:creating configuration files ... ok 2024-05-04T00:28:11.447 INFO:teuthology.orchestra.run.smithi006.stdout:running bootstrap script ... ok 2024-05-04T00:28:11.599 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libradosstriper1-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:11.725 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libcephfs-dev (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:11.868 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-fuse-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:11.994 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-rados (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:12.094 INFO:teuthology.orchestra.run.smithi006.stdout:performing post-bootstrap initialization ... ok 2024-05-04T00:28:12.095 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librgw2 (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:12.205 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up cephfs-top (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:12.314 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-04T00:28:12.707 INFO:teuthology.orchestra.run.smithi006.stdout:syncing data to disk ... ok 2024-05-04T00:28:13.061 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-04T00:28:13.477 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librbd1-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:13.594 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-rbd (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:13.696 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librgw2-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:13.814 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up rbd-fuse (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:13.940 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up rbd-nbd (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:14.066 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-rgw (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:14.192 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-cephfs (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:14.318 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up rbd-nbd-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:14.444 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up cephfs-shell (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:14.545 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up rbd-fuse-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:14.647 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-common (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:15.165 INFO:teuthology.orchestra.run.smithi163.stdout:Adding group ceph....done 2024-05-04T00:28:15.593 INFO:teuthology.orchestra.run.smithi163.stdout:Adding system user ceph....done 2024-05-04T00:28:15.761 INFO:teuthology.orchestra.run.smithi163.stdout:Setting system user ceph properties....done 2024-05-04T00:28:15.776 INFO:teuthology.orchestra.run.smithi163.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-04T00:28:15.828 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-04T00:28:15.917 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-04T00:28:15.954 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-04T00:28:16.081 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql (14+238) ... 2024-05-04T00:28:16.207 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-04T00:28:16.255 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-04T00:28:16.316 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-04T00:28:16.575 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-04T00:28:16.575 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-04T00:28:16.741 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up cephfs-mirror (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:16.951 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-04T00:28:16.951 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-04T00:28:17.160 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-04T00:28:17.253 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-04T00:28:17.443 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-test (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:17.522 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-04T00:28:17.543 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up radosgw (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:17.674 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-04T00:28:17.988 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-04T00:28:17.988 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-04T00:28:18.462 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-base (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:18.801 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-04T00:28:19.027 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-04T00:28:19.127 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-04T00:28:19.273 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mds (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:19.503 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-04T00:28:19.504 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-04T00:28:19.992 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-common-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:20.077 INFO:teuthology.orchestra.run.smithi006.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-04T00:28:20.083 DEBUG:teuthology.parallel:result is None 2024-05-04T00:28:20.093 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up rbd-mirror (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:20.279 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-05-04T00:28:20.279 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-05-04T00:28:20.752 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:20.965 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-04T00:28:20.965 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-04T00:28:21.438 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mds-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:21.565 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up radosgw-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:21.691 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-test-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:21.809 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-osd (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:22.063 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-04T00:28:22.063 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-04T00:28:22.544 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:22.645 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-osd-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:22.755 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up rbd-mirror-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:22.881 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:23.007 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:23.158 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mon (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:23.373 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-04T00:28:23.373 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-04T00:28:23.876 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-cephadm (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:24.028 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:24.129 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-dashboard (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:24.263 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mon-dbg (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:24.390 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-volume (19.0.0-3522-gbd4e00a3-1jammy) ... 2024-05-04T00:28:24.743 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-04T00:28:24.859 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-04T00:28:25.005 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-04T00:28:26.625 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-04T00:28:27.258 INFO:teuthology.orchestra.run.smithi163.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-04T00:28:27.261 DEBUG:teuthology.orchestra.run.smithi163:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-04T00:28:27.369 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2024-05-04T00:28:27.570 INFO:teuthology.orchestra.run.smithi163.stdout:Building dependency tree... 2024-05-04T00:28:27.571 INFO:teuthology.orchestra.run.smithi163.stdout:Reading state information... 2024-05-04T00:28:27.754 INFO:teuthology.orchestra.run.smithi163.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-04T00:28:27.755 INFO:teuthology.orchestra.run.smithi163.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-04T00:28:27.755 INFO:teuthology.orchestra.run.smithi163.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-04T00:28:27.755 INFO:teuthology.orchestra.run.smithi163.stdout:The following packages were automatically installed and are no longer required: 2024-05-04T00:28:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-04T00:28:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-04T00:28:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-04T00:28:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-04T00:28:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-04T00:28:27.755 INFO:teuthology.orchestra.run.smithi163.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-04T00:28:27.756 INFO:teuthology.orchestra.run.smithi163.stdout:The following additional packages will be installed: 2024-05-04T00:28:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-04T00:28:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-04T00:28:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-04T00:28:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-04T00:28:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-04T00:28:27.757 INFO:teuthology.orchestra.run.smithi163.stdout:Suggested packages: 2024-05-04T00:28:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-04T00:28:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-04T00:28:27.758 INFO:teuthology.orchestra.run.smithi163.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-04T00:28:27.799 INFO:teuthology.orchestra.run.smithi163.stdout:The following NEW packages will be installed: 2024-05-04T00:28:27.799 INFO:teuthology.orchestra.run.smithi163.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-04T00:28:27.800 INFO:teuthology.orchestra.run.smithi163.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-04T00:28:27.800 INFO:teuthology.orchestra.run.smithi163.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-04T00:28:27.800 INFO:teuthology.orchestra.run.smithi163.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-04T00:28:27.800 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-04T00:28:27.800 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-04T00:28:27.800 INFO:teuthology.orchestra.run.smithi163.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-04T00:28:27.801 INFO:teuthology.orchestra.run.smithi163.stdout:The following packages will be upgraded: 2024-05-04T00:28:27.801 INFO:teuthology.orchestra.run.smithi163.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-04T00:28:27.981 INFO:teuthology.orchestra.run.smithi163.stdout:4 upgraded, 39 newly installed, 0 to remove and 299 not upgraded. 2024-05-04T00:28:27.982 INFO:teuthology.orchestra.run.smithi163.stdout:Need to get 55.7 MB of archives. 2024-05-04T00:28:27.982 INFO:teuthology.orchestra.run.smithi163.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-04T00:28:27.982 INFO:teuthology.orchestra.run.smithi163.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-04T00:28:28.605 INFO:teuthology.orchestra.run.smithi163.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-04T00:28:28.621 INFO:teuthology.orchestra.run.smithi163.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-04T00:28:28.746 INFO:teuthology.orchestra.run.smithi163.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-04T00:28:28.747 INFO:teuthology.orchestra.run.smithi163.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-04T00:28:28.748 INFO:teuthology.orchestra.run.smithi163.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-04T00:28:28.777 INFO:teuthology.orchestra.run.smithi163.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-04T00:28:28.779 INFO:teuthology.orchestra.run.smithi163.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-04T00:28:28.782 INFO:teuthology.orchestra.run.smithi163.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-04T00:28:28.785 INFO:teuthology.orchestra.run.smithi163.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-04T00:28:28.786 INFO:teuthology.orchestra.run.smithi163.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-04T00:28:28.952 INFO:teuthology.orchestra.run.smithi163.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-04T00:28:29.233 INFO:teuthology.orchestra.run.smithi163.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-04T00:28:29.243 INFO:teuthology.orchestra.run.smithi163.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-04T00:28:29.248 INFO:teuthology.orchestra.run.smithi163.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-04T00:28:29.333 INFO:teuthology.orchestra.run.smithi163.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-04T00:28:30.420 INFO:teuthology.orchestra.run.smithi163.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-04T00:28:30.425 INFO:teuthology.orchestra.run.smithi163.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-04T00:28:30.425 INFO:teuthology.orchestra.run.smithi163.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-04T00:28:30.432 INFO:teuthology.orchestra.run.smithi163.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-04T00:28:30.432 INFO:teuthology.orchestra.run.smithi163.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-04T00:28:30.443 INFO:teuthology.orchestra.run.smithi163.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-04T00:28:30.611 INFO:teuthology.orchestra.run.smithi163.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-04T00:28:31.206 INFO:teuthology.orchestra.run.smithi163.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-04T00:28:31.207 INFO:teuthology.orchestra.run.smithi163.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-04T00:28:31.385 INFO:teuthology.orchestra.run.smithi163.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-04T00:28:31.385 INFO:teuthology.orchestra.run.smithi163.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-04T00:28:31.423 INFO:teuthology.orchestra.run.smithi163.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-04T00:28:31.490 INFO:teuthology.orchestra.run.smithi163.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-04T00:28:31.495 INFO:teuthology.orchestra.run.smithi163.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-04T00:28:31.495 INFO:teuthology.orchestra.run.smithi163.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-04T00:28:31.497 INFO:teuthology.orchestra.run.smithi163.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-04T00:28:31.497 INFO:teuthology.orchestra.run.smithi163.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-04T00:28:31.730 INFO:teuthology.orchestra.run.smithi163.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-04T00:28:32.142 INFO:teuthology.orchestra.run.smithi163.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-04T00:28:32.958 INFO:teuthology.orchestra.run.smithi163.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-04T00:28:32.958 INFO:teuthology.orchestra.run.smithi163.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-04T00:28:32.959 INFO:teuthology.orchestra.run.smithi163.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-04T00:28:32.959 INFO:teuthology.orchestra.run.smithi163.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-04T00:28:32.959 INFO:teuthology.orchestra.run.smithi163.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-04T00:28:32.960 INFO:teuthology.orchestra.run.smithi163.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-04T00:28:32.989 INFO:teuthology.orchestra.run.smithi163.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-04T00:28:32.989 INFO:teuthology.orchestra.run.smithi163.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-04T00:28:33.399 INFO:teuthology.orchestra.run.smithi163.stdout:Preconfiguring packages ... 2024-05-04T00:28:33.573 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 55.7 MB in 5s (10.8 MB/s) 2024-05-04T00:28:33.848 INFO:teuthology.orchestra.run.smithi163.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174290 files and directories currently installed.) 2024-05-04T00:28:33.853 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-04T00:28:33.974 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-04T00:28:34.607 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-04T00:28:35.608 INFO:teuthology.orchestra.run.smithi163.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-04T00:28:35.849 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package flex. 2024-05-04T00:28:35.913 INFO:teuthology.orchestra.run.smithi163.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174290 files and directories currently installed.) 2024-05-04T00:28:35.919 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-04T00:28:35.957 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-04T00:28:36.481 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-04T00:28:36.663 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-04T00:28:37.125 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-04T00:28:37.659 INFO:teuthology.orchestra.run.smithi163.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174363 files and directories currently installed.) 2024-05-04T00:28:37.664 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-04T00:28:37.772 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-04T00:28:38.207 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-04T00:28:38.346 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-04T00:28:38.658 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-04T00:28:39.032 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package bison. 2024-05-04T00:28:39.137 INFO:teuthology.orchestra.run.smithi163.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174363 files and directories currently installed.) 2024-05-04T00:28:39.142 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-04T00:28:39.192 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-04T00:28:39.577 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-04T00:28:39.604 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-04T00:28:39.643 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-04T00:28:39.963 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package dump. 2024-05-04T00:28:39.991 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-04T00:28:40.030 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking dump (0.4b47-3) ... 2024-05-04T00:28:40.317 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package indent. 2024-05-04T00:28:40.343 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-04T00:28:40.384 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-04T00:28:40.653 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-04T00:28:40.681 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-04T00:28:40.720 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-04T00:28:40.992 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-04T00:28:41.019 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-04T00:28:41.058 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-04T00:28:41.319 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-04T00:28:41.335 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-04T00:28:41.377 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-04T00:28:41.707 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-04T00:28:41.734 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-04T00:28:41.773 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-04T00:28:41.993 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-04T00:28:42.021 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-04T00:28:42.069 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-04T00:28:42.381 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libjson-perl. 2024-05-04T00:28:42.408 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-04T00:28:42.447 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-04T00:28:42.726 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-04T00:28:42.753 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-04T00:28:42.784 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-04T00:28:44.429 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-04T00:28:44.456 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-04T00:28:44.495 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-04T00:28:44.756 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-04T00:28:44.773 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-04T00:28:44.815 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-04T00:28:45.093 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-04T00:28:45.120 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-04T00:28:45.168 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-04T00:28:45.521 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-04T00:28:45.549 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-04T00:28:45.587 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-04T00:28:45.899 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-04T00:28:45.927 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-04T00:28:45.966 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-04T00:28:46.369 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-04T00:28:46.397 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-04T00:28:46.436 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-04T00:28:46.956 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-04T00:28:46.984 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-04T00:28:47.023 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-04T00:28:47.535 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-04T00:28:47.563 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-04T00:28:47.610 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-04T00:28:47.863 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-04T00:28:47.890 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-04T00:28:47.929 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-04T00:28:48.434 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-04T00:28:48.461 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-04T00:28:48.500 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-04T00:28:48.812 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package modemmanager. 2024-05-04T00:28:48.828 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-04T00:28:48.862 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-04T00:28:49.461 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package network-manager. 2024-05-04T00:28:49.489 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-04T00:28:49.536 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-04T00:28:50.078 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ppp. 2024-05-04T00:28:50.106 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-04T00:28:50.374 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-04T00:28:50.735 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package pptp-linux. 2024-05-04T00:28:50.763 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-04T00:28:50.801 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-04T00:28:51.071 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-04T00:28:51.087 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-04T00:28:51.129 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-04T00:28:51.450 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-04T00:28:51.478 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-04T00:28:51.525 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking postgresql-client-common (238) ... 2024-05-04T00:28:51.846 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-04T00:28:51.874 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-04T00:28:51.912 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-04T00:28:52.526 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package postgresql-common. 2024-05-04T00:28:52.554 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-04T00:28:52.613 INFO:teuthology.orchestra.run.smithi163.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-04T00:28:52.641 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking postgresql-common (238) ... 2024-05-04T00:28:53.059 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package postgresql-14. 2024-05-04T00:28:53.087 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-04T00:28:53.121 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-04T00:28:54.439 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package postgresql. 2024-05-04T00:28:54.456 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-04T00:28:54.497 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking postgresql (14+238) ... 2024-05-04T00:28:54.741 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package postgresql-client. 2024-05-04T00:28:54.758 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-04T00:28:54.799 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking postgresql-client (14+238) ... 2024-05-04T00:28:55.052 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-04T00:28:55.080 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-04T00:28:55.118 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-04T00:28:55.480 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package tcl8.6. 2024-05-04T00:28:55.508 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-04T00:28:55.546 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-04T00:28:55.832 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package tcl. 2024-05-04T00:28:55.860 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-04T00:28:55.904 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-04T00:28:56.203 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package wpasupplicant. 2024-05-04T00:28:56.231 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-04T00:28:56.269 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-04T00:28:56.599 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-04T00:28:56.615 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-04T00:28:56.657 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-04T00:28:57.044 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-04T00:28:57.072 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-04T00:28:57.119 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-04T00:28:57.660 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up postgresql-client-common (238) ... 2024-05-04T00:28:58.410 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-04T00:28:58.535 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-04T00:28:58.661 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-04T00:28:58.788 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-04T00:28:58.914 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-04T00:28:59.015 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-04T00:28:59.547 INFO:teuthology.orchestra.run.smithi163.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-04T00:28:59.630 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-04T00:29:00.002 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-04T00:29:00.002 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-04T00:29:00.475 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-04T00:29:00.601 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-04T00:29:00.727 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-04T00:29:00.828 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-04T00:29:00.937 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-04T00:29:01.055 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-04T00:29:01.181 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-04T00:29:01.307 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-04T00:29:01.947 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-04T00:29:02.073 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up dump (0.4b47-3) ... 2024-05-04T00:29:02.166 INFO:teuthology.orchestra.run.smithi163.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-04T00:29:02.283 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-04T00:29:02.409 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-04T00:29:02.535 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-04T00:29:02.645 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-04T00:29:02.746 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-04T00:29:02.819 INFO:teuthology.orchestra.run.smithi163.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-04T00:29:02.889 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-04T00:29:03.015 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-04T00:29:03.192 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-04T00:29:03.327 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-04T00:29:03.453 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-04T00:29:03.596 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up postgresql-client (14+238) ... 2024-05-04T00:29:03.705 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-04T00:29:04.152 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:04.152 INFO:teuthology.orchestra.run.smithi163.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-04T00:29:04.152 INFO:teuthology.orchestra.run.smithi163.stdout:which means they are currently configured by ifupdown: 2024-05-04T00:29:04.152 INFO:teuthology.orchestra.run.smithi163.stdout:- enp3s0f1 2024-05-04T00:29:04.152 INFO:teuthology.orchestra.run.smithi163.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-04T00:29:04.152 INFO:teuthology.orchestra.run.smithi163.stdout:remove their configuration from /etc/network/interfaces. 2024-05-04T00:29:04.152 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:04.278 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-04T00:29:04.611 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-04T00:29:04.950 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-04T00:29:05.475 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-04T00:29:05.626 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-04T00:29:05.752 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-04T00:29:05.879 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up postgresql-common (238) ... 2024-05-04T00:29:06.785 INFO:teuthology.orchestra.run.smithi163.stdout:Adding user postgres to group ssl-cert 2024-05-04T00:29:07.021 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:07.021 INFO:teuthology.orchestra.run.smithi163.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-04T00:29:07.223 INFO:teuthology.orchestra.run.smithi163.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-04T00:29:07.223 INFO:teuthology.orchestra.run.smithi163.stdout:Removing obsolete dictionary files: 2024-05-04T00:29:07.776 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-04T00:29:08.165 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-04T00:29:08.471 INFO:teuthology.orchestra.run.smithi163.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-04T00:29:08.485 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-04T00:29:08.527 INFO:teuthology.orchestra.run.smithi163.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-04T00:29:08.527 INFO:teuthology.orchestra.run.smithi163.stdout:This user must also own the server process. 2024-05-04T00:29:08.527 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:08.527 INFO:teuthology.orchestra.run.smithi163.stdout:The database cluster will be initialized with locale "en_US". 2024-05-04T00:29:08.528 INFO:teuthology.orchestra.run.smithi163.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-04T00:29:08.528 INFO:teuthology.orchestra.run.smithi163.stdout:The default text search configuration will be set to "english". 2024-05-04T00:29:08.528 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:08.528 INFO:teuthology.orchestra.run.smithi163.stdout:Data page checksums are disabled. 2024-05-04T00:29:08.528 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:08.528 INFO:teuthology.orchestra.run.smithi163.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-04T00:29:08.528 INFO:teuthology.orchestra.run.smithi163.stdout:creating subdirectories ... ok 2024-05-04T00:29:08.528 INFO:teuthology.orchestra.run.smithi163.stdout:selecting dynamic shared memory implementation ... posix 2024-05-04T00:29:08.539 INFO:teuthology.orchestra.run.smithi163.stdout:selecting default max_connections ... 100 2024-05-04T00:29:08.558 INFO:teuthology.orchestra.run.smithi163.stdout:selecting default shared_buffers ... 128MB 2024-05-04T00:29:08.564 INFO:teuthology.orchestra.run.smithi163.stdout:selecting default time zone ... Etc/UTC 2024-05-04T00:29:08.564 INFO:teuthology.orchestra.run.smithi163.stdout:creating configuration files ... ok 2024-05-04T00:29:08.673 INFO:teuthology.orchestra.run.smithi163.stdout:running bootstrap script ... ok 2024-05-04T00:29:09.675 INFO:teuthology.orchestra.run.smithi163.stdout:performing post-bootstrap initialization ... ok 2024-05-04T00:29:10.343 INFO:teuthology.orchestra.run.smithi163.stdout:syncing data to disk ... ok 2024-05-04T00:29:10.714 INFO:teuthology.orchestra.run.smithi163.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-04T00:29:13.480 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-04T00:29:13.606 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-04T00:29:13.732 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up postgresql (14+238) ... 2024-05-04T00:29:13.858 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-04T00:29:13.976 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-04T00:29:14.205 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-04T00:29:14.206 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-04T00:29:14.737 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-04T00:29:14.838 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-04T00:29:15.149 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-04T00:29:15.309 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-04T00:29:16.378 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-04T00:29:16.470 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-04T00:29:16.936 INFO:teuthology.orchestra.run.smithi163.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-04T00:29:16.944 DEBUG:teuthology.parallel:result is None 2024-05-04T00:29:16.945 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bd4e00a39d766328b458e4c953f4d722fed96a31 2024-05-04T00:29:17.170 DEBUG:teuthology.orchestra.run.smithi006:> dpkg-query -W -f '${Version}' ceph 2024-05-04T00:29:17.191 INFO:teuthology.orchestra.run.smithi006.stdout:19.0.0-3522-gbd4e00a3-1jammy 2024-05-04T00:29:17.192 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3522-gbd4e00a3-1jammy 2024-05-04T00:29:17.192 INFO:teuthology.task.install:The correct ceph version 19.0.0-3522-gbd4e00a3-1jammy is installed. 2024-05-04T00:29:17.194 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bd4e00a39d766328b458e4c953f4d722fed96a31 2024-05-04T00:29:17.416 DEBUG:teuthology.orchestra.run.smithi163:> dpkg-query -W -f '${Version}' ceph 2024-05-04T00:29:17.435 INFO:teuthology.orchestra.run.smithi163.stdout:19.0.0-3522-gbd4e00a3-1jammy 2024-05-04T00:29:17.436 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3522-gbd4e00a3-1jammy 2024-05-04T00:29:17.436 INFO:teuthology.task.install:The correct ceph version 19.0.0-3522-gbd4e00a3-1jammy is installed. 2024-05-04T00:29:17.438 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-04T00:29:17.438 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:17.438 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-04T00:29:17.453 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:29:17.453 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-04T00:29:17.492 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-04T00:29:17.492 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:17.492 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2024-05-04T00:29:17.510 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-04T00:29:17.569 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:29:17.569 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/daemon-helper 2024-05-04T00:29:17.583 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-04T00:29:17.639 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-04T00:29:17.640 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:17.640 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-04T00:29:17.654 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-04T00:29:17.710 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:29:17.710 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-04T00:29:17.722 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-04T00:29:17.775 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-04T00:29:17.776 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:17.776 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2024-05-04T00:29:17.789 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-04T00:29:17.846 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:29:17.846 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/stdin-killer 2024-05-04T00:29:17.858 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-04T00:29:17.911 INFO:teuthology.run_tasks:Running task ceph... 2024-05-04T00:29:17.999 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-04T00:29:17.999 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /var/log/ceph 2024-05-04T00:29:18.002 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 777 /var/log/ceph 2024-05-04T00:29:18.014 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-04T00:29:18.014 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-04T00:29:18.059 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-04T00:29:18.071 INFO:tasks.ceph:Creating extra log directories... 2024-05-04T00:29:18.071 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-04T00:29:18.119 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-04T00:29:18.138 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-04T00:29:18.138 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-04T00:29:18.138 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-04T00:29:18.138 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:18.138 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-04T00:29:18.178 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-04T00:29:18.255 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:29:18.256 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-04T00:29:18.261 DEBUG:teuthology.orchestra.run.smithi163:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-04T00:29:18.342 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-04T00:29:18.342 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-04T00:29:18.342 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688442', 'branch': 'wip-pdonnell-testing-20240503.163550-debug', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/3 tasks/dbench validater/valgrind}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7688442', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240503.163550-debug'}, 'ceph': {'cephfs': {'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240503.163550-debug', 'sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 65, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 1842, 'sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31', 'sleep_before_teardown': 0, 'subset': '478/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240503.163550-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi006.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBlXbvxO9wd8rg/B/Ewb2Aj1cLbnGU5sypoN9DaAk4VAtGFnf5vFxeXo2b/X1iGGLS6Bw7QpIET6R8Sxpajh8ow=', 'smithi163.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLNx3VE/CsM7gbIrU8+X66ZSHmKacnMUasflpx9Iw11Yq7mQBYvn0KTNjBTJKyGGMWnq/4HQHu8S/zySxloGmsE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-03_22:48:16', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-04T00:29:18.343 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-04T00:29:18.345 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-04T00:29:18.384 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/run/ceph 2024-05-04T00:29:18.391 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/run/ceph 2024-05-04T00:29:18.441 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:18.441 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2024-05-04T00:29:18.450 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-04T00:29:18.450 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2024-05-04T00:29:18.499 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-04T00:29:18.499 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T00:29:18.499 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 875 Links: 1 2024-05-04T00:29:18.499 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T00:29:18.499 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-05-04 00:18:12.454710661 +0000 2024-05-04T00:29:18.499 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-05-04 00:18:12.182713090 +0000 2024-05-04T00:29:18.499 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-05-04 00:18:12.182713090 +0000 2024-05-04T00:29:18.499 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-05-04T00:29:18.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-04T00:29:18.553 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-05-04T00:29:18.553 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-05-04T00:29:18.553 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000450183 s, 1.1 MB/s 2024-05-04T00:29:18.555 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-04T00:29:18.605 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2024-05-04T00:29:18.654 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-04T00:29:18.654 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T00:29:18.655 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-05-04T00:29:18.655 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T00:29:18.655 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-05-04 00:18:12.962706120 +0000 2024-05-04T00:29:18.655 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-05-04 00:18:12.694708515 +0000 2024-05-04T00:29:18.655 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-05-04 00:18:12.694708515 +0000 2024-05-04T00:29:18.655 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-05-04T00:29:18.655 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-04T00:29:18.709 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-05-04T00:29:18.709 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-05-04T00:29:18.709 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000442163 s, 1.2 MB/s 2024-05-04T00:29:18.711 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-04T00:29:18.760 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2024-05-04T00:29:18.806 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-04T00:29:18.807 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T00:29:18.807 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-05-04T00:29:18.807 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T00:29:18.807 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-05-04 00:18:13.486701436 +0000 2024-05-04T00:29:18.807 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-05-04 00:18:13.178704189 +0000 2024-05-04T00:29:18.807 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-05-04 00:18:13.178704189 +0000 2024-05-04T00:29:18.807 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-05-04T00:29:18.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-04T00:29:18.861 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-05-04T00:29:18.861 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-05-04T00:29:18.861 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000408407 s, 1.3 MB/s 2024-05-04T00:29:18.862 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-04T00:29:18.912 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2024-05-04T00:29:18.959 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-04T00:29:18.959 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T00:29:18.959 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-05-04T00:29:18.959 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T00:29:18.959 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-05-04 00:18:13.970697110 +0000 2024-05-04T00:29:18.959 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-05-04 00:18:13.694699577 +0000 2024-05-04T00:29:18.959 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-05-04 00:18:13.694699577 +0000 2024-05-04T00:29:18.959 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-05-04T00:29:18.960 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-04T00:29:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-05-04T00:29:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-05-04T00:29:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.00038938 s, 1.3 MB/s 2024-05-04T00:29:19.015 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-04T00:29:19.064 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-04T00:29:19.064 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:29:19.064 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/scratch_devs of=/dev/stdout 2024-05-04T00:29:19.070 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-04T00:29:19.070 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_1 2024-05-04T00:29:19.117 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-04T00:29:19.117 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T00:29:19.117 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 871 Links: 1 2024-05-04T00:29:19.118 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T00:29:19.118 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-05-04 00:18:07.114403896 +0000 2024-05-04T00:29:19.118 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-05-04 00:18:06.834406398 +0000 2024-05-04T00:29:19.118 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-05-04 00:18:06.834406398 +0000 2024-05-04T00:29:19.118 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2024-05-04T00:29:19.118 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-04T00:29:19.171 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-05-04T00:29:19.171 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-05-04T00:29:19.171 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000449475 s, 1.1 MB/s 2024-05-04T00:29:19.172 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-04T00:29:19.222 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_2 2024-05-04T00:29:19.268 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-04T00:29:19.268 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T00:29:19.268 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-05-04T00:29:19.268 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T00:29:19.268 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-05-04 00:18:07.598399573 +0000 2024-05-04T00:29:19.268 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-05-04 00:18:07.350401788 +0000 2024-05-04T00:29:19.269 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-05-04 00:18:07.350401788 +0000 2024-05-04T00:29:19.269 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2024-05-04T00:29:19.269 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-04T00:29:19.322 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-05-04T00:29:19.322 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-05-04T00:29:19.322 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.0004125 s, 1.2 MB/s 2024-05-04T00:29:19.324 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-04T00:29:19.373 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_3 2024-05-04T00:29:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-04T00:29:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T00:29:19.420 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-05-04T00:29:19.420 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T00:29:19.421 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-05-04 00:18:08.094395142 +0000 2024-05-04T00:29:19.421 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-05-04 00:18:07.838397430 +0000 2024-05-04T00:29:19.421 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-05-04 00:18:07.838397430 +0000 2024-05-04T00:29:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2024-05-04T00:29:19.421 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-04T00:29:19.474 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-05-04T00:29:19.474 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-05-04T00:29:19.474 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000429405 s, 1.2 MB/s 2024-05-04T00:29:19.476 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-04T00:29:19.526 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_4 2024-05-04T00:29:19.572 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-04T00:29:19.572 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T00:29:19.572 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-05-04T00:29:19.572 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T00:29:19.572 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-05-04 00:18:08.310393214 +0000 2024-05-04T00:29:19.573 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-05-04 00:18:08.306393250 +0000 2024-05-04T00:29:19.573 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-05-04 00:18:08.306393250 +0000 2024-05-04T00:29:19.573 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2024-05-04T00:29:19.573 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-04T00:29:19.628 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-05-04T00:29:19.628 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-05-04T00:29:19.628 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000279691 s, 1.8 MB/s 2024-05-04T00:29:19.629 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-04T00:29:19.677 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-04T00:29:19.677 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-04T00:29:19.677 INFO:tasks.ceph:Generating config... 2024-05-04T00:29:19.679 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-04T00:29:19.679 INFO:tasks.ceph:[client] debug client = 20 2024-05-04T00:29:19.679 INFO:tasks.ceph:[client] debug ms = 1 2024-05-04T00:29:19.679 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-04T00:29:19.679 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-04T00:29:19.679 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-05-04T00:29:19.679 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-05-04T00:29:19.679 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-05-04T00:29:19.679 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-04T00:29:19.679 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-04T00:29:19.679 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-04T00:29:19.679 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-04T00:29:19.680 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-04T00:29:19.680 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-04T00:29:19.680 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-05-04T00:29:19.680 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-04T00:29:19.680 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-04T00:29:19.680 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-04T00:29:19.680 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-04T00:29:19.680 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-04T00:29:19.680 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-04T00:29:19.680 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-04T00:29:19.680 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-04T00:29:19.680 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-04T00:29:19.680 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-04T00:29:19.680 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-04T00:29:19.680 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-04T00:29:19.680 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-05-04T00:29:19.681 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-04T00:29:19.681 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-04T00:29:19.681 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-04T00:29:19.681 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-04T00:29:19.681 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-04T00:29:19.681 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-04T00:29:19.681 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-04T00:29:19.681 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-04T00:29:19.681 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-04T00:29:19.681 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-04T00:29:19.681 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-04T00:29:19.681 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-04T00:29:19.681 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-04T00:29:19.681 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-04T00:29:19.682 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-05-04T00:29:19.682 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-04T00:29:19.682 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-04T00:29:19.682 INFO:tasks.ceph:Setting up mon.a... 2024-05-04T00:29:19.682 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-04T00:29:19.749 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.keyring 2024-05-04T00:29:19.771 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-04T00:29:19.837 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-04T00:29:19.849 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.6'), ('mon.b', '172.21.15.163'), ('mon.c', '[v2:172.21.15.163:3301,v1:172.21.15.163:6790]')] 2024-05-04T00:29:19.850 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.6,172.21.15.163,[v2:172.21.15.163:3301,v1:172.21.15.163:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-04T00:29:19.851 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:19.851 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-04T00:29:19.898 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.6 --add b 172.21.15.163 --addv c '[v2:172.21.15.163:3301,v1:172.21.15.163:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-04T00:29:20.015 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-04T00:29:20.015 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: generated fsid ad5951ed-0d5e-4770-b5d9-995e08a00213 2024-05-04T00:29:20.015 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = quincy 2024-05-04T00:29:20.015 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 0 2024-05-04T00:29:20.015 INFO:teuthology.orchestra.run.smithi006.stdout:fsid ad5951ed-0d5e-4770-b5d9-995e08a00213 2024-05-04T00:29:20.015 INFO:teuthology.orchestra.run.smithi006.stdout:last_changed 2024-05-04T00:29:20.015797+0000 2024-05-04T00:29:20.015 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-05-04T00:29:20.015797+0000 2024-05-04T00:29:20.015 INFO:teuthology.orchestra.run.smithi006.stdout:min_mon_release 17 (quincy) 2024-05-04T00:29:20.015 INFO:teuthology.orchestra.run.smithi006.stdout:election_strategy: 1 2024-05-04T00:29:20.015 INFO:teuthology.orchestra.run.smithi006.stdout:0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-05-04T00:29:20.015 INFO:teuthology.orchestra.run.smithi006.stdout:1: [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon.b 2024-05-04T00:29:20.016 INFO:teuthology.orchestra.run.smithi006.stdout:2: [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] mon.c 2024-05-04T00:29:20.016 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-04T00:29:20.021 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-04T00:29:20.026 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ad5951ed-0d5e-4770-b5d9-995e08a00213... 2024-05-04T00:29:20.027 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-04T00:29:20.071 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-04T00:29:20.098 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2024-05-04T00:29:20.098 INFO:teuthology.orchestra.run.smithi006.stdout: chdir = "" 2024-05-04T00:29:20.098 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-04T00:29:20.098 INFO:teuthology.orchestra.run.smithi006.stdout: auth supported = cephx 2024-05-04T00:29:20.098 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.098 INFO:teuthology.orchestra.run.smithi006.stdout: filestore xattr use omap = true 2024-05-04T00:29:20.098 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.098 INFO:teuthology.orchestra.run.smithi006.stdout: mon clock drift allowed = 1.000 2024-05-04T00:29:20.098 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.098 INFO:teuthology.orchestra.run.smithi006.stdout: osd crush chooseleaf type = 0 2024-05-04T00:29:20.098 INFO:teuthology.orchestra.run.smithi006.stdout: auth debug = true 2024-05-04T00:29:20.099 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.099 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on old message = true 2024-05-04T00:29:20.099 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on bug = true 2024-05-04T00:29:20.099 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.099 INFO:teuthology.orchestra.run.smithi006.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-04T00:29:20.099 INFO:teuthology.orchestra.run.smithi006.stdout: mon pg warn max object skew = 0 2024-05-04T00:29:20.099 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.099 INFO:teuthology.orchestra.run.smithi006.stdout: # disable pg_autoscaler by default for new pools 2024-05-04T00:29:20.099 INFO:teuthology.orchestra.run.smithi006.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-04T00:29:20.099 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.099 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default size = 2 2024-05-04T00:29:20.099 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.099 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow primary affinity = true 2024-05-04T00:29:20.099 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow pg remap = true 2024-05-04T00:29:20.100 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on legacy crush tunables = false 2024-05-04T00:29:20.100 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on crush straw calc version zero = false 2024-05-04T00:29:20.100 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on no sortbitwise = false 2024-05-04T00:29:20.100 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on osd down out interval zero = false 2024-05-04T00:29:20.100 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on too few osds = false 2024-05-04T00:29:20.100 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-04T00:29:20.100 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-04T00:29:20.100 INFO:teuthology.orchestra.run.smithi006.stdout: mon_allow_pool_size_one = true 2024-05-04T00:29:20.100 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.100 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-04T00:29:20.100 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.100 INFO:teuthology.orchestra.run.smithi006.stdout: osd default data pool replay window = 5 2024-05-04T00:29:20.100 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.100 INFO:teuthology.orchestra.run.smithi006.stdout: mon allow pool delete = true 2024-05-04T00:29:20.101 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.101 INFO:teuthology.orchestra.run.smithi006.stdout: mon cluster log file level = debug 2024-05-04T00:29:20.101 INFO:teuthology.orchestra.run.smithi006.stdout: debug asserts on shutdown = true 2024-05-04T00:29:20.101 INFO:teuthology.orchestra.run.smithi006.stdout: mon health detail to clog = false 2024-05-04T00:29:20.101 INFO:teuthology.orchestra.run.smithi006.stdout: mon host = "172.21.15.6,172.21.15.163,[v2:172.21.15.163:3301,v1:172.21.15.163:6790]" 2024-05-04T00:29:20.101 INFO:teuthology.orchestra.run.smithi006.stdout: mds beacon grace = 60 2024-05-04T00:29:20.101 INFO:teuthology.orchestra.run.smithi006.stdout: mds heartbeat grace = 60 2024-05-04T00:29:20.101 INFO:teuthology.orchestra.run.smithi006.stdout: osd heartbeat grace = 60 2024-05-04T00:29:20.101 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = ad5951ed-0d5e-4770-b5d9-995e08a00213 2024-05-04T00:29:20.101 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.101 INFO:teuthology.orchestra.run.smithi006.stdout:[osd] 2024-05-04T00:29:20.101 INFO:teuthology.orchestra.run.smithi006.stdout: osd journal size = 100 2024-05-04T00:29:20.101 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.101 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub load threshold = 5.0 2024-05-04T00:29:20.102 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub max interval = 600 2024-05-04T00:29:20.102 INFO:teuthology.orchestra.run.smithi006.stdout: osd mclock profile = high_recovery_ops 2024-05-04T00:29:20.102 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.102 INFO:teuthology.orchestra.run.smithi006.stdout: osd recover clone overlap = true 2024-05-04T00:29:20.102 INFO:teuthology.orchestra.run.smithi006.stdout: osd recovery max chunk = 1048576 2024-05-04T00:29:20.102 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.102 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug shutdown = true 2024-05-04T00:29:20.102 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug op order = true 2024-05-04T00:29:20.102 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug verify stray on activate = true 2024-05-04T00:29:20.102 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug trim objects = true 2024-05-04T00:29:20.102 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.102 INFO:teuthology.orchestra.run.smithi006.stdout: osd open classes on start = true 2024-05-04T00:29:20.102 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug pg log writeout = true 2024-05-04T00:29:20.103 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.103 INFO:teuthology.orchestra.run.smithi006.stdout: osd deep scrub update digest min age = 30 2024-05-04T00:29:20.103 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.103 INFO:teuthology.orchestra.run.smithi006.stdout: osd map max advance = 10 2024-05-04T00:29:20.103 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.103 INFO:teuthology.orchestra.run.smithi006.stdout: journal zero on create = true 2024-05-04T00:29:20.103 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.103 INFO:teuthology.orchestra.run.smithi006.stdout: filestore ondisk finisher threads = 3 2024-05-04T00:29:20.103 INFO:teuthology.orchestra.run.smithi006.stdout: filestore apply finisher threads = 3 2024-05-04T00:29:20.103 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.103 INFO:teuthology.orchestra.run.smithi006.stdout: bdev debug aio = true 2024-05-04T00:29:20.103 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug misdirected ops = true 2024-05-04T00:29:20.103 INFO:teuthology.orchestra.run.smithi006.stdout: bdev async discard = True 2024-05-04T00:29:20.103 INFO:teuthology.orchestra.run.smithi006.stdout: bdev enable discard = True 2024-05-04T00:29:20.103 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore allocator = bitmap 2024-05-04T00:29:20.103 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore block size = 96636764160 2024-05-04T00:29:20.104 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore fsck on mount = True 2024-05-04T00:29:20.104 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluefs = 1/20 2024-05-04T00:29:20.104 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluestore = 1/20 2024-05-04T00:29:20.104 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-05-04T00:29:20.104 INFO:teuthology.orchestra.run.smithi006.stdout: debug osd = 20 2024-05-04T00:29:20.104 INFO:teuthology.orchestra.run.smithi006.stdout: debug rocksdb = 4/10 2024-05-04T00:29:20.104 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd backfillfull_ratio = 0.85 2024-05-04T00:29:20.104 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd full ratio = 0.9 2024-05-04T00:29:20.104 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd nearfull ratio = 0.8 2024-05-04T00:29:20.104 INFO:teuthology.orchestra.run.smithi006.stdout: osd failsafe full ratio = 0.95 2024-05-04T00:29:20.104 INFO:teuthology.orchestra.run.smithi006.stdout: osd fast shutdown = False 2024-05-04T00:29:20.104 INFO:teuthology.orchestra.run.smithi006.stdout: osd objectstore = bluestore 2024-05-04T00:29:20.104 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2024-05-04T00:29:20.104 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.105 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr] 2024-05-04T00:29:20.105 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-05-04T00:29:20.105 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgr = 20 2024-05-04T00:29:20.105 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2024-05-04T00:29:20.105 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2024-05-04T00:29:20.105 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2024-05-04T00:29:20.105 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2024-05-04T00:29:20.105 INFO:teuthology.orchestra.run.smithi006.stdout: mgr/telemetry/nag = false 2024-05-04T00:29:20.105 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2024-05-04T00:29:20.105 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.105 INFO:teuthology.orchestra.run.smithi006.stdout:[mon] 2024-05-04T00:29:20.105 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-05-04T00:29:20.105 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2024-05-04T00:29:20.105 INFO:teuthology.orchestra.run.smithi006.stdout: debug paxos = 20 2024-05-04T00:29:20.105 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2024-05-04T00:29:20.106 INFO:teuthology.orchestra.run.smithi006.stdout: mon data avail warn = 5 2024-05-04T00:29:20.106 INFO:teuthology.orchestra.run.smithi006.stdout: mon mgr mkfs grace = 240 2024-05-04T00:29:20.106 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2024-05-04T00:29:20.106 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd reporter subtree level = osd 2024-05-04T00:29:20.106 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd prime pg temp = true 2024-05-04T00:29:20.106 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2024-05-04T00:29:20.106 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.106 INFO:teuthology.orchestra.run.smithi006.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-04T00:29:20.106 INFO:teuthology.orchestra.run.smithi006.stdout: auth mon ticket ttl = 660 # 11m 2024-05-04T00:29:20.106 INFO:teuthology.orchestra.run.smithi006.stdout: auth service ticket ttl = 240 # 4m 2024-05-04T00:29:20.106 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.106 INFO:teuthology.orchestra.run.smithi006.stdout: # don't complain about insecure global_id in the test suite 2024-05-04T00:29:20.106 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-04T00:29:20.107 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-04T00:29:20.107 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.107 INFO:teuthology.orchestra.run.smithi006.stdout: # 1m isn't quite enough 2024-05-04T00:29:20.107 INFO:teuthology.orchestra.run.smithi006.stdout: mon_down_mkfs_grace = 2m 2024-05-04T00:29:20.107 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.107 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_filestore_osds = false 2024-05-04T00:29:20.107 INFO:teuthology.orchestra.run.smithi006.stdout: mon down mkfs grace = 300 2024-05-04T00:29:20.107 INFO:teuthology.orchestra.run.smithi006.stdout: mon op complaint time = 120 2024-05-04T00:29:20.107 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd crush smoke test = False 2024-05-04T00:29:20.107 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:29:20.107 INFO:teuthology.orchestra.run.smithi006.stdout:[client] 2024-05-04T00:29:20.107 INFO:teuthology.orchestra.run.smithi006.stdout: rgw cache enabled = true 2024-05-04T00:29:20.107 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable ops log = true 2024-05-04T00:29:20.107 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable usage log = true 2024-05-04T00:29:20.108 INFO:teuthology.orchestra.run.smithi006.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-04T00:29:20.108 INFO:teuthology.orchestra.run.smithi006.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-04T00:29:20.108 INFO:teuthology.orchestra.run.smithi006.stdout: client mount timeout = 600 2024-05-04T00:29:20.108 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2024-05-04T00:29:20.108 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-05-04T00:29:20.108 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2024-05-04T00:29:20.108 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2024-05-04T00:29:20.108 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.a] 2024-05-04T00:29:20.108 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.b] 2024-05-04T00:29:20.108 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.c] 2024-05-04T00:29:20.108 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2024-05-04T00:29:20.108 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2024-05-04T00:29:20.108 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.e] 2024-05-04T00:29:20.108 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2024-05-04T00:29:20.109 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2024-05-04T00:29:20.109 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.f] 2024-05-04T00:29:20.109 INFO:teuthology.orchestra.run.smithi006.stdout:[mds] 2024-05-04T00:29:20.109 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds = 20 2024-05-04T00:29:20.109 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds balancer = 20 2024-05-04T00:29:20.109 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-05-04T00:29:20.109 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug frag = True 2024-05-04T00:29:20.109 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug scatterstat = True 2024-05-04T00:29:20.109 INFO:teuthology.orchestra.run.smithi006.stdout: mds op complaint time = 180 2024-05-04T00:29:20.109 INFO:teuthology.orchestra.run.smithi006.stdout: mds valgrind exit = True 2024-05-04T00:29:20.109 INFO:teuthology.orchestra.run.smithi006.stdout: mds verify scatter = True 2024-05-04T00:29:20.109 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2024-05-04T00:29:20.109 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2024-05-04T00:29:20.109 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2024-05-04T00:29:20.110 INFO:teuthology.orchestra.run.smithi163.stdout:[global] 2024-05-04T00:29:20.110 INFO:teuthology.orchestra.run.smithi163.stdout: chdir = "" 2024-05-04T00:29:20.110 INFO:teuthology.orchestra.run.smithi163.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-04T00:29:20.110 INFO:teuthology.orchestra.run.smithi163.stdout: auth supported = cephx 2024-05-04T00:29:20.110 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.110 INFO:teuthology.orchestra.run.smithi163.stdout: filestore xattr use omap = true 2024-05-04T00:29:20.110 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.110 INFO:teuthology.orchestra.run.smithi163.stdout: mon clock drift allowed = 1.000 2024-05-04T00:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: osd crush chooseleaf type = 0 2024-05-04T00:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: auth debug = true 2024-05-04T00:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on old message = true 2024-05-04T00:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on bug = true 2024-05-04T00:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-04T00:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: mon pg warn max object skew = 0 2024-05-04T00:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: # disable pg_autoscaler by default for new pools 2024-05-04T00:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-04T00:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default size = 2 2024-05-04T00:29:20.112 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.112 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow primary affinity = true 2024-05-04T00:29:20.112 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow pg remap = true 2024-05-04T00:29:20.112 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on legacy crush tunables = false 2024-05-04T00:29:20.112 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on crush straw calc version zero = false 2024-05-04T00:29:20.112 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on no sortbitwise = false 2024-05-04T00:29:20.112 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on osd down out interval zero = false 2024-05-04T00:29:20.112 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on too few osds = false 2024-05-04T00:29:20.112 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-04T00:29:20.112 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-04T00:29:20.112 INFO:teuthology.orchestra.run.smithi163.stdout: mon_allow_pool_size_one = true 2024-05-04T00:29:20.112 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.112 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-04T00:29:20.112 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.113 INFO:teuthology.orchestra.run.smithi163.stdout: osd default data pool replay window = 5 2024-05-04T00:29:20.113 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.113 INFO:teuthology.orchestra.run.smithi163.stdout: mon allow pool delete = true 2024-05-04T00:29:20.113 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.113 INFO:teuthology.orchestra.run.smithi163.stdout: mon cluster log file level = debug 2024-05-04T00:29:20.113 INFO:teuthology.orchestra.run.smithi163.stdout: debug asserts on shutdown = true 2024-05-04T00:29:20.113 INFO:teuthology.orchestra.run.smithi163.stdout: mon health detail to clog = false 2024-05-04T00:29:20.113 INFO:teuthology.orchestra.run.smithi163.stdout: mon host = "172.21.15.6,172.21.15.163,[v2:172.21.15.163:3301,v1:172.21.15.163:6790]" 2024-05-04T00:29:20.113 INFO:teuthology.orchestra.run.smithi163.stdout: mds beacon grace = 60 2024-05-04T00:29:20.113 INFO:teuthology.orchestra.run.smithi163.stdout: mds heartbeat grace = 60 2024-05-04T00:29:20.113 INFO:teuthology.orchestra.run.smithi163.stdout: osd heartbeat grace = 60 2024-05-04T00:29:20.113 INFO:teuthology.orchestra.run.smithi163.stdout: fsid = ad5951ed-0d5e-4770-b5d9-995e08a00213 2024-05-04T00:29:20.113 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.113 INFO:teuthology.orchestra.run.smithi163.stdout:[osd] 2024-05-04T00:29:20.113 INFO:teuthology.orchestra.run.smithi163.stdout: osd journal size = 100 2024-05-04T00:29:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub load threshold = 5.0 2024-05-04T00:29:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub max interval = 600 2024-05-04T00:29:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: osd mclock profile = high_recovery_ops 2024-05-04T00:29:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: osd recover clone overlap = true 2024-05-04T00:29:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: osd recovery max chunk = 1048576 2024-05-04T00:29:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug shutdown = true 2024-05-04T00:29:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug op order = true 2024-05-04T00:29:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug verify stray on activate = true 2024-05-04T00:29:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug trim objects = true 2024-05-04T00:29:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: osd open classes on start = true 2024-05-04T00:29:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug pg log writeout = true 2024-05-04T00:29:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: osd deep scrub update digest min age = 30 2024-05-04T00:29:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: osd map max advance = 10 2024-05-04T00:29:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: journal zero on create = true 2024-05-04T00:29:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: filestore ondisk finisher threads = 3 2024-05-04T00:29:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: filestore apply finisher threads = 3 2024-05-04T00:29:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: bdev debug aio = true 2024-05-04T00:29:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug misdirected ops = true 2024-05-04T00:29:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: bdev async discard = True 2024-05-04T00:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: bdev enable discard = True 2024-05-04T00:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore allocator = bitmap 2024-05-04T00:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore block size = 96636764160 2024-05-04T00:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore fsck on mount = True 2024-05-04T00:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluefs = 1/20 2024-05-04T00:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluestore = 1/20 2024-05-04T00:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-05-04T00:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: debug osd = 20 2024-05-04T00:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: debug rocksdb = 4/10 2024-05-04T00:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd backfillfull_ratio = 0.85 2024-05-04T00:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd full ratio = 0.9 2024-05-04T00:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd nearfull ratio = 0.8 2024-05-04T00:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: osd failsafe full ratio = 0.95 2024-05-04T00:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: osd fast shutdown = False 2024-05-04T00:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: osd objectstore = bluestore 2024-05-04T00:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: osd op complaint time = 180 2024-05-04T00:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr] 2024-05-04T00:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-05-04T00:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: debug mgr = 20 2024-05-04T00:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2024-05-04T00:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2024-05-04T00:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2024-05-04T00:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2024-05-04T00:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: mgr/telemetry/nag = false 2024-05-04T00:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: debug client = 20 2024-05-04T00:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout:[mon] 2024-05-04T00:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-05-04T00:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2024-05-04T00:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: debug paxos = 20 2024-05-04T00:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2024-05-04T00:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: mon data avail warn = 5 2024-05-04T00:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: mon mgr mkfs grace = 240 2024-05-04T00:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2024-05-04T00:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd reporter subtree level = osd 2024-05-04T00:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd prime pg temp = true 2024-05-04T00:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2024-05-04T00:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-04T00:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: auth mon ticket ttl = 660 # 11m 2024-05-04T00:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: auth service ticket ttl = 240 # 4m 2024-05-04T00:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: # don't complain about insecure global_id in the test suite 2024-05-04T00:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-04T00:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-04T00:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: # 1m isn't quite enough 2024-05-04T00:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: mon_down_mkfs_grace = 2m 2024-05-04T00:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_filestore_osds = false 2024-05-04T00:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: mon down mkfs grace = 300 2024-05-04T00:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: mon op complaint time = 120 2024-05-04T00:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd crush smoke test = False 2024-05-04T00:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-04T00:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout:[client] 2024-05-04T00:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: rgw cache enabled = true 2024-05-04T00:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable ops log = true 2024-05-04T00:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable usage log = true 2024-05-04T00:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-04T00:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-04T00:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout: client mount timeout = 600 2024-05-04T00:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout: debug client = 20 2024-05-04T00:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-05-04T00:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout: rados mon op timeout = 900 2024-05-04T00:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout: rados osd op timeout = 900 2024-05-04T00:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.a] 2024-05-04T00:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.b] 2024-05-04T00:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.c] 2024-05-04T00:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.a] 2024-05-04T00:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.c] 2024-05-04T00:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.e] 2024-05-04T00:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.b] 2024-05-04T00:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.d] 2024-05-04T00:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.f] 2024-05-04T00:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout:[mds] 2024-05-04T00:29:20.121 INFO:teuthology.orchestra.run.smithi163.stdout: debug mds = 20 2024-05-04T00:29:20.121 INFO:teuthology.orchestra.run.smithi163.stdout: debug mds balancer = 20 2024-05-04T00:29:20.121 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-05-04T00:29:20.121 INFO:teuthology.orchestra.run.smithi163.stdout: mds debug frag = True 2024-05-04T00:29:20.121 INFO:teuthology.orchestra.run.smithi163.stdout: mds debug scatterstat = True 2024-05-04T00:29:20.121 INFO:teuthology.orchestra.run.smithi163.stdout: mds op complaint time = 180 2024-05-04T00:29:20.121 INFO:teuthology.orchestra.run.smithi163.stdout: mds valgrind exit = True 2024-05-04T00:29:20.121 INFO:teuthology.orchestra.run.smithi163.stdout: mds verify scatter = True 2024-05-04T00:29:20.121 INFO:teuthology.orchestra.run.smithi163.stdout: osd op complaint time = 180 2024-05-04T00:29:20.121 INFO:teuthology.orchestra.run.smithi163.stdout: rados mon op timeout = 900 2024-05-04T00:29:20.121 INFO:teuthology.orchestra.run.smithi163.stdout: rados osd op timeout = 900 2024-05-04T00:29:20.123 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-04T00:29:20.123 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-04T00:29:20.249 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-04T00:29:20.249 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:20.249 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-04T00:29:20.255 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:20.255 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-04T00:29:20.302 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi006.front.sepia.ceph.com 2024-05-04T00:29:20.302 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:20.302 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-04T00:29:20.302 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-04T00:29:20.368 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:20.368 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-04T00:29:20.415 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi163.front.sepia.ceph.com 2024-05-04T00:29:20.415 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:29:20.415 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-04T00:29:20.415 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-04T00:29:20.440 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:29:20.440 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-04T00:29:20.488 INFO:tasks.ceph:Setting up mon nodes... 2024-05-04T00:29:20.489 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-04T00:29:20.489 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-04T00:29:20.566 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-04T00:29:20.572 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-04T00:29:20.646 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-04T00:29:20.658 INFO:tasks.ceph:Setting up mds nodes... 2024-05-04T00:29:20.658 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-04T00:29:20.735 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-04T00:29:20.741 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-04T00:29:20.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-04T00:29:20.868 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-04T00:29:20.874 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-04T00:29:20.885 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-05-04T00:29:20.991 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-05-04T00:29:20.998 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-05-04T00:29:21.011 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-04T00:29:21.088 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-04T00:29:21.095 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-04T00:29:21.108 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-04T00:29:21.221 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-04T00:29:21.228 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-04T00:29:21.238 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-05-04T00:29:21.343 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-05-04T00:29:21.349 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-05-04T00:29:21.360 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-04T00:29:21.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-04T00:29:21.429 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-04T00:29:21.443 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-04T00:29:21.443 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-04T00:29:21.443 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-04T00:29:21.456 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-04T00:29:21.456 INFO:tasks.ceph:role: osd.0 2024-05-04T00:29:21.456 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com 2024-05-04T00:29:21.456 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-04T00:29:21.515 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T00:29:21.515 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T00:29:21.515 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T00:29:21.516 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-04T00:29:21.516 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T00:29:21.516 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-05-04T00:29:21.516 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T00:29:21.516 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-04T00:29:21.516 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T00:29:21.516 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T00:29:21.962 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-05-04T00:29:21.964 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-05-04T00:29:21.965 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-04T00:29:22.058 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-04T00:29:22.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T00:29:22.070 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2024-05-04T00:29:22.071 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-04T00:29:22.126 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-04T00:29:22.126 INFO:tasks.ceph:role: osd.1 2024-05-04T00:29:22.127 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com 2024-05-04T00:29:22.127 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-04T00:29:22.191 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T00:29:22.191 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T00:29:22.191 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T00:29:22.191 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-04T00:29:22.191 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T00:29:22.191 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-05-04T00:29:22.191 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T00:29:22.191 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-04T00:29:22.191 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T00:29:22.192 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T00:29:22.651 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-05-04T00:29:22.653 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-05-04T00:29:22.653 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-04T00:29:22.812 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-04T00:29:22.823 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2024-05-04T00:29:22.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T00:29:22.824 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-04T00:29:22.879 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-04T00:29:22.879 INFO:tasks.ceph:role: osd.2 2024-05-04T00:29:22.879 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com 2024-05-04T00:29:22.879 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-04T00:29:22.942 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T00:29:22.942 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T00:29:22.943 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T00:29:22.943 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-04T00:29:22.943 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T00:29:22.943 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-05-04T00:29:22.943 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T00:29:22.943 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-04T00:29:22.943 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T00:29:22.943 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T00:29:23.420 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-05-04T00:29:23.422 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-05-04T00:29:23.422 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-04T00:29:23.581 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-04T00:29:23.593 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2024-05-04T00:29:23.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T00:29:23.594 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-04T00:29:23.650 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-04T00:29:23.650 INFO:tasks.ceph:role: osd.3 2024-05-04T00:29:23.651 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com 2024-05-04T00:29:23.651 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-04T00:29:23.714 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T00:29:23.714 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T00:29:23.715 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T00:29:23.715 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-04T00:29:23.715 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T00:29:23.715 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-05-04T00:29:23.715 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T00:29:23.715 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-04T00:29:23.715 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T00:29:23.715 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T00:29:24.139 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-05-04T00:29:24.141 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-05-04T00:29:24.141 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-04T00:29:24.226 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-04T00:29:24.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T00:29:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2024-05-04T00:29:24.282 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T00:29:24.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:24.538+0000 7f638981d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-04T00:29:24.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:24.538+0000 7f638981d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-04T00:29:24.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:24.538+0000 7f638981d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-04T00:29:24.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:24.538+0000 7f638981d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-04T00:29:24.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:24.538+0000 7f638981d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-04T00:29:24.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:24.542+0000 7f638981d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-04T00:29:27.531 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-04T00:29:27.546 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T00:29:27.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:27.658+0000 7f3a1e6547c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-04T00:29:27.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:27.658+0000 7f3a1e6547c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-04T00:29:27.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:27.658+0000 7f3a1e6547c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-04T00:29:27.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:27.658+0000 7f3a1e6547c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-04T00:29:27.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:27.658+0000 7f3a1e6547c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-04T00:29:27.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:27.658+0000 7f3a1e6547c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-04T00:29:30.645 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-04T00:29:30.659 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T00:29:30.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:30.770+0000 7f5d309087c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-04T00:29:30.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:30.770+0000 7f5d309087c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-04T00:29:30.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:30.770+0000 7f5d309087c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-04T00:29:30.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:30.770+0000 7f5d309087c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-04T00:29:30.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:30.770+0000 7f5d309087c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-04T00:29:30.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:30.770+0000 7f5d309087c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-04T00:29:33.750 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-04T00:29:33.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T00:29:33.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:33.866+0000 7f72cfa8f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-04T00:29:33.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:33.866+0000 7f72cfa8f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-04T00:29:33.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:33.870+0000 7f72cfa8f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-04T00:29:33.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:33.870+0000 7f72cfa8f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-04T00:29:33.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:33.870+0000 7f72cfa8f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-04T00:29:33.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:33.870+0000 7f72cfa8f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-04T00:29:36.874 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-04T00:29:36.888 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-04T00:29:36.903 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-04T00:29:36.903 INFO:tasks.ceph:role: osd.4 2024-05-04T00:29:36.903 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com 2024-05-04T00:29:36.903 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-04T00:29:36.964 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T00:29:36.964 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T00:29:36.964 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T00:29:36.964 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-04T00:29:36.964 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T00:29:36.964 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-05-04T00:29:36.964 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T00:29:36.964 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-04T00:29:36.964 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T00:29:36.964 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T00:29:37.441 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-05-04T00:29:37.443 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-05-04T00:29:37.443 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-04T00:29:37.577 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-04T00:29:37.588 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: /sbin/restorecon: command not found 2024-05-04T00:29:37.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T00:29:37.589 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-04T00:29:37.644 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-04T00:29:37.644 INFO:tasks.ceph:role: osd.5 2024-05-04T00:29:37.644 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi163.front.sepia.ceph.com 2024-05-04T00:29:37.644 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-04T00:29:37.708 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T00:29:37.708 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T00:29:37.708 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T00:29:37.708 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-04T00:29:37.708 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T00:29:37.708 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-05-04T00:29:37.708 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T00:29:37.709 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-04T00:29:37.709 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T00:29:37.709 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T00:29:38.143 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-05-04T00:29:38.144 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-05-04T00:29:38.145 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-04T00:29:38.213 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-04T00:29:38.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T00:29:38.265 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: /sbin/restorecon: command not found 2024-05-04T00:29:38.266 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-04T00:29:38.319 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-04T00:29:38.319 INFO:tasks.ceph:role: osd.6 2024-05-04T00:29:38.319 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi163.front.sepia.ceph.com 2024-05-04T00:29:38.319 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-04T00:29:38.378 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T00:29:38.379 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T00:29:38.379 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T00:29:38.379 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-04T00:29:38.379 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T00:29:38.379 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-05-04T00:29:38.379 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T00:29:38.379 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-04T00:29:38.379 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T00:29:38.379 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T00:29:38.845 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-05-04T00:29:38.848 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-05-04T00:29:38.848 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-04T00:29:38.947 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-04T00:29:38.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T00:29:38.957 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: /sbin/restorecon: command not found 2024-05-04T00:29:38.957 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-04T00:29:39.232 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-04T00:29:39.232 INFO:tasks.ceph:role: osd.7 2024-05-04T00:29:39.232 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi163.front.sepia.ceph.com 2024-05-04T00:29:39.232 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-04T00:29:39.298 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T00:29:39.298 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T00:29:39.299 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T00:29:39.299 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-04T00:29:39.299 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T00:29:39.299 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-05-04T00:29:39.299 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T00:29:39.299 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-04T00:29:39.299 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T00:29:39.299 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T00:29:39.778 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-05-04T00:29:39.779 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-05-04T00:29:39.780 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-04T00:29:39.930 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-04T00:29:39.941 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: /sbin/restorecon: command not found 2024-05-04T00:29:39.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T00:29:39.942 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T00:29:40.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:40.085+0000 7ff71fe3b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-04T00:29:40.096 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:40.089+0000 7ff71fe3b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-04T00:29:40.096 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:40.093+0000 7ff71fe3b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-04T00:29:40.096 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:40.093+0000 7ff71fe3b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-04T00:29:40.096 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:40.093+0000 7ff71fe3b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-04T00:29:40.097 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:40.093+0000 7ff71fe3b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-04T00:29:43.071 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-04T00:29:43.084 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T00:29:43.196 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:43.193+0000 7fce67d167c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-04T00:29:43.196 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:43.193+0000 7fce67d167c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-04T00:29:43.197 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:43.193+0000 7fce67d167c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-04T00:29:43.197 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:43.193+0000 7fce67d167c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-04T00:29:43.197 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:43.193+0000 7fce67d167c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-04T00:29:43.197 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:43.193+0000 7fce67d167c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-04T00:29:46.168 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-04T00:29:46.182 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T00:29:46.297 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:46.293+0000 7fbca0f957c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-04T00:29:46.298 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:46.293+0000 7fbca0f957c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-04T00:29:46.298 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:46.293+0000 7fbca0f957c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-04T00:29:46.298 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:46.293+0000 7fbca0f957c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-04T00:29:46.298 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:46.293+0000 7fbca0f957c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-04T00:29:46.299 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:46.293+0000 7fbca0f957c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-04T00:29:48.345 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:29:48.347 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:29:49.317 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-04T00:29:49.331 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T00:29:49.439 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:49.433+0000 7facd684c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-04T00:29:49.439 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:49.433+0000 7facd684c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-04T00:29:49.439 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:49.433+0000 7facd684c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-04T00:29:49.440 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:49.433+0000 7facd684c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-04T00:29:49.440 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:49.433+0000 7facd684c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-04T00:29:49.440 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:29:49.437+0000 7facd684c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-04T00:29:52.416 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-04T00:29:52.429 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-04T00:29:52.430 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:52.430 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-04T00:29:52.444 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:52.444 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-04T00:29:52.498 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:52.498 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-04T00:29:52.554 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:52.554 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-05-04T00:29:52.610 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:52.610 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-04T00:29:52.665 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:52.665 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-04T00:29:52.722 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:52.722 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-04T00:29:52.777 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:52.777 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-04T00:29:52.833 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:29:52.833 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-04T00:29:52.848 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:29:52.848 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-04T00:29:52.903 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:29:52.903 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-04T00:29:52.955 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:29:52.955 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-05-04T00:29:53.010 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:29:53.010 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-04T00:29:53.063 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:29:53.063 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-04T00:29:53.115 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:29:53.115 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-04T00:29:53.168 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:29:53.168 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-04T00:29:53.224 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:29:53.224 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-04T00:29:53.230 INFO:tasks.ceph:Adding keys to all mons... 2024-05-04T00:29:53.230 DEBUG:teuthology.orchestra.run.smithi006:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-04T00:29:53.275 DEBUG:teuthology.orchestra.run.smithi163:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-04T00:29:53.285 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.y] 2024-05-04T00:29:53.285 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBggTVmXznFIRAAnqbvyDVMJrNrItiiP1PJyg== 2024-05-04T00:29:53.285 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2024-05-04T00:29:53.285 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBggTVmDtTbKxAA6OecTMGCAx4e6d+otuRu0w== 2024-05-04T00:29:53.285 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2024-05-04T00:29:53.285 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBggTVmScTKMxAAuZ9VvVADscY18UaFzJxeNQ== 2024-05-04T00:29:53.285 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.e] 2024-05-04T00:29:53.285 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBggTVmQAEpOxAAWfPaTLm7pmCfsqPJddPaRQ== 2024-05-04T00:29:53.286 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.0] 2024-05-04T00:29:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBkgTVmLoaBIBAAN1kD0COfdNvwqYGXPmiKfQ== 2024-05-04T00:29:53.286 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.1] 2024-05-04T00:29:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBngTVmAE+YJxAA8JPmvvDUU8jBR+dJOCNjYw== 2024-05-04T00:29:53.286 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.2] 2024-05-04T00:29:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBqgTVmXjUvLhAAjc7hjs7rvVomkC32qf7u8Q== 2024-05-04T00:29:53.286 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.3] 2024-05-04T00:29:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBtgTVmMCoZNBAAthQdmQ3gIAWQbZJ4NB5a9w== 2024-05-04T00:29:53.286 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.x] 2024-05-04T00:29:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBggTVmR1mcJhAAeb5wN/dwJs3VDzfQ/WphlA== 2024-05-04T00:29:53.286 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2024-05-04T00:29:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBhgTVm28peBRAAJ+MSVJ16+tmZXthFwNJ/uQ== 2024-05-04T00:29:53.286 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2024-05-04T00:29:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBhgTVmLxNJDRAA6+NvoXxmK20CE8duZGZvQA== 2024-05-04T00:29:53.287 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.f] 2024-05-04T00:29:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBhgTVmXomOFBAA94O3H5R8Y8/kdSjBHuC37A== 2024-05-04T00:29:53.287 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.4] 2024-05-04T00:29:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQB0gTVmHI2FBRAA2t5ZYWQiGuqXBGK2QP1hHw== 2024-05-04T00:29:53.287 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.5] 2024-05-04T00:29:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQB3gTVm3qHFCxAA+Gc5rZ56pmhGpGfR3Jp05Q== 2024-05-04T00:29:53.287 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.6] 2024-05-04T00:29:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQB6gTVmnlrUERAADxqIcPWI+1Nkw219x6sqQw== 2024-05-04T00:29:53.287 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.7] 2024-05-04T00:29:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQB9gTVmFkM/GhAAGvnxQ0SXYpWkYyKhWodz2w== 2024-05-04T00:29:53.287 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-05-04T00:29:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBhgTVmOlGiGRAAOXCOEYuzE5hWYI/eA4CmeA== 2024-05-04T00:29:53.289 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr.y] 2024-05-04T00:29:53.289 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQBggTVmXznFIRAAnqbvyDVMJrNrItiiP1PJyg== 2024-05-04T00:29:53.289 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.a] 2024-05-04T00:29:53.289 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQBggTVmDtTbKxAA6OecTMGCAx4e6d+otuRu0w== 2024-05-04T00:29:53.289 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.c] 2024-05-04T00:29:53.289 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQBggTVmScTKMxAAuZ9VvVADscY18UaFzJxeNQ== 2024-05-04T00:29:53.289 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.e] 2024-05-04T00:29:53.289 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQBggTVmQAEpOxAAWfPaTLm7pmCfsqPJddPaRQ== 2024-05-04T00:29:53.289 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.0] 2024-05-04T00:29:53.289 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQBkgTVmLoaBIBAAN1kD0COfdNvwqYGXPmiKfQ== 2024-05-04T00:29:53.289 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.1] 2024-05-04T00:29:53.289 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQBngTVmAE+YJxAA8JPmvvDUU8jBR+dJOCNjYw== 2024-05-04T00:29:53.290 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.2] 2024-05-04T00:29:53.290 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQBqgTVmXjUvLhAAjc7hjs7rvVomkC32qf7u8Q== 2024-05-04T00:29:53.290 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.3] 2024-05-04T00:29:53.290 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQBtgTVmMCoZNBAAthQdmQ3gIAWQbZJ4NB5a9w== 2024-05-04T00:29:53.290 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr.x] 2024-05-04T00:29:53.290 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQBggTVmR1mcJhAAeb5wN/dwJs3VDzfQ/WphlA== 2024-05-04T00:29:53.290 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.b] 2024-05-04T00:29:53.290 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQBhgTVm28peBRAAJ+MSVJ16+tmZXthFwNJ/uQ== 2024-05-04T00:29:53.290 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.d] 2024-05-04T00:29:53.290 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQBhgTVmLxNJDRAA6+NvoXxmK20CE8duZGZvQA== 2024-05-04T00:29:53.290 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.f] 2024-05-04T00:29:53.290 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQBhgTVmXomOFBAA94O3H5R8Y8/kdSjBHuC37A== 2024-05-04T00:29:53.290 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.4] 2024-05-04T00:29:53.290 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQB0gTVmHI2FBRAA2t5ZYWQiGuqXBGK2QP1hHw== 2024-05-04T00:29:53.290 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.5] 2024-05-04T00:29:53.291 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQB3gTVm3qHFCxAA+Gc5rZ56pmhGpGfR3Jp05Q== 2024-05-04T00:29:53.291 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.6] 2024-05-04T00:29:53.291 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQB6gTVmnlrUERAADxqIcPWI+1Nkw219x6sqQw== 2024-05-04T00:29:53.291 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.7] 2024-05-04T00:29:53.291 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQB9gTVmFkM/GhAAGvnxQ0SXYpWkYyKhWodz2w== 2024-05-04T00:29:53.291 INFO:teuthology.orchestra.run.smithi163.stdout:[client.0] 2024-05-04T00:29:53.291 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQBhgTVmOlGiGRAAOXCOEYuzE5hWYI/eA4CmeA== 2024-05-04T00:29:53.291 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-04T00:29:53.331 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-04T00:29:53.411 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T00:29:53.413 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T00:29:53.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T00:29:53.491 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T00:29:53.564 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T00:29:53.566 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T00:29:53.638 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T00:29:53.641 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T00:29:53.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T00:29:53.713 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T00:29:53.781 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T00:29:53.784 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T00:29:53.853 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T00:29:53.855 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T00:29:53.925 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-04T00:29:53.927 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-04T00:29:53.998 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T00:29:54.000 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T00:29:54.073 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T00:29:54.075 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T00:29:54.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T00:29:54.154 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T00:29:54.224 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T00:29:54.226 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T00:29:54.295 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T00:29:54.297 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T00:29:54.366 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T00:29:54.372 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T00:29:54.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T00:29:54.443 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T00:29:54.511 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-04T00:29:54.513 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-04T00:29:54.586 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-04T00:29:54.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-04T00:29:54.595 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-04T00:29:54.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-04T00:29:54.716 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-04T00:29:54.729 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-04T00:29:54.853 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-04T00:29:54.862 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-04T00:29:54.914 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-04T00:29:55.035 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-04T00:29:55.045 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-04T00:29:55.048 DEBUG:teuthology.orchestra.run.smithi163:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-04T00:29:55.091 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-04T00:29:55.092 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-05-04T00:29:55.092 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-04T00:29:55.092 DEBUG:teuthology.orchestra.run.smithi006:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-05-04T00:29:55.095 INFO:tasks.ceph.mon.a:Started 2024-05-04T00:29:55.095 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-05-04T00:29:55.095 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-04T00:29:55.096 DEBUG:teuthology.orchestra.run.smithi163:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-05-04T00:29:55.137 INFO:tasks.ceph.mon.b:Started 2024-05-04T00:29:55.137 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-05-04T00:29:55.137 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-04T00:29:55.137 DEBUG:teuthology.orchestra.run.smithi163:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-05-04T00:29:55.139 INFO:tasks.ceph.mon.c:Started 2024-05-04T00:29:55.140 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-04T00:29:55.140 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-04T00:29:55.140 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-05-04T00:29:55.143 INFO:tasks.ceph.mgr.y:Started 2024-05-04T00:29:55.143 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-04T00:29:55.143 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-05-04T00:29:55.145 INFO:tasks.ceph.mgr.x:Started 2024-05-04T00:29:55.145 INFO:tasks.ceph:Setting crush tunables to default 2024-05-04T00:29:55.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd crush tunables default 2024-05-04T00:29:55.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.290+0000 7f3dac057640 1 Processor -- start 2024-05-04T00:29:55.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.290+0000 7f3dac057640 1 -- start start 2024-05-04T00:29:55.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.294+0000 7f3dac057640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3da40cea80 0x7f3da40b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:29:55.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.294+0000 7f3dac057640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3da4164c90 0x7f3da41670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:29:55.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.294+0000 7f3dac057640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da415ce40 con 0x7f3da40b4b00 2024-05-04T00:29:55.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.294+0000 7f3dac057640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f3da40cdd50 con 0x7f3da4164c90 2024-05-04T00:29:55.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.294+0000 7f3dac057640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f3da40cbad0 con 0x7f3da40cea80 2024-05-04T00:29:55.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.294+0000 7f3daa5f4640 1 -- >> v2:172.21.15.6:3300/0 conn(0x7f3da4164c90 msgr2=0x7f3da41670b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.6:3300/0 2024-05-04T00:29:55.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.294+0000 7f3da9df3640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7f3da40b4b00 legacy=0x7f3da40d1790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.163:6789/0 2024-05-04T00:29:55.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.294+0000 7f3da95f2640 1 -- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3da40cea80 msgr2=0x7f3da40b3ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3301/0 2024-05-04T00:29:55.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.294+0000 7f3daa5f4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3da4164c90 0x7f3da41670b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T00:29:55.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.294+0000 7f3da95f2640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3da40cea80 0x7f3da40b3ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T00:29:55.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.498+0000 7f3daa5f4640 1 -- >> v2:172.21.15.6:3300/0 conn(0x7f3da4164c90 msgr2=0x7f3da41670b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.6:3300/0 2024-05-04T00:29:55.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.498+0000 7f3daa5f4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3da4164c90 0x7f3da41670b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T00:29:55.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.498+0000 7f3da9df3640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7f3da40b4b00 legacy=0x7f3da40d1790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.163:6789/0 2024-05-04T00:29:55.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.498+0000 7f3da95f2640 1 -- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3da40cea80 msgr2=0x7f3da40b3ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3301/0 2024-05-04T00:29:55.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.498+0000 7f3da95f2640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3da40cea80 0x7f3da40b3ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T00:29:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.902+0000 7f3daa5f4640 1 -- >> v2:172.21.15.6:3300/0 conn(0x7f3da4164c90 msgr2=0x7f3da41670b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.6:3300/0 2024-05-04T00:29:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.902+0000 7f3daa5f4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3da4164c90 0x7f3da41670b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T00:29:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.902+0000 7f3da9df3640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7f3da40b4b00 legacy=0x7f3da40d1790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.163:6789/0 2024-05-04T00:29:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.902+0000 7f3da95f2640 1 -- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3da40cea80 msgr2=0x7f3da40b3ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3301/0 2024-05-04T00:29:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:55.902+0000 7f3da95f2640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3da40cea80 0x7f3da40b3ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T00:29:56.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:56.706+0000 7f3daa5f4640 1 -- >> v2:172.21.15.6:3300/0 conn(0x7f3da4164c90 msgr2=0x7f3da41670b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.6:3300/0 2024-05-04T00:29:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:56.706+0000 7f3daa5f4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3da4164c90 0x7f3da41670b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T00:29:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:56.706+0000 7f3da9df3640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7f3da40b4b00 legacy=0x7f3da40d1790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.163:6789/0 2024-05-04T00:29:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:56.706+0000 7f3da95f2640 1 -- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3da40cea80 msgr2=0x7f3da40b3ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3301/0 2024-05-04T00:29:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:56.706+0000 7f3da95f2640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3da40cea80 0x7f3da40b3ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T00:29:58.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:58.294+0000 7f3d977fe640 1 -- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3da40cea80 msgr2=0x7f3da40b3ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T00:29:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:58.294+0000 7f3d977fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3da40cea80 0x7f3da40b3ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:29:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:58.294+0000 7f3d977fe640 1 -- >> v2:172.21.15.6:3300/0 conn(0x7f3da4164c90 msgr2=0x7f3da41670b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T00:29:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:58.294+0000 7f3d977fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3da4164c90 0x7f3da41670b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:29:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:58.294+0000 7f3d977fe640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7f3da40b4b00 legacy=0x7f3da40d1790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T00:29:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:58.294+0000 7f3d977fe640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3d880036d0 0x7f3d88005ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:29:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:58.294+0000 7f3d977fe640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da415d120 con 0x7f3d88006290 2024-05-04T00:29:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:58.294+0000 7f3d977fe640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f3da40cdd50 con 0x7f3d880036d0 2024-05-04T00:29:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:58.294+0000 7f3da95f2640 1 -- >> v1:172.21.15.6:6789/0 conn(0x7f3d88006290 legacy=0x7f3d880087a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.6:6789/0 2024-05-04T00:29:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:58.294+0000 7f3da9df3640 1 -- >> v2:172.21.15.163:3300/0 conn(0x7f3d880036d0 msgr2=0x7f3d88005ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3300/0 2024-05-04T00:29:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:58.294+0000 7f3da9df3640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3d880036d0 0x7f3d88005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T00:29:58.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:58.498+0000 7f3da95f2640 1 -- >> v1:172.21.15.6:6789/0 conn(0x7f3d88006290 legacy=0x7f3d880087a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.6:6789/0 2024-05-04T00:29:58.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:58.498+0000 7f3da9df3640 1 -- >> v2:172.21.15.163:3300/0 conn(0x7f3d880036d0 msgr2=0x7f3d88005ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3300/0 2024-05-04T00:29:58.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:58.498+0000 7f3da9df3640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3d880036d0 0x7f3d88005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T00:29:58.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:58.902+0000 7f3da95f2640 1 -- >> v1:172.21.15.6:6789/0 conn(0x7f3d88006290 legacy=0x7f3d880087a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.6:6789/0 2024-05-04T00:29:58.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:58.902+0000 7f3da9df3640 1 -- >> v2:172.21.15.163:3300/0 conn(0x7f3d880036d0 msgr2=0x7f3d88005ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3300/0 2024-05-04T00:29:58.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:58.902+0000 7f3da9df3640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3d880036d0 0x7f3d88005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T00:29:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:59.706+0000 7f3da95f2640 1 -- >> v1:172.21.15.6:6789/0 conn(0x7f3d88006290 legacy=0x7f3d880087a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.6:6789/0 2024-05-04T00:29:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:59.706+0000 7f3da9df3640 1 -- >> v2:172.21.15.163:3300/0 conn(0x7f3d880036d0 msgr2=0x7f3d88005ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3300/0 2024-05-04T00:29:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:29:59.706+0000 7f3da9df3640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3d880036d0 0x7f3d88005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T00:30:01.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.294+0000 7f3d977fe640 1 -- >> v2:172.21.15.163:3300/0 conn(0x7f3d880036d0 msgr2=0x7f3d88005ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T00:30:01.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.294+0000 7f3d977fe640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3d880036d0 0x7f3d88005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:01.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.294+0000 7f3d977fe640 1 -- >> v1:172.21.15.6:6789/0 conn(0x7f3d88006290 legacy=0x7f3d880087a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T00:30:01.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.294+0000 7f3daa5f4640 1 -- reap_dead start 2024-05-04T00:30:01.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.294+0000 7f3d977fe640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3d8800a080 0x7f3d88005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:01.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.294+0000 7f3d977fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d8800a5a0 0x7f3d8800aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:01.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.294+0000 7f3d977fe640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da415ce40 con 0x7f3d880087e0 2024-05-04T00:30:01.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.294+0000 7f3d977fe640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f3da40cdd50 con 0x7f3d8800a080 2024-05-04T00:30:01.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.294+0000 7f3d977fe640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f3da40cbad0 con 0x7f3d8800a5a0 2024-05-04T00:30:01.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.294+0000 7f3da9df3640 1 -- >> v2:172.21.15.163:3300/0 conn(0x7f3d8800a080 msgr2=0x7f3d88005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3300/0 2024-05-04T00:30:01.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.294+0000 7f3daa5f4640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7f3d880087e0 legacy=0x7f3d88008f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.163:6789/0 2024-05-04T00:30:01.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.294+0000 7f3da9df3640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3d8800a080 0x7f3d88005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T00:30:01.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.294+0000 7f3da95f2640 1 -- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d8800a5a0 msgr2=0x7f3d8800aa30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3301/0 2024-05-04T00:30:01.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.294+0000 7f3da95f2640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d8800a5a0 0x7f3d8800aa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T00:30:01.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.498+0000 7f3daa5f4640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7f3d880087e0 legacy=0x7f3d88008f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.163:6789/0 2024-05-04T00:30:01.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.498+0000 7f3da95f2640 1 -- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d8800a5a0 msgr2=0x7f3d8800aa30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3301/0 2024-05-04T00:30:01.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.498+0000 7f3da9df3640 1 -- >> v2:172.21.15.163:3300/0 conn(0x7f3d8800a080 msgr2=0x7f3d88005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3300/0 2024-05-04T00:30:01.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.498+0000 7f3da95f2640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d8800a5a0 0x7f3d8800aa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T00:30:01.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.498+0000 7f3da9df3640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3d8800a080 0x7f3d88005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T00:30:01.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.902+0000 7f3daa5f4640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7f3d880087e0 legacy=0x7f3d88008f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.163:6789/0 2024-05-04T00:30:01.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.902+0000 7f3da95f2640 1 -- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d8800a5a0 msgr2=0x7f3d8800aa30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3301/0 2024-05-04T00:30:01.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.902+0000 7f3da9df3640 1 -- >> v2:172.21.15.163:3300/0 conn(0x7f3d8800a080 msgr2=0x7f3d88005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3300/0 2024-05-04T00:30:01.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.902+0000 7f3da95f2640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d8800a5a0 0x7f3d8800aa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T00:30:01.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:01.902+0000 7f3da9df3640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3d8800a080 0x7f3d88005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T00:30:02.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:02.706+0000 7f3daa5f4640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7f3d880087e0 legacy=0x7f3d88008f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.163:6789/0 2024-05-04T00:30:02.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:02.706+0000 7f3da9df3640 1 -- >> v2:172.21.15.163:3300/0 conn(0x7f3d8800a080 msgr2=0x7f3d88005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3300/0 2024-05-04T00:30:02.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:02.706+0000 7f3da95f2640 1 -- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d8800a5a0 msgr2=0x7f3d8800aa30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3301/0 2024-05-04T00:30:02.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:02.706+0000 7f3da9df3640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3d8800a080 0x7f3d88005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T00:30:02.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:02.706+0000 7f3da95f2640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d8800a5a0 0x7f3d8800aa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T00:30:03.692 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:00:08.399 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:30:03.692 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:00:08.400 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:30:04.017 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:00:08.725 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:30:04.018 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:00:08.726 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:30:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:04.294+0000 7f3d977fe640 1 -- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d8800a5a0 msgr2=0x7f3d8800aa30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T00:30:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:04.294+0000 7f3d977fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d8800a5a0 0x7f3d8800aa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:04.294+0000 7f3d977fe640 1 -- >> v2:172.21.15.163:3300/0 conn(0x7f3d8800a080 msgr2=0x7f3d88005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T00:30:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:04.294+0000 7f3d977fe640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3d8800a080 0x7f3d88005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:04.294+0000 7f3d977fe640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7f3d880087e0 legacy=0x7f3d88008f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T00:30:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:04.294+0000 7f3d977fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d88011960 0x7f3d88013d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:04.294+0000 7f3d977fe640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da415d120 con 0x7f3d88009800 2024-05-04T00:30:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:04.294+0000 7f3d977fe640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f3da40cdd50 con 0x7f3d88011960 2024-05-04T00:30:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:04.294+0000 7f3da9df3640 1 -- >> v1:172.21.15.6:6789/0 conn(0x7f3d88009800 legacy=0x7f3d88010240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.6:6789/0 2024-05-04T00:30:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:04.294+0000 7f3da95f2640 1 -- >> v2:172.21.15.6:3300/0 conn(0x7f3d88011960 msgr2=0x7f3d88013d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.6:3300/0 2024-05-04T00:30:04.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:04.294+0000 7f3da95f2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d88011960 0x7f3d88013d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T00:30:04.407 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:00:09.169 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:30:04.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:04.498+0000 7f3da9df3640 1 -- >> v1:172.21.15.6:6789/0 conn(0x7f3d88009800 legacy=0x7f3d88010240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.6:6789/0 2024-05-04T00:30:04.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:04.498+0000 7f3da95f2640 1 -- >> v2:172.21.15.6:3300/0 conn(0x7f3d88011960 msgr2=0x7f3d88013d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.6:3300/0 2024-05-04T00:30:04.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:04.498+0000 7f3da95f2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d88011960 0x7f3d88013d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T00:30:04.750 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:00:09.511 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:30:04.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:04.902+0000 7f3da9df3640 1 -- >> v1:172.21.15.6:6789/0 conn(0x7f3d88009800 legacy=0x7f3d88010240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.6:6789/0 2024-05-04T00:30:04.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:04.902+0000 7f3da95f2640 1 -- >> v2:172.21.15.6:3300/0 conn(0x7f3d88011960 msgr2=0x7f3d88013d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.6:3300/0 2024-05-04T00:30:04.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:04.902+0000 7f3da95f2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d88011960 0x7f3d88013d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T00:30:05.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:05.706+0000 7f3da95f2640 1 -- >> v2:172.21.15.6:3300/0 conn(0x7f3d88011960 msgr2=0x7f3d88013d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.6:3300/0 2024-05-04T00:30:05.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:05.706+0000 7f3da9df3640 1 -- >> v1:172.21.15.6:6789/0 conn(0x7f3d88009800 legacy=0x7f3d88010240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.6:6789/0 2024-05-04T00:30:05.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:05.706+0000 7f3da95f2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d88011960 0x7f3d88013d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T00:30:07.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.294+0000 7f3d977fe640 1 -- >> v2:172.21.15.6:3300/0 conn(0x7f3d88011960 msgr2=0x7f3d88013d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T00:30:07.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.294+0000 7f3d977fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d88011960 0x7f3d88013d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:07.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.294+0000 7f3d977fe640 1 -- >> v1:172.21.15.6:6789/0 conn(0x7f3d88009800 legacy=0x7f3d88010240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T00:30:07.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.294+0000 7f3daa5f4640 1 -- reap_dead start 2024-05-04T00:30:07.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.294+0000 7f3d977fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 0x7f3d8800a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:07.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.294+0000 7f3d977fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 0x7f3d88005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:07.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.294+0000 7f3d977fe640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da415ce40 con 0x7f3d8800b210 2024-05-04T00:30:07.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.294+0000 7f3d977fe640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f3da40cdd50 con 0x7f3d88008f50 2024-05-04T00:30:07.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.294+0000 7f3d977fe640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f3da40cbad0 con 0x7f3d880087e0 2024-05-04T00:30:07.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.322+0000 7f3da9df3640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 0x7f3d8800a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:07.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.406+0000 7f3da9df3640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 0x7f3d8800a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:48908/0 (socket says 172.21.15.6:48908) 2024-05-04T00:30:07.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.406+0000 7f3da9df3640 1 -- 172.21.15.6:0/3483429197 learned_addr learned my addr 172.21.15.6:0/3483429197 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:30:07.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.454+0000 7f3da9df3640 1 -- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 msgr2=0x7f3d8800a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-04T00:30:07.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.454+0000 7f3da9df3640 1 -- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 msgr2=0x7f3d8800a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T00:30:07.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.454+0000 7f3da9df3640 1 --2- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 0x7f3d8800a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T00:30:07.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.454+0000 7f3da9df3640 1 --2- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 0x7f3d8800a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T00:30:07.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.626+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 0x7f3d88005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:07.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.658+0000 7f3da9df3640 1 --2- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 0x7f3d8800a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:07.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.662+0000 7f3da9df3640 1 -- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 msgr2=0x7f3d8800a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-04T00:30:07.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.662+0000 7f3da9df3640 1 -- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 msgr2=0x7f3d8800a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T00:30:07.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.662+0000 7f3da9df3640 1 --2- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 0x7f3d8800a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T00:30:07.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.662+0000 7f3da9df3640 1 --2- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 0x7f3d8800a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T00:30:07.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.782+0000 7f3da95f2640 1 -- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 msgr2=0x7f3d88005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T00:30:07.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.782+0000 7f3da95f2640 1 -- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 msgr2=0x7f3d88005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T00:30:07.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.782+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 0x7f3d88005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T00:30:07.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.782+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 0x7f3d88005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T00:30:07.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:07.986+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 0x7f3d88005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:08.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:08.066+0000 7f3da9df3640 1 --2- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 0x7f3d8800a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:08.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:08.070+0000 7f3da9df3640 1 -- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 msgr2=0x7f3d8800a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T00:30:08.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:08.070+0000 7f3da9df3640 1 -- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 msgr2=0x7f3d8800a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T00:30:08.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:08.070+0000 7f3da9df3640 1 --2- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 0x7f3d8800a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T00:30:08.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:08.070+0000 7f3da9df3640 1 --2- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 0x7f3d8800a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T00:30:08.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:08.106+0000 7f3da95f2640 1 -- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 msgr2=0x7f3d88005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-04T00:30:08.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:08.106+0000 7f3da95f2640 1 -- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 msgr2=0x7f3d88005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T00:30:08.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:08.106+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 0x7f3d88005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T00:30:08.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:08.106+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 0x7f3d88005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T00:30:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:08.554+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 0x7f3d88005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:08.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:08.618+0000 7f3da95f2640 1 -- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 msgr2=0x7f3d88005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-04T00:30:08.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:08.618+0000 7f3da95f2640 1 -- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 msgr2=0x7f3d88005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T00:30:08.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:08.618+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 0x7f3d88005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T00:30:08.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:08.618+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 0x7f3d88005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T00:30:08.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:08.926+0000 7f3da9df3640 1 --2- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 0x7f3d8800a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:08.942+0000 7f3da9df3640 1 -- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 msgr2=0x7f3d8800a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-04T00:30:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:08.942+0000 7f3da9df3640 1 -- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 msgr2=0x7f3d8800a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T00:30:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:08.942+0000 7f3da9df3640 1 --2- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 0x7f3d8800a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T00:30:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:08.942+0000 7f3da9df3640 1 --2- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 0x7f3d8800a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T00:30:10.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.134+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 0x7f3d88005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:10.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.138+0000 7f3da95f2640 1 -- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 msgr2=0x7f3d88005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-04T00:30:10.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.138+0000 7f3da95f2640 1 -- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 msgr2=0x7f3d88005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T00:30:10.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.138+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 0x7f3d88005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T00:30:10.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.138+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 0x7f3d88005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T00:30:10.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.294+0000 7f3d977fe640 1 -- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 msgr2=0x7f3d8800a9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T00:30:10.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.294+0000 7f3d977fe640 1 --2- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d880087e0 0x7f3d8800a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:10.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.294+0000 7f3d977fe640 1 -- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 msgr2=0x7f3d88005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T00:30:10.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.294+0000 7f3d977fe640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.6:3300/0 conn(0x7f3d88008f50 0x7f3d88005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:10.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.294+0000 7f3d977fe640 1 -- 172.21.15.6:0/3483429197 >> v1:172.21.15.6:6789/0 conn(0x7f3d8800b210 legacy=0x7f3d8800d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:10.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.294+0000 7f3d977fe640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 0x7f3d880151a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:10.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.294+0000 7f3d977fe640 1 -- 172.21.15.6:0/3483429197 --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da415d120 con 0x7f3d8800ed50 2024-05-04T00:30:10.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.294+0000 7f3d977fe640 1 -- 172.21.15.6:0/3483429197 --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f3da40cdd50 con 0x7f3d88012d80 2024-05-04T00:30:10.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.298+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 0x7f3d880151a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:10.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.302+0000 7f3da95f2640 1 -- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 msgr2=0x7f3d880151a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T00:30:10.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.302+0000 7f3da95f2640 1 -- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 msgr2=0x7f3d880151a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T00:30:10.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.302+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 0x7f3d880151a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T00:30:10.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.302+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 0x7f3d880151a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T00:30:10.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.630+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 0x7f3d880151a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:10.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.690+0000 7f3da95f2640 1 -- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 msgr2=0x7f3d880151a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T00:30:10.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.690+0000 7f3da95f2640 1 -- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 msgr2=0x7f3d880151a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T00:30:10.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.690+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 0x7f3d880151a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T00:30:10.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:10.690+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 0x7f3d880151a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T00:30:11.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:11.094+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 0x7f3d880151a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:11.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:11.098+0000 7f3da95f2640 1 -- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 msgr2=0x7f3d880151a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T00:30:11.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:11.098+0000 7f3da95f2640 1 -- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 msgr2=0x7f3d880151a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T00:30:11.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:11.098+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 0x7f3d880151a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T00:30:11.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:11.098+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 0x7f3d880151a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T00:30:11.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:11.902+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 0x7f3d880151a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:11.906+0000 7f3da95f2640 1 -- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 msgr2=0x7f3d880151a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T00:30:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:11.906+0000 7f3da95f2640 1 -- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 msgr2=0x7f3d880151a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T00:30:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:11.906+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 0x7f3d880151a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T00:30:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:11.906+0000 7f3da95f2640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 0x7f3d880151a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T00:30:13.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.074+0000 7f3da8df1640 1 -- 172.21.15.6:0/3483429197 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4181582793 0 0) 0x7f3da415d120 con 0x7f3d8800ed50 2024-05-04T00:30:13.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.074+0000 7f3da8df1640 1 -- 172.21.15.6:0/3483429197 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d90003530 con 0x7f3d8800ed50 2024-05-04T00:30:13.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.294+0000 7f3d977fe640 1 -- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 msgr2=0x7f3d880151a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T00:30:13.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.294+0000 7f3d977fe640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88012d80 0x7f3d880151a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:13.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.294+0000 7f3d977fe640 1 -- 172.21.15.6:0/3483429197 >> v1:172.21.15.163:6789/0 conn(0x7f3d8800ed50 legacy=0x7f3d88011170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:13.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.294+0000 7f3daa5f4640 1 -- 172.21.15.6:0/3483429197 reap_dead start 2024-05-04T00:30:13.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.294+0000 7f3d977fe640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88008f50 0x7f3d8800a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:13.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.294+0000 7f3d977fe640 1 --2- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d88005b20 0x7f3d88015f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:13.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.294+0000 7f3d977fe640 1 -- 172.21.15.6:0/3483429197 --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d88016820 con 0x7f3d88008780 2024-05-04T00:30:13.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.294+0000 7f3d977fe640 1 -- 172.21.15.6:0/3483429197 --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f3da40cdd50 con 0x7f3d88008f50 2024-05-04T00:30:13.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.294+0000 7f3d977fe640 1 -- 172.21.15.6:0/3483429197 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f3da40cbad0 con 0x7f3d88005b20 2024-05-04T00:30:13.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.354+0000 7f3da9df3640 1 --2- 172.21.15.6:0/3483429197 >> v2:172.21.15.163:3300/0 conn(0x7f3d88008f50 0x7f3d8800a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:13.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.378+0000 7f3da9df3640 1 -- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d88005b20 msgr2=0x7f3d88015f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:30:13.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.378+0000 7f3da9df3640 1 --2- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d88005b20 0x7f3d88015f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:13.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.378+0000 7f3da9df3640 1 -- 172.21.15.6:0/3483429197 >> v1:172.21.15.163:6789/0 conn(0x7f3d88008780 legacy=0x7f3d88015860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:30:13.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.378+0000 7f3da9df3640 1 -- 172.21.15.6:0/3483429197 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d880164b0 con 0x7f3d88008f50 2024-05-04T00:30:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.386+0000 7f3da9df3640 1 --2- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d88008f50 0x7f3d8800a9b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3d880096b0 tx=0x7f3d9801d220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adfeee23bf8fc06d server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:13.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.486+0000 7f3da8df1640 1 -- 172.21.15.6:0/3483429197 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d980b1070 con 0x7f3d88008f50 2024-05-04T00:30:13.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.486+0000 7f3da8df1640 1 -- 172.21.15.6:0/3483429197 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d980ac600 con 0x7f3d88008f50 2024-05-04T00:30:13.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.486+0000 7f3da8df1640 1 -- 172.21.15.6:0/3483429197 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d980ac9f0 con 0x7f3d88008f50 2024-05-04T00:30:13.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.490+0000 7f3dac057640 1 -- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d88008f50 msgr2=0x7f3d8800a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:13.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.490+0000 7f3dac057640 1 --2- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d88008f50 0x7f3d8800a9b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3d880096b0 tx=0x7f3d9801d220 comp rx=0 tx=0).stop 2024-05-04T00:30:13.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.490+0000 7f3dac057640 1 -- 172.21.15.6:0/3483429197 shutdown_connections 2024-05-04T00:30:13.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.490+0000 7f3dac057640 1 --2- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d88005b20 0x7f3d88015f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:13.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.490+0000 7f3dac057640 1 --2- 172.21.15.6:0/3483429197 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d88008f50 0x7f3d8800a9b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:13.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.490+0000 7f3dac057640 1 -- 172.21.15.6:0/3483429197 >> 172.21.15.6:0/3483429197 conn(0x7f3da406da40 msgr2=0x7f3da406de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:13.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.490+0000 7f3dac057640 1 -- 172.21.15.6:0/3483429197 shutdown_connections 2024-05-04T00:30:13.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.490+0000 7f3dac057640 1 -- 172.21.15.6:0/3483429197 wait complete. 2024-05-04T00:30:13.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.494+0000 7f3dac057640 1 Processor -- start 2024-05-04T00:30:13.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.494+0000 7f3dac057640 1 -- start start 2024-05-04T00:30:13.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.498+0000 7f3dac057640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d88005b20 0x7f3da41601a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:13.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.498+0000 7f3dac057640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d88008780 0x7f3da4151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:13.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.498+0000 7f3dac057640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d88008f50 0x7f3da4150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:13.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.498+0000 7f3dac057640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3da40cee90 con 0x7f3d88005b20 2024-05-04T00:30:13.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.498+0000 7f3dac057640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f3da40cd440 con 0x7f3d88008f50 2024-05-04T00:30:13.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.498+0000 7f3dac057640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f3da40b42d0 con 0x7f3d88008780 2024-05-04T00:30:13.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.522+0000 7f3da9df3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d88005b20 0x7f3da41601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:13.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.526+0000 7f3daa5f4640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d88008f50 0x7f3da4150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:13.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.530+0000 7f3da9df3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d88005b20 0x7f3da41601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46212/0 (socket says 172.21.15.6:46212) 2024-05-04T00:30:13.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.530+0000 7f3da9df3640 1 -- 172.21.15.6:0/32367792 learned_addr learned my addr 172.21.15.6:0/32367792 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:30:13.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.546+0000 7f3da95f2640 1 --2- 172.21.15.6:0/32367792 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d88008780 0x7f3da4151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.554+0000 7f3daa5f4640 1 -- 172.21.15.6:0/32367792 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d88008780 msgr2=0x7f3da4151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.554+0000 7f3daa5f4640 1 --2- 172.21.15.6:0/32367792 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d88008780 0x7f3da4151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.554+0000 7f3daa5f4640 1 -- 172.21.15.6:0/32367792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d88005b20 msgr2=0x7f3da41601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.554+0000 7f3daa5f4640 1 --2- 172.21.15.6:0/32367792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d88005b20 0x7f3da41601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.554+0000 7f3daa5f4640 1 -- 172.21.15.6:0/32367792 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da415ffb0 con 0x7f3d88008f50 2024-05-04T00:30:13.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.558+0000 7f3daa5f4640 1 --2- 172.21.15.6:0/32367792 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d88008f50 0x7f3da4150960 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009fe0 tx=0x7f3d9c009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:13.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.642+0000 7f3d967fc640 1 -- 172.21.15.6:0/32367792 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c003d50 con 0x7f3d88008f50 2024-05-04T00:30:13.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.642+0000 7f3d967fc640 1 -- 172.21.15.6:0/32367792 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d9c006070 con 0x7f3d88008f50 2024-05-04T00:30:13.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.642+0000 7f3dac057640 1 -- 172.21.15.6:0/32367792 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da41523e0 con 0x7f3d88008f50 2024-05-04T00:30:13.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.642+0000 7f3dac057640 1 -- 172.21.15.6:0/32367792 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da415fcd0 con 0x7f3d88008f50 2024-05-04T00:30:13.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.642+0000 7f3d967fc640 1 -- 172.21.15.6:0/32367792 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c006460 con 0x7f3d88008f50 2024-05-04T00:30:13.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.642+0000 7f3dac057640 1 -- 172.21.15.6:0/32367792 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d8c0052a0 con 0x7f3d88008f50 2024-05-04T00:30:13.834 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:13.834+0000 7fc8ff580180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-04T00:30:13.906 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:13.901+0000 7f0dbe6f2180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-04T00:30:13.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.950+0000 7f3d967fc640 1 -- 172.21.15.6:0/32367792 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3d9c010070 con 0x7f3d88008f50 2024-05-04T00:30:13.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.970+0000 7f3d967fc640 1 -- 172.21.15.6:0/32367792 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3d9c01cdf0 con 0x7f3d88008f50 2024-05-04T00:30:13.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:13.970+0000 7f3d967fc640 1 -- 172.21.15.6:0/32367792 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f3d9c018060 con 0x7f3d88008f50 2024-05-04T00:30:14.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:14.098+0000 7f3dac057640 1 -- 172.21.15.6:0/32367792 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f3d8c005860 con 0x7f3d88008f50 2024-05-04T00:30:14.395 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:14.389+0000 7f0dbe6f2180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-04T00:30:14.406 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:14.406+0000 7fc8ff580180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-04T00:30:14.604 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:14.601+0000 7f0dbe6f2180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-04T00:30:14.616 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:14.614+0000 7fc8ff580180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-04T00:30:15.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:15.010+0000 7f3d967fc640 1 -- 172.21.15.6:0/32367792 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f3d9c01c480 con 0x7f3d88008f50 2024-05-04T00:30:15.011 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2024-05-04T00:30:15.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:15.010+0000 7f3dac057640 1 -- 172.21.15.6:0/32367792 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d88008f50 msgr2=0x7f3da4150960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:15.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:15.010+0000 7f3dac057640 1 --2- 172.21.15.6:0/32367792 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d88008f50 0x7f3da4150960 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009fe0 tx=0x7f3d9c009510 comp rx=0 tx=0).stop 2024-05-04T00:30:15.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:15.010+0000 7f3dac057640 1 -- 172.21.15.6:0/32367792 shutdown_connections 2024-05-04T00:30:15.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:15.010+0000 7f3dac057640 1 --2- 172.21.15.6:0/32367792 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d88008f50 0x7f3da4150960 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:15.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:15.010+0000 7f3dac057640 1 --2- 172.21.15.6:0/32367792 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d88008780 0x7f3da4151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:15.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:15.010+0000 7f3dac057640 1 --2- 172.21.15.6:0/32367792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d88005b20 0x7f3da41601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:15.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:15.010+0000 7f3dac057640 1 -- 172.21.15.6:0/32367792 >> 172.21.15.6:0/32367792 conn(0x7f3da406da40 msgr2=0x7f3da40d0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:15.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:15.010+0000 7f3dac057640 1 -- 172.21.15.6:0/32367792 shutdown_connections 2024-05-04T00:30:15.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:15.010+0000 7f3dac057640 1 -- 172.21.15.6:0/32367792 wait complete. 2024-05-04T00:30:15.033 INFO:tasks.ceph:check_enable_crimson: False 2024-05-04T00:30:15.033 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-04T00:30:15.033 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:30:15.033 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-04T00:30:15.045 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:30:15.045 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-04T00:30:15.099 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:30:15.100 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-04T00:30:15.153 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:30:15.153 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-04T00:30:15.168 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:15.165+0000 7f0dbe6f2180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-04T00:30:15.205 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:30:15.205 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-04T00:30:15.217 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:30:15.217 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-04T00:30:15.245 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:15.242+0000 7fc8ff580180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-04T00:30:15.251 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:15.245+0000 7f0dbe6f2180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-04T00:30:15.261 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:30:15.261 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-04T00:30:15.302 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:15.302+0000 7fc8ff580180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-04T00:30:15.305 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:15.301+0000 7f0dbe6f2180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-04T00:30:15.313 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-04T00:30:15.313 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-04T00:30:15.358 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:15.354+0000 7fc8ff580180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-04T00:30:15.367 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new a907d753-b7cf-499c-ae36-81e44ed933a2 0 2024-05-04T00:30:15.384 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:15.381+0000 7f0dbe6f2180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-04T00:30:15.438 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:15.433+0000 7f0dbe6f2180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-04T00:30:15.438 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:15.438+0000 7fc8ff580180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-04T00:30:15.493 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:15.490+0000 7fc8ff580180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-04T00:30:15.519 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:15.513+0000 7f0dbe6f2180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-04T00:30:15.531 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.525+0000 7f0d9571f640 1 Processor -- start 2024-05-04T00:30:15.531 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.529+0000 7f0d9571f640 1 -- start start 2024-05-04T00:30:15.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.529+0000 7f0d9571f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d900b3cf0 0x7f0d9015a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:15.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.529+0000 7f0d9571f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d9015ad70 con 0x7f0d900c8550 2024-05-04T00:30:15.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.529+0000 7f0d9571f640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d900cad80 con 0x7f0d90153fe0 2024-05-04T00:30:15.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.529+0000 7f0d9571f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9015a3a0 con 0x7f0d900b3cf0 2024-05-04T00:30:15.534 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.529+0000 7f0d8e7fc640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f0d90153fe0 0x7f0d900c7260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:43934/0 (socket says 172.21.15.163:43934) 2024-05-04T00:30:15.535 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.529+0000 7f0d8e7fc640 1 -- 172.21.15.163:0/2142268464 learned_addr learned my addr 172.21.15.163:0/2142268464 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-05-04T00:30:15.539 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.533+0000 7f0d8effd640 1 --2- 172.21.15.163:0/2142268464 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d900b3cf0 0x7f0d9015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:15.543 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.537+0000 7f0d8effd640 1 -- 172.21.15.163:0/2142268464 >> v1:172.21.15.163:6789/0 conn(0x7f0d90153fe0 legacy=0x7f0d900c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:15.543 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.537+0000 7f0d8effd640 1 -- 172.21.15.163:0/2142268464 >> v1:172.21.15.6:6789/0 conn(0x7f0d900c8550 legacy=0x7f0d901647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:15.543 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.537+0000 7f0d8effd640 1 -- 172.21.15.163:0/2142268464 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d900cb060 con 0x7f0d900b3cf0 2024-05-04T00:30:15.547 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.545+0000 7f0d8effd640 1 --2- 172.21.15.163:0/2142268464 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d900b3cf0 0x7f0d9015a830 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0d800097f0 tx=0x7f0d8001ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=694ff8715d419994 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:15.554 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.549+0000 7f0d8dffb640 1 -- 172.21.15.163:0/2142268464 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d800b5070 con 0x7f0d900b3cf0 2024-05-04T00:30:15.554 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.549+0000 7f0d8dffb640 1 -- 172.21.15.163:0/2142268464 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d800a89f0 con 0x7f0d900b3cf0 2024-05-04T00:30:15.554 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.549+0000 7f0d8dffb640 1 -- 172.21.15.163:0/2142268464 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d800a8dc0 con 0x7f0d900b3cf0 2024-05-04T00:30:15.555 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.549+0000 7f0d9571f640 1 -- 172.21.15.163:0/2142268464 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d900b3cf0 msgr2=0x7f0d9015a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:15.555 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.549+0000 7f0d9571f640 1 --2- 172.21.15.163:0/2142268464 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d900b3cf0 0x7f0d9015a830 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0d800097f0 tx=0x7f0d8001ecf0 comp rx=0 tx=0).stop 2024-05-04T00:30:15.555 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.549+0000 7f0d9571f640 1 -- 172.21.15.163:0/2142268464 shutdown_connections 2024-05-04T00:30:15.555 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.549+0000 7f0d9571f640 1 --2- 172.21.15.163:0/2142268464 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d900b3cf0 0x7f0d9015a830 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:15.555 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.549+0000 7f0d9571f640 1 -- 172.21.15.163:0/2142268464 >> 172.21.15.163:0/2142268464 conn(0x7f0d9006c780 msgr2=0x7f0d9006cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:15.555 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.549+0000 7f0d9571f640 1 -- 172.21.15.163:0/2142268464 shutdown_connections 2024-05-04T00:30:15.555 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.549+0000 7f0d9571f640 1 -- 172.21.15.163:0/2142268464 wait complete. 2024-05-04T00:30:15.557 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.553+0000 7f0d9571f640 1 Processor -- start 2024-05-04T00:30:15.557 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.553+0000 7f0d9571f640 1 -- start start 2024-05-04T00:30:15.558 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.553+0000 7f0d9571f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d900b3cf0 0x7f0d90152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:15.558 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.553+0000 7f0d9571f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d900c8550 0x7f0d901f0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:15.558 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.553+0000 7f0d9571f640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d90153fe0 0x7f0d90158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:15.558 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.553+0000 7f0d9571f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0d900c7970 con 0x7f0d900c8550 2024-05-04T00:30:15.558 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.553+0000 7f0d9571f640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9015a030 con 0x7f0d90153fe0 2024-05-04T00:30:15.559 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.553+0000 7f0d9571f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f0d900c7af0 con 0x7f0d900b3cf0 2024-05-04T00:30:15.559 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.553+0000 7f0d8effd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d900b3cf0 0x7f0d90152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:15.559 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.553+0000 7f0d8f7fe640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d90153fe0 0x7f0d90158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:15.559 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.553+0000 7f0d8effd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d900b3cf0 0x7f0d90152850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:36596/0 (socket says 172.21.15.163:36596) 2024-05-04T00:30:15.559 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.553+0000 7f0d8effd640 1 -- 172.21.15.163:0/2576520626 learned_addr learned my addr 172.21.15.163:0/2576520626 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-04T00:30:15.563 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.561+0000 7f0d8effd640 1 -- 172.21.15.163:0/2576520626 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d90153fe0 msgr2=0x7f0d90158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:15.563 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.561+0000 7f0d8effd640 1 --2- 172.21.15.163:0/2576520626 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d90153fe0 0x7f0d90158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:15.563 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.561+0000 7f0d8effd640 1 -- 172.21.15.163:0/2576520626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d900c8550 msgr2=0x7f0d901f0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:15.563 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.561+0000 7f0d8effd640 1 --2- 172.21.15.163:0/2576520626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d900c8550 0x7f0d901f0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:15.563 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.561+0000 7f0d8effd640 1 -- 172.21.15.163:0/2576520626 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d901f14d0 con 0x7f0d900b3cf0 2024-05-04T00:30:15.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.561+0000 7f0d8effd640 1 --2- 172.21.15.163:0/2576520626 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d900b3cf0 0x7f0d90152850 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0d8001b900 tx=0x7f0d8001ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:15.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.565+0000 7f0d777fe640 1 -- 172.21.15.163:0/2576520626 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d800b5040 con 0x7f0d900b3cf0 2024-05-04T00:30:15.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.565+0000 7f0d777fe640 1 -- 172.21.15.163:0/2576520626 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d800bf070 con 0x7f0d900b3cf0 2024-05-04T00:30:15.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.565+0000 7f0d777fe640 1 -- 172.21.15.163:0/2576520626 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d800b0c30 con 0x7f0d900b3cf0 2024-05-04T00:30:15.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.569+0000 7f0d9571f640 1 -- 172.21.15.163:0/2576520626 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d90152400 con 0x7f0d900b3cf0 2024-05-04T00:30:15.572 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.569+0000 7f0d9571f640 1 -- 172.21.15.163:0/2576520626 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d901f0a70 con 0x7f0d900b3cf0 2024-05-04T00:30:15.572 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.569+0000 7f0d9571f640 1 -- 172.21.15.163:0/2576520626 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d90069a50 con 0x7f0d900b3cf0 2024-05-04T00:30:15.579 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:15.573+0000 7f0dbe6f2180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-04T00:30:15.587 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:15.586+0000 7fc8ff580180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-04T00:30:15.644 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:15.642+0000 7fc8ff580180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-04T00:30:15.734 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:15.729+0000 7f0dbe6f2180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-04T00:30:15.797 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:15.793+0000 7f0dbe6f2180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-04T00:30:15.805 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:15.802+0000 7fc8ff580180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-04T00:30:15.869 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:15.866+0000 7fc8ff580180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-04T00:30:15.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.885+0000 7f0d777fe640 1 -- 172.21.15.163:0/2576520626 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0d800c4460 con 0x7f0d900b3cf0 2024-05-04T00:30:15.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.885+0000 7f0d777fe640 1 -- 172.21.15.163:0/2576520626 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f0d800b0dd0 con 0x7f0d900b3cf0 2024-05-04T00:30:15.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.885+0000 7f0d777fe640 1 -- 172.21.15.163:0/2576520626 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f0d80018850 con 0x7f0d900b3cf0 2024-05-04T00:30:15.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:15.993+0000 7f0d9571f640 1 -- 172.21.15.163:0/2576520626 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a907d753-b7cf-499c-ae36-81e44ed933a2", "id": 0} v 0) -- 0x7f0d9006c110 con 0x7f0d900b3cf0 2024-05-04T00:30:16.306 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.301+0000 7f0d777fe640 1 -- 172.21.15.163:0/2576520626 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a907d753-b7cf-499c-ae36-81e44ed933a2", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f0d800c48c0 con 0x7f0d900b3cf0 2024-05-04T00:30:16.306 INFO:teuthology.orchestra.run.smithi163.stdout:0 2024-05-04T00:30:16.307 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.301+0000 7f0d9571f640 1 -- 172.21.15.163:0/2576520626 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d900b3cf0 msgr2=0x7f0d90152850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:16.307 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.301+0000 7f0d9571f640 1 --2- 172.21.15.163:0/2576520626 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d900b3cf0 0x7f0d90152850 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0d8001b900 tx=0x7f0d8001ba90 comp rx=0 tx=0).stop 2024-05-04T00:30:16.308 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.305+0000 7f0d9571f640 1 -- 172.21.15.163:0/2576520626 shutdown_connections 2024-05-04T00:30:16.308 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.305+0000 7f0d9571f640 1 --2- 172.21.15.163:0/2576520626 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d90153fe0 0x7f0d90158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:16.308 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.305+0000 7f0d9571f640 1 --2- 172.21.15.163:0/2576520626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d900c8550 0x7f0d901f0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:16.308 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.305+0000 7f0d9571f640 1 --2- 172.21.15.163:0/2576520626 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d900b3cf0 0x7f0d90152850 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:16.308 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.305+0000 7f0d9571f640 1 -- 172.21.15.163:0/2576520626 >> 172.21.15.163:0/2576520626 conn(0x7f0d9006c780 msgr2=0x7f0d90075cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:16.308 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.305+0000 7f0d9571f640 1 -- 172.21.15.163:0/2576520626 shutdown_connections 2024-05-04T00:30:16.308 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.305+0000 7f0d9571f640 1 -- 172.21.15.163:0/2576520626 wait complete. 2024-05-04T00:30:16.326 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new eab41a32-d5f1-43b8-8835-f2d4bffc9cdb 1 2024-05-04T00:30:16.460 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.457+0000 7f4a20d0b640 1 Processor -- start 2024-05-04T00:30:16.460 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.457+0000 7f4a20d0b640 1 -- start start 2024-05-04T00:30:16.462 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.457+0000 7f4a20d0b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4a1c13eff0 0x7f4a1c0c4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:16.462 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.457+0000 7f4a20d0b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a1c15a7a0 con 0x7f4a1c15e030 2024-05-04T00:30:16.462 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.457+0000 7f4a20d0b640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a1c15aa80 con 0x7f4a1c0c7970 2024-05-04T00:30:16.462 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.457+0000 7f4a20d0b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f4a1c15e440 con 0x7f4a1c13eff0 2024-05-04T00:30:16.463 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.457+0000 7f4a1a59c640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f4a1c0c7970 0x7f4a1c159f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:43940/0 (socket says 172.21.15.163:43940) 2024-05-04T00:30:16.463 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.457+0000 7f4a1a59c640 1 -- 172.21.15.163:0/2667912452 learned_addr learned my addr 172.21.15.163:0/2667912452 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-05-04T00:30:16.465 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.461+0000 7f4a1959a640 1 -- 172.21.15.163:0/2667912452 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2871783056 0 0) 0x7f4a1c15aa80 con 0x7f4a1c0c7970 2024-05-04T00:30:16.465 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.461+0000 7f4a1959a640 1 -- 172.21.15.163:0/2667912452 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a08003530 con 0x7f4a1c0c7970 2024-05-04T00:30:16.470 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.465+0000 7f4a1959a640 1 -- 172.21.15.163:0/2667912452 <== mon.1 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1930993366 0 0) 0x7f4a08003530 con 0x7f4a1c0c7970 2024-05-04T00:30:16.470 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.465+0000 7f4a1959a640 1 -- 172.21.15.163:0/2667912452 >> v2:172.21.15.6:3300/0 conn(0x7f4a1c13eff0 msgr2=0x7f4a1c0c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:30:16.471 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.465+0000 7f4a1959a640 1 --2- 172.21.15.163:0/2667912452 >> v2:172.21.15.6:3300/0 conn(0x7f4a1c13eff0 0x7f4a1c0c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:16.471 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.465+0000 7f4a1959a640 1 -- 172.21.15.163:0/2667912452 >> v1:172.21.15.6:6789/0 conn(0x7f4a1c15e030 legacy=0x7f4a1c0ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:30:16.471 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.465+0000 7f4a1959a640 1 -- 172.21.15.163:0/2667912452 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1c15ad60 con 0x7f4a1c0c7970 2024-05-04T00:30:16.471 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.465+0000 7f4a1959a640 1 -- 172.21.15.163:0/2667912452 <== mon.1 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 557976392 0 0) 0x7f4a0c001700 con 0x7f4a1c0c7970 2024-05-04T00:30:16.471 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.465+0000 7f4a1959a640 1 -- 172.21.15.163:0/2667912452 >> v1:172.21.15.163:6789/0 conn(0x7f4a1c0c7970 legacy=0x7f4a1c159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:16.471 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.465+0000 7f4a1959a640 1 --2- 172.21.15.163:0/2667912452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a08003a60 0x7f4a08003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:16.472 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.465+0000 7f4a1959a640 1 --2- 172.21.15.163:0/2667912452 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a08004810 0x7f4a08004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:16.472 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.465+0000 7f4a1959a640 1 --2- 172.21.15.163:0/2667912452 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a08005400 0x7f4a0800bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:16.472 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.465+0000 7f4a1959a640 1 -- 172.21.15.163:0/2667912452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c15e440 con 0x7f4a08003a60 2024-05-04T00:30:16.472 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.465+0000 7f4a1959a640 1 -- 172.21.15.163:0/2667912452 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0800c3a0 con 0x7f4a08004810 2024-05-04T00:30:16.472 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.465+0000 7f4a1959a640 1 -- 172.21.15.163:0/2667912452 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f4a0800c5a0 con 0x7f4a08005400 2024-05-04T00:30:16.472 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.465+0000 7f4a1ad9d640 1 --2- 172.21.15.163:0/2667912452 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a08005400 0x7f4a0800bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:16.474 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.469+0000 7f4a19d9b640 1 --2- 172.21.15.163:0/2667912452 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a08004810 0x7f4a08004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:16.477 INFO:tasks.ceph.mgr.x.smithi163.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-04T00:30:16.478 INFO:tasks.ceph.mgr.x.smithi163.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-04T00:30:16.478 INFO:tasks.ceph.mgr.x.smithi163.stderr: from numpy import show_config as show_numpy_config 2024-05-04T00:30:16.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.477+0000 7f4a1ad9d640 1 -- 172.21.15.163:0/2667912452 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a08004810 msgr2=0x7f4a08004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:30:16.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.477+0000 7f4a1ad9d640 1 --2- 172.21.15.163:0/2667912452 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a08004810 0x7f4a08004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:16.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.477+0000 7f4a1ad9d640 1 -- 172.21.15.163:0/2667912452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a08003a60 msgr2=0x7f4a08003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:30:16.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.477+0000 7f4a1ad9d640 1 --2- 172.21.15.163:0/2667912452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a08003a60 0x7f4a08003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:16.483 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.477+0000 7f4a1ad9d640 1 -- 172.21.15.163:0/2667912452 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a08003530 con 0x7f4a08005400 2024-05-04T00:30:16.483 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-04T00:30:16.483 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-04T00:30:16.483 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2024-05-04T00:30:16.484 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.481+0000 7f4a1ad9d640 1 -- 172.21.15.163:0/2667912452 reap_dead start 2024-05-04T00:30:16.485 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.481+0000 7f4a1ad9d640 1 --2- 172.21.15.163:0/2667912452 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a08005400 0x7f4a0800bac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c157ac0 tx=0x7f4a1401cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cbf3db8ebdf4aae server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:16.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.485+0000 7f4a1959a640 1 -- 172.21.15.163:0/2667912452 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a14006e60 con 0x7f4a08005400 2024-05-04T00:30:16.491 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.485+0000 7f4a1959a640 1 -- 172.21.15.163:0/2667912452 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a14003b80 con 0x7f4a08005400 2024-05-04T00:30:16.491 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.485+0000 7f4a1959a640 1 -- 172.21.15.163:0/2667912452 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a140a5800 con 0x7f4a08005400 2024-05-04T00:30:16.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.485+0000 7f4a20d0b640 1 -- 172.21.15.163:0/2667912452 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a08005400 msgr2=0x7f4a0800bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:16.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.485+0000 7f4a20d0b640 1 --2- 172.21.15.163:0/2667912452 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a08005400 0x7f4a0800bac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c157ac0 tx=0x7f4a1401cc10 comp rx=0 tx=0).stop 2024-05-04T00:30:16.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.485+0000 7f4a20d0b640 1 -- 172.21.15.163:0/2667912452 shutdown_connections 2024-05-04T00:30:16.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.485+0000 7f4a20d0b640 1 --2- 172.21.15.163:0/2667912452 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a08005400 0x7f4a0800bac0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:16.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.485+0000 7f4a20d0b640 1 -- 172.21.15.163:0/2667912452 >> 172.21.15.163:0/2667912452 conn(0x7f4a1c06cb80 msgr2=0x7f4a1c06cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:16.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.485+0000 7f4a20d0b640 1 -- 172.21.15.163:0/2667912452 shutdown_connections 2024-05-04T00:30:16.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.485+0000 7f4a20d0b640 1 -- 172.21.15.163:0/2667912452 wait complete. 2024-05-04T00:30:16.493 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.489+0000 7f4a20d0b640 1 Processor -- start 2024-05-04T00:30:16.493 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.489+0000 7f4a20d0b640 1 -- start start 2024-05-04T00:30:16.494 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.489+0000 7f4a20d0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a1c135e70 0x7f4a1c136280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:16.494 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.489+0000 7f4a20d0b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a1c14f700 0x7f4a1c14fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:16.494 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.489+0000 7f4a20d0b640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a1c1597d0 0x7f4a1c159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:16.495 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.489+0000 7f4a20d0b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c0c9180 con 0x7f4a1c135e70 2024-05-04T00:30:16.495 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.489+0000 7f4a20d0b640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c0c9000 con 0x7f4a1c1597d0 2024-05-04T00:30:16.495 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.489+0000 7f4a20d0b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f4a1c0c4020 con 0x7f4a1c14f700 2024-05-04T00:30:16.495 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.489+0000 7f4a19d9b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a1c14f700 0x7f4a1c14fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:16.495 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.489+0000 7f4a1ad9d640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a1c1597d0 0x7f4a1c159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:16.495 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.489+0000 7f4a19d9b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a1c14f700 0x7f4a1c14fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:36606/0 (socket says 172.21.15.163:36606) 2024-05-04T00:30:16.496 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.489+0000 7f4a19d9b640 1 -- 172.21.15.163:0/3467724712 learned_addr learned my addr 172.21.15.163:0/3467724712 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-04T00:30:16.499 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.493+0000 7f4a19d9b640 1 -- 172.21.15.163:0/3467724712 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a1c1597d0 msgr2=0x7f4a1c159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:16.499 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.493+0000 7f4a19d9b640 1 --2- 172.21.15.163:0/3467724712 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a1c1597d0 0x7f4a1c159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:16.499 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.493+0000 7f4a19d9b640 1 -- 172.21.15.163:0/3467724712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a1c135e70 msgr2=0x7f4a1c136280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:16.499 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.493+0000 7f4a19d9b640 1 --2- 172.21.15.163:0/3467724712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a1c135e70 0x7f4a1c136280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:16.499 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.493+0000 7f4a19d9b640 1 -- 172.21.15.163:0/3467724712 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1c1586f0 con 0x7f4a1c14f700 2024-05-04T00:30:16.501 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.497+0000 7f4a19d9b640 1 --2- 172.21.15.163:0/3467724712 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a1c14f700 0x7f4a1c14fb10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400f520 tx=0x7f4a0400f9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:16.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.505+0000 7f4a12ffd640 1 -- 172.21.15.163:0/3467724712 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0401a070 con 0x7f4a1c14f700 2024-05-04T00:30:16.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.505+0000 7f4a12ffd640 1 -- 172.21.15.163:0/3467724712 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a04005320 con 0x7f4a1c14f700 2024-05-04T00:30:16.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.505+0000 7f4a20d0b640 1 -- 172.21.15.163:0/3467724712 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1c1589d0 con 0x7f4a1c14f700 2024-05-04T00:30:16.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.505+0000 7f4a12ffd640 1 -- 172.21.15.163:0/3467724712 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04007270 con 0x7f4a1c14f700 2024-05-04T00:30:16.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.505+0000 7f4a20d0b640 1 -- 172.21.15.163:0/3467724712 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a1c1f3c90 con 0x7f4a1c14f700 2024-05-04T00:30:16.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.505+0000 7f4a20d0b640 1 -- 172.21.15.163:0/3467724712 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a1c069a50 con 0x7f4a1c14f700 2024-05-04T00:30:16.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.505+0000 7f4a12ffd640 1 -- 172.21.15.163:0/3467724712 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4a0401d070 con 0x7f4a1c14f700 2024-05-04T00:30:16.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.505+0000 7f4a12ffd640 1 -- 172.21.15.163:0/3467724712 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f4a040039f0 con 0x7f4a1c14f700 2024-05-04T00:30:16.525 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:16.521+0000 7f0dbe6f2180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-04T00:30:16.554 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:16.554+0000 7fc8ff580180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-04T00:30:16.620 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.613+0000 7f4a12ffd640 1 -- 172.21.15.163:0/3467724712 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f4a04024070 con 0x7f4a1c14f700 2024-05-04T00:30:16.677 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:16.673+0000 7f0dbe6f2180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-04T00:30:16.716 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.713+0000 7f4a20d0b640 1 -- 172.21.15.163:0/3467724712 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "eab41a32-d5f1-43b8-8835-f2d4bffc9cdb", "id": 1} v 0) -- 0x7f4a1c1666e0 con 0x7f4a1c14f700 2024-05-04T00:30:16.755 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:16.754+0000 7fc8ff580180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-04T00:30:16.865 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:16.861+0000 7f0dbe6f2180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-04T00:30:16.920 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:16.918+0000 7fc8ff580180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-04T00:30:16.955 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.949+0000 7f4a12ffd640 1 -- 172.21.15.163:0/3467724712 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eab41a32-d5f1-43b8-8835-f2d4bffc9cdb", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f4a04003d20 con 0x7f4a1c14f700 2024-05-04T00:30:16.955 INFO:teuthology.orchestra.run.smithi163.stdout:1 2024-05-04T00:30:16.957 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.953+0000 7f4a20d0b640 1 -- 172.21.15.163:0/3467724712 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a1c14f700 msgr2=0x7f4a1c14fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:16.957 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.953+0000 7f4a20d0b640 1 --2- 172.21.15.163:0/3467724712 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a1c14f700 0x7f4a1c14fb10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400f520 tx=0x7f4a0400f9e0 comp rx=0 tx=0).stop 2024-05-04T00:30:16.957 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.953+0000 7f4a20d0b640 1 -- 172.21.15.163:0/3467724712 shutdown_connections 2024-05-04T00:30:16.957 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.953+0000 7f4a20d0b640 1 --2- 172.21.15.163:0/3467724712 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a1c1597d0 0x7f4a1c159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:16.957 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.953+0000 7f4a20d0b640 1 --2- 172.21.15.163:0/3467724712 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a1c14f700 0x7f4a1c14fb10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:16.957 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.953+0000 7f4a20d0b640 1 --2- 172.21.15.163:0/3467724712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a1c135e70 0x7f4a1c136280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:16.957 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.953+0000 7f4a20d0b640 1 -- 172.21.15.163:0/3467724712 >> 172.21.15.163:0/3467724712 conn(0x7f4a1c06cb80 msgr2=0x7f4a1c15b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:16.957 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.953+0000 7f4a20d0b640 1 -- 172.21.15.163:0/3467724712 shutdown_connections 2024-05-04T00:30:16.957 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:16.953+0000 7f4a20d0b640 1 -- 172.21.15.163:0/3467724712 wait complete. 2024-05-04T00:30:16.959 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:16.957+0000 7f0dbe6f2180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-04T00:30:16.978 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new f2540144-b533-4ffc-a9cf-24f0e4910a9d 2 2024-05-04T00:30:16.994 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:16.994+0000 7fc8ff580180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-04T00:30:17.103 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:17.097+0000 7f0dbe6f2180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-04T00:30:17.126 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.121+0000 7fee6e422640 1 Processor -- start 2024-05-04T00:30:17.126 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.121+0000 7fee6e422640 1 -- start start 2024-05-04T00:30:17.128 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.121+0000 7fee6e422640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee680c8480 0x7fee681647d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:17.128 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.121+0000 7fee6e422640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee68074bc0 con 0x7fee68152ed0 2024-05-04T00:30:17.128 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.125+0000 7fee6e422640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee680c5b60 con 0x7fee681532e0 2024-05-04T00:30:17.128 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.125+0000 7fee6e422640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fee680c5910 con 0x7fee680c8480 2024-05-04T00:30:17.129 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.125+0000 7fee6c9bf640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee680c8480 0x7fee681647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:17.129 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.125+0000 7fee677fe640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fee681532e0 0x7fee680c7d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:43948/0 (socket says 172.21.15.163:43948) 2024-05-04T00:30:17.129 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.125+0000 7fee677fe640 1 -- 172.21.15.163:0/1769561573 learned_addr learned my addr 172.21.15.163:0/1769561573 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-05-04T00:30:17.131 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.125+0000 7fee6c9bf640 1 -- 172.21.15.163:0/1769561573 >> v1:172.21.15.163:6789/0 conn(0x7fee681532e0 legacy=0x7fee680c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:17.131 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.125+0000 7fee6c9bf640 1 -- 172.21.15.163:0/1769561573 >> v1:172.21.15.6:6789/0 conn(0x7fee68152ed0 legacy=0x7fee68073780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:17.132 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.125+0000 7fee6c9bf640 1 -- 172.21.15.163:0/1769561573 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee680c5e40 con 0x7fee680c8480 2024-05-04T00:30:17.134 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.129+0000 7fee6c9bf640 1 --2- 172.21.15.163:0/1769561573 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee680c8480 0x7fee681647d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee60009dc0 tx=0x7fee6001eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bc8f3b27ccb794f server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:17.141 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.137+0000 7fee66ffd640 1 -- 172.21.15.163:0/1769561573 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee600b4070 con 0x7fee680c8480 2024-05-04T00:30:17.141 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.137+0000 7fee66ffd640 1 -- 172.21.15.163:0/1769561573 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee600a7970 con 0x7fee680c8480 2024-05-04T00:30:17.141 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.137+0000 7fee66ffd640 1 -- 172.21.15.163:0/1769561573 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee600a7d40 con 0x7fee680c8480 2024-05-04T00:30:17.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.137+0000 7fee6e422640 1 -- 172.21.15.163:0/1769561573 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee680c8480 msgr2=0x7fee681647d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:17.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.137+0000 7fee6e422640 1 --2- 172.21.15.163:0/1769561573 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee680c8480 0x7fee681647d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee60009dc0 tx=0x7fee6001eba0 comp rx=0 tx=0).stop 2024-05-04T00:30:17.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.137+0000 7fee6e422640 1 -- 172.21.15.163:0/1769561573 shutdown_connections 2024-05-04T00:30:17.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.137+0000 7fee6e422640 1 --2- 172.21.15.163:0/1769561573 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee680c8480 0x7fee681647d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:17.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.137+0000 7fee6e422640 1 -- 172.21.15.163:0/1769561573 >> 172.21.15.163:0/1769561573 conn(0x7fee680ce410 msgr2=0x7fee680ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:17.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.137+0000 7fee6e422640 1 -- 172.21.15.163:0/1769561573 shutdown_connections 2024-05-04T00:30:17.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.137+0000 7fee6e422640 1 -- 172.21.15.163:0/1769561573 wait complete. 2024-05-04T00:30:17.144 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.141+0000 7fee6e422640 1 Processor -- start 2024-05-04T00:30:17.144 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.141+0000 7fee6e422640 1 -- start start 2024-05-04T00:30:17.146 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.141+0000 7fee6e422640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680c8480 0x7fee6815aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:17.146 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.141+0000 7fee6e422640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee68152ed0 0x7fee6814e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:17.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.141+0000 7fee6e422640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee681532e0 0x7fee68150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:17.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.141+0000 7fee6e422640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fee68073e90 con 0x7fee680c8480 2024-05-04T00:30:17.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.141+0000 7fee6e422640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fee680c6490 con 0x7fee681532e0 2024-05-04T00:30:17.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.141+0000 7fee6e422640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fee68074010 con 0x7fee68152ed0 2024-05-04T00:30:17.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.141+0000 7fee677fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee68152ed0 0x7fee6814e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:17.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.141+0000 7fee6c9bf640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee681532e0 0x7fee68150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:17.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.141+0000 7fee677fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee68152ed0 0x7fee6814e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:36626/0 (socket says 172.21.15.163:36626) 2024-05-04T00:30:17.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.141+0000 7fee677fe640 1 -- 172.21.15.163:0/3030234185 learned_addr learned my addr 172.21.15.163:0/3030234185 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-04T00:30:17.148 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:17.146+0000 7fc8ff580180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-04T00:30:17.148 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.141+0000 7fee67fff640 1 --2- 172.21.15.163:0/3030234185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680c8480 0x7fee6815aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:17.152 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.149+0000 7fee677fe640 1 -- 172.21.15.163:0/3030234185 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee681532e0 msgr2=0x7fee68150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:17.152 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.149+0000 7fee677fe640 1 --2- 172.21.15.163:0/3030234185 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee681532e0 0x7fee68150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:17.152 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.149+0000 7fee677fe640 1 -- 172.21.15.163:0/3030234185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680c8480 msgr2=0x7fee6815aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:17.152 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.149+0000 7fee677fe640 1 --2- 172.21.15.163:0/3030234185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680c8480 0x7fee6815aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:17.152 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.149+0000 7fee677fe640 1 -- 172.21.15.163:0/3030234185 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee681f1920 con 0x7fee68152ed0 2024-05-04T00:30:17.154 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.149+0000 7fee677fe640 1 --2- 172.21.15.163:0/3030234185 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee68152ed0 0x7fee6814e0e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fee5800c460 tx=0x7fee5800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:17.160 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.157+0000 7fee64ff9640 1 -- 172.21.15.163:0/3030234185 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58017070 con 0x7fee68152ed0 2024-05-04T00:30:17.160 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.157+0000 7fee64ff9640 1 -- 172.21.15.163:0/3030234185 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee58005d10 con 0x7fee68152ed0 2024-05-04T00:30:17.161 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.157+0000 7fee6e422640 1 -- 172.21.15.163:0/3030234185 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6815b010 con 0x7fee68152ed0 2024-05-04T00:30:17.161 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.157+0000 7fee64ff9640 1 -- 172.21.15.163:0/3030234185 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee580072b0 con 0x7fee68152ed0 2024-05-04T00:30:17.161 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.157+0000 7fee6e422640 1 -- 172.21.15.163:0/3030234185 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fee6815a5c0 con 0x7fee68152ed0 2024-05-04T00:30:17.161 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.157+0000 7fee6e422640 1 -- 172.21.15.163:0/3030234185 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee68152600 con 0x7fee68152ed0 2024-05-04T00:30:17.162 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.157+0000 7fee64ff9640 1 -- 172.21.15.163:0/3030234185 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fee5801a070 con 0x7fee68152ed0 2024-05-04T00:30:17.275 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.269+0000 7fee64ff9640 1 -- 172.21.15.163:0/3030234185 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fee5801c440 con 0x7fee68152ed0 2024-05-04T00:30:17.275 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.273+0000 7fee64ff9640 1 -- 172.21.15.163:0/3030234185 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fee58021080 con 0x7fee68152ed0 2024-05-04T00:30:17.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.349+0000 7fee6e422640 1 -- 172.21.15.163:0/3030234185 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f2540144-b533-4ffc-a9cf-24f0e4910a9d", "id": 2} v 0) -- 0x7fee68073a00 con 0x7fee68152ed0 2024-05-04T00:30:17.601 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.597+0000 7fee64ff9640 1 -- 172.21.15.163:0/3030234185 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f2540144-b533-4ffc-a9cf-24f0e4910a9d", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fee58007450 con 0x7fee68152ed0 2024-05-04T00:30:17.601 INFO:teuthology.orchestra.run.smithi163.stdout:2 2024-05-04T00:30:17.602 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.597+0000 7fee6e422640 1 -- 172.21.15.163:0/3030234185 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee68152ed0 msgr2=0x7fee6814e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:17.602 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.597+0000 7fee6e422640 1 --2- 172.21.15.163:0/3030234185 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee68152ed0 0x7fee6814e0e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fee5800c460 tx=0x7fee5800c920 comp rx=0 tx=0).stop 2024-05-04T00:30:17.602 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.597+0000 7fee6e422640 1 -- 172.21.15.163:0/3030234185 shutdown_connections 2024-05-04T00:30:17.602 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.597+0000 7fee6e422640 1 --2- 172.21.15.163:0/3030234185 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee681532e0 0x7fee68150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:17.602 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.597+0000 7fee6e422640 1 --2- 172.21.15.163:0/3030234185 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee68152ed0 0x7fee6814e0e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:17.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.597+0000 7fee6e422640 1 --2- 172.21.15.163:0/3030234185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680c8480 0x7fee6815aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:17.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.597+0000 7fee6e422640 1 -- 172.21.15.163:0/3030234185 >> 172.21.15.163:0/3030234185 conn(0x7fee680ce410 msgr2=0x7fee68157610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:17.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.597+0000 7fee6e422640 1 -- 172.21.15.163:0/3030234185 shutdown_connections 2024-05-04T00:30:17.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.597+0000 7fee6e422640 1 -- 172.21.15.163:0/3030234185 wait complete. 2024-05-04T00:30:17.625 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 982b7ace-fd02-4f03-aef2-0428468f8379 3 2024-05-04T00:30:17.755 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:17.753+0000 7f0dbe6f2180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-04T00:30:17.769 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.765+0000 7fa071515640 1 Processor -- start 2024-05-04T00:30:17.769 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.765+0000 7fa071515640 1 -- start start 2024-05-04T00:30:17.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.765+0000 7fa071515640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa06c06dc90 0x7fa06c154110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:17.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.765+0000 7fa071515640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa06c15aa30 0x7fa06c0c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:17.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.765+0000 7fa071515640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa06c074d00 con 0x7fa06c0c7b20 2024-05-04T00:30:17.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.765+0000 7fa071515640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa06c0c9ac0 con 0x7fa06c06dc90 2024-05-04T00:30:17.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.765+0000 7fa071515640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa06c0c8eb0 con 0x7fa06c15aa30 2024-05-04T00:30:17.784 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.781+0000 7fa06a7fc640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fa06c0c7b20 0x7fa06c15a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:43952/0 (socket says 172.21.15.163:43952) 2024-05-04T00:30:17.784 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.781+0000 7fa06a7fc640 1 -- 172.21.15.163:0/2765142919 learned_addr learned my addr 172.21.15.163:0/2765142919 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-05-04T00:30:17.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.785+0000 7fa06b7fe640 1 --2- 172.21.15.163:0/2765142919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa06c15aa30 0x7fa06c0c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:17.797 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.793+0000 7fa06b7fe640 1 -- 172.21.15.163:0/2765142919 >> v2:172.21.15.6:3300/0 conn(0x7fa06c06dc90 msgr2=0x7fa06c154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:30:17.797 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.793+0000 7fa06b7fe640 1 --2- 172.21.15.163:0/2765142919 >> v2:172.21.15.6:3300/0 conn(0x7fa06c06dc90 0x7fa06c154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:17.797 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.793+0000 7fa06b7fe640 1 -- 172.21.15.163:0/2765142919 >> v1:172.21.15.163:6789/0 conn(0x7fa06c0c7b20 legacy=0x7fa06c15a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:17.797 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.793+0000 7fa06b7fe640 1 -- 172.21.15.163:0/2765142919 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06c0c9190 con 0x7fa06c15aa30 2024-05-04T00:30:17.803 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.797+0000 7fa06b7fe640 1 --2- 172.21.15.163:0/2765142919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa06c15aa30 0x7fa06c0c7f30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa064009d90 tx=0x7fa06401f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c989249f6f7df07 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:17.803 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:17.802+0000 7fc8ff580180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-04T00:30:17.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.805+0000 7fa069ffb640 1 -- 172.21.15.163:0/2765142919 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0640b4070 con 0x7fa06c15aa30 2024-05-04T00:30:17.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.805+0000 7fa069ffb640 1 -- 172.21.15.163:0/2765142919 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0640af600 con 0x7fa06c15aa30 2024-05-04T00:30:17.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.805+0000 7fa069ffb640 1 -- 172.21.15.163:0/2765142919 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0640af9d0 con 0x7fa06c15aa30 2024-05-04T00:30:17.810 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.805+0000 7fa071515640 1 -- 172.21.15.163:0/2765142919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa06c15aa30 msgr2=0x7fa06c0c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:17.810 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.805+0000 7fa071515640 1 --2- 172.21.15.163:0/2765142919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa06c15aa30 0x7fa06c0c7f30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa064009d90 tx=0x7fa06401f150 comp rx=0 tx=0).stop 2024-05-04T00:30:17.810 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.805+0000 7fa071515640 1 -- 172.21.15.163:0/2765142919 shutdown_connections 2024-05-04T00:30:17.810 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.805+0000 7fa071515640 1 --2- 172.21.15.163:0/2765142919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa06c15aa30 0x7fa06c0c7f30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:17.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.805+0000 7fa071515640 1 --2- 172.21.15.163:0/2765142919 >> v2:172.21.15.6:3300/0 conn(0x7fa06c06dc90 0x7fa06c154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:17.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.805+0000 7fa071515640 1 -- 172.21.15.163:0/2765142919 >> 172.21.15.163:0/2765142919 conn(0x7fa06c0ce410 msgr2=0x7fa06c0ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:17.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.805+0000 7fa071515640 1 -- 172.21.15.163:0/2765142919 shutdown_connections 2024-05-04T00:30:17.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.805+0000 7fa071515640 1 -- 172.21.15.163:0/2765142919 wait complete. 2024-05-04T00:30:17.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.809+0000 7fa071515640 1 Processor -- start 2024-05-04T00:30:17.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.809+0000 7fa071515640 1 -- start start 2024-05-04T00:30:17.815 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.809+0000 7fa071515640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa06c06dc90 0x7fa06c154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:17.815 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.809+0000 7fa071515640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa06c0c7b20 0x7fa06c0cd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:17.816 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.809+0000 7fa071515640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa06c15aa30 0x7fa06c1f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:17.816 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.809+0000 7fa071515640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c154650 con 0x7fa06c15aa30 2024-05-04T00:30:17.816 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.809+0000 7fa071515640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c0c9750 con 0x7fa06c0c7b20 2024-05-04T00:30:17.816 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.809+0000 7fa071515640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa06c06c810 con 0x7fa06c06dc90 2024-05-04T00:30:17.816 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.809+0000 7fa06affd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa06c06dc90 0x7fa06c154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:17.816 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.809+0000 7fa06a7fc640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa06c0c7b20 0x7fa06c0cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:17.817 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.809+0000 7fa06affd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa06c06dc90 0x7fa06c154920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:36650/0 (socket says 172.21.15.163:36650) 2024-05-04T00:30:17.817 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.809+0000 7fa06affd640 1 -- 172.21.15.163:0/2585330603 learned_addr learned my addr 172.21.15.163:0/2585330603 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-04T00:30:17.817 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.813+0000 7fa06b7fe640 1 --2- 172.21.15.163:0/2585330603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa06c15aa30 0x7fa06c1f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:17.819 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.813+0000 7fa06affd640 1 -- 172.21.15.163:0/2585330603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa06c0c7b20 msgr2=0x7fa06c0cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:17.819 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.813+0000 7fa06affd640 1 --2- 172.21.15.163:0/2585330603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa06c0c7b20 0x7fa06c0cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:17.819 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.813+0000 7fa06affd640 1 -- 172.21.15.163:0/2585330603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa06c15aa30 msgr2=0x7fa06c1f3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:17.820 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.813+0000 7fa06affd640 1 --2- 172.21.15.163:0/2585330603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa06c15aa30 0x7fa06c1f3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:17.820 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.813+0000 7fa06affd640 1 -- 172.21.15.163:0/2585330603 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06c153000 con 0x7fa06c06dc90 2024-05-04T00:30:17.821 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.817+0000 7fa06affd640 1 --2- 172.21.15.163:0/2585330603 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa06c06dc90 0x7fa06c154920 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00b440 tx=0x7fa05c00b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:17.827 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.821+0000 7fa0537fe640 1 -- 172.21.15.163:0/2585330603 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c015020 con 0x7fa06c06dc90 2024-05-04T00:30:17.827 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.821+0000 7fa0537fe640 1 -- 172.21.15.163:0/2585330603 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05c0118b0 con 0x7fa06c06dc90 2024-05-04T00:30:17.827 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.821+0000 7fa0537fe640 1 -- 172.21.15.163:0/2585330603 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c011ca0 con 0x7fa06c06dc90 2024-05-04T00:30:17.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.821+0000 7fa071515640 1 -- 172.21.15.163:0/2585330603 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa06c1532c0 con 0x7fa06c06dc90 2024-05-04T00:30:17.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.821+0000 7fa071515640 1 -- 172.21.15.163:0/2585330603 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa06c1516c0 con 0x7fa06c06dc90 2024-05-04T00:30:17.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.825+0000 7fa071515640 1 -- 172.21.15.163:0/2585330603 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa06c1511d0 con 0x7fa06c06dc90 2024-05-04T00:30:17.841 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:17.837+0000 7f0dbe6f2180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-04T00:30:17.883 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:17.882+0000 7fc8ff580180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-04T00:30:17.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.961+0000 7fa0537fe640 1 -- 172.21.15.163:0/2585330603 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa05c018020 con 0x7fa06c06dc90 2024-05-04T00:30:17.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.961+0000 7fa0537fe640 1 -- 172.21.15.163:0/2585330603 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fa05c01ac20 con 0x7fa06c06dc90 2024-05-04T00:30:17.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:17.965+0000 7fa0537fe640 1 -- 172.21.15.163:0/2585330603 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa05c01f020 con 0x7fa06c06dc90 2024-05-04T00:30:18.030 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:18.025+0000 7f0dbe6f2180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-04T00:30:18.045 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.041+0000 7fa071515640 1 -- 172.21.15.163:0/2585330603 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "982b7ace-fd02-4f03-aef2-0428468f8379", "id": 3} v 0) -- 0x7fa06c069a50 con 0x7fa06c06dc90 2024-05-04T00:30:18.074 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:18.074+0000 7fc8ff580180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-04T00:30:18.105 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:18.101+0000 7f0dbe6f2180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-04T00:30:18.153 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:18.150+0000 7fc8ff580180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-04T00:30:18.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.233+0000 7fa0537fe640 1 -- 172.21.15.163:0/2585330603 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "982b7ace-fd02-4f03-aef2-0428468f8379", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fa05c00d040 con 0x7fa06c06dc90 2024-05-04T00:30:18.236 INFO:teuthology.orchestra.run.smithi163.stdout:3 2024-05-04T00:30:18.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.233+0000 7fa071515640 1 -- 172.21.15.163:0/2585330603 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa06c06dc90 msgr2=0x7fa06c154920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:18.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.233+0000 7fa071515640 1 --2- 172.21.15.163:0/2585330603 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa06c06dc90 0x7fa06c154920 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00b440 tx=0x7fa05c00b900 comp rx=0 tx=0).stop 2024-05-04T00:30:18.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.233+0000 7fa071515640 1 -- 172.21.15.163:0/2585330603 shutdown_connections 2024-05-04T00:30:18.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.233+0000 7fa071515640 1 --2- 172.21.15.163:0/2585330603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa06c0c7b20 0x7fa06c0cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:18.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.233+0000 7fa071515640 1 --2- 172.21.15.163:0/2585330603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa06c15aa30 0x7fa06c1f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:18.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.233+0000 7fa071515640 1 --2- 172.21.15.163:0/2585330603 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa06c06dc90 0x7fa06c154920 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:18.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.233+0000 7fa071515640 1 -- 172.21.15.163:0/2585330603 >> 172.21.15.163:0/2585330603 conn(0x7fa06c0ce410 msgr2=0x7fa06c1470c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:18.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.233+0000 7fa071515640 1 -- 172.21.15.163:0/2585330603 shutdown_connections 2024-05-04T00:30:18.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.233+0000 7fa071515640 1 -- 172.21.15.163:0/2585330603 wait complete. 2024-05-04T00:30:18.258 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new ecf94166-cfdf-4ac8-a659-6ae907686e8a 4 2024-05-04T00:30:18.398 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.393+0000 7f8db7f29640 1 Processor -- start 2024-05-04T00:30:18.398 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.393+0000 7f8db7f29640 1 -- start start 2024-05-04T00:30:18.400 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.397+0000 7f8db7f29640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8db006dc90 0x7f8db0154110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:18.400 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.397+0000 7f8db7f29640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8db00c7b20 0x7f8db00c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:18.400 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.397+0000 7f8db7f29640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8db0074d00 con 0x7f8db015a320 2024-05-04T00:30:18.400 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.397+0000 7f8db7f29640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8db00c9ac0 con 0x7f8db006dc90 2024-05-04T00:30:18.400 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.397+0000 7f8db7f29640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f8db00c8eb0 con 0x7f8db00c7b20 2024-05-04T00:30:18.401 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.397+0000 7f8db54c4640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8db00c7b20 0x7f8db00c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:18.401 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.397+0000 7f8db54c4640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8db00c7b20 0x7f8db00c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50358/0 (socket says 172.21.15.163:50358) 2024-05-04T00:30:18.401 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.397+0000 7f8db54c4640 1 -- 172.21.15.163:0/2407411589 learned_addr learned my addr 172.21.15.163:0/2407411589 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-04T00:30:18.401 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.397+0000 7f8db5cc5640 1 --2- 172.21.15.163:0/2407411589 >> v2:172.21.15.6:3300/0 conn(0x7f8db006dc90 0x7f8db0154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:18.405 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.401+0000 7f8db54c4640 1 -- 172.21.15.163:0/2407411589 >> v2:172.21.15.6:3300/0 conn(0x7f8db006dc90 msgr2=0x7f8db0154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:30:18.405 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.401+0000 7f8db54c4640 1 --2- 172.21.15.163:0/2407411589 >> v2:172.21.15.6:3300/0 conn(0x7f8db006dc90 0x7f8db0154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:18.405 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.401+0000 7f8db54c4640 1 -- 172.21.15.163:0/2407411589 >> v1:172.21.15.6:6789/0 conn(0x7f8db015a320 legacy=0x7f8db015a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:30:18.405 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.401+0000 7f8db54c4640 1 -- 172.21.15.163:0/2407411589 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db00c9190 con 0x7f8db00c7b20 2024-05-04T00:30:18.408 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.405+0000 7f8db54c4640 1 --2- 172.21.15.163:0/2407411589 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8db00c7b20 0x7f8db00c7f30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8db00c57e0 tx=0x7f8da001ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acccc117ba0195bb server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:18.413 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.409+0000 7f8db4cc3640 1 -- 172.21.15.163:0/2407411589 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da00b5070 con 0x7f8db00c7b20 2024-05-04T00:30:18.413 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.409+0000 7f8db4cc3640 1 -- 172.21.15.163:0/2407411589 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da00a89d0 con 0x7f8db00c7b20 2024-05-04T00:30:18.413 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.409+0000 7f8db4cc3640 1 -- 172.21.15.163:0/2407411589 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da00a8da0 con 0x7f8db00c7b20 2024-05-04T00:30:18.414 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.409+0000 7f8db7f29640 1 -- 172.21.15.163:0/2407411589 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8db00c7b20 msgr2=0x7f8db00c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:18.414 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.409+0000 7f8db7f29640 1 --2- 172.21.15.163:0/2407411589 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8db00c7b20 0x7f8db00c7f30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8db00c57e0 tx=0x7f8da001ed10 comp rx=0 tx=0).stop 2024-05-04T00:30:18.414 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.409+0000 7f8db7f29640 1 -- 172.21.15.163:0/2407411589 shutdown_connections 2024-05-04T00:30:18.414 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.409+0000 7f8db7f29640 1 --2- 172.21.15.163:0/2407411589 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8db00c7b20 0x7f8db00c7f30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:18.414 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.409+0000 7f8db7f29640 1 --2- 172.21.15.163:0/2407411589 >> v2:172.21.15.6:3300/0 conn(0x7f8db006dc90 0x7f8db0154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:18.415 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.409+0000 7f8db7f29640 1 -- 172.21.15.163:0/2407411589 >> 172.21.15.163:0/2407411589 conn(0x7f8db00ce410 msgr2=0x7f8db00ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:18.415 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.409+0000 7f8db7f29640 1 -- 172.21.15.163:0/2407411589 shutdown_connections 2024-05-04T00:30:18.415 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.409+0000 7f8db7f29640 1 -- 172.21.15.163:0/2407411589 wait complete. 2024-05-04T00:30:18.416 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.413+0000 7f8db7f29640 1 Processor -- start 2024-05-04T00:30:18.416 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.413+0000 7f8db7f29640 1 -- start start 2024-05-04T00:30:18.417 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.413+0000 7f8db7f29640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8db006dc90 0x7f8db0153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:18.417 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.413+0000 7f8db7f29640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8db00c7b20 0x7f8db01f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:18.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.413+0000 7f8db7f29640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8db015a320 0x7f8db0148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:18.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.413+0000 7f8db7f29640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8db0154650 con 0x7f8db00c7b20 2024-05-04T00:30:18.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.413+0000 7f8db7f29640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8db00c9750 con 0x7f8db015a320 2024-05-04T00:30:18.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.413+0000 7f8db7f29640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f8db006c810 con 0x7f8db006dc90 2024-05-04T00:30:18.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.413+0000 7f8db5cc5640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8db006dc90 0x7f8db0153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:18.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.413+0000 7f8db5cc5640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8db006dc90 0x7f8db0153030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:36664/0 (socket says 172.21.15.163:36664) 2024-05-04T00:30:18.419 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.413+0000 7f8db5cc5640 1 -- 172.21.15.163:0/1557206848 learned_addr learned my addr 172.21.15.163:0/1557206848 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-04T00:30:18.419 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.413+0000 7f8db64c6640 1 --2- 172.21.15.163:0/1557206848 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8db015a320 0x7f8db0148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:18.420 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:18.417+0000 7f0dbe6f2180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-04T00:30:18.421 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.417+0000 7f8db54c4640 1 --2- 172.21.15.163:0/1557206848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8db00c7b20 0x7f8db01f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:18.422 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:30:18.424 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.421+0000 7f8db5cc5640 1 -- 172.21.15.163:0/1557206848 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8db015a320 msgr2=0x7f8db0148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:18.424 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.421+0000 7f8db5cc5640 1 --2- 172.21.15.163:0/1557206848 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8db015a320 0x7f8db0148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:18.424 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.421+0000 7f8db5cc5640 1 -- 172.21.15.163:0/1557206848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8db00c7b20 msgr2=0x7f8db01f3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:18.424 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.421+0000 7f8db5cc5640 1 --2- 172.21.15.163:0/1557206848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8db00c7b20 0x7f8db01f3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:18.424 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.421+0000 7f8db5cc5640 1 -- 172.21.15.163:0/1557206848 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db014e000 con 0x7f8db006dc90 2024-05-04T00:30:18.425 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:30:18.427 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.421+0000 7f8db5cc5640 1 --2- 172.21.15.163:0/1557206848 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8db006dc90 0x7f8db0153030 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00e870 tx=0x7f8dac00ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:18.431 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.429+0000 7f8da67fc640 1 -- 172.21.15.163:0/1557206848 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac017070 con 0x7f8db006dc90 2024-05-04T00:30:18.431 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.429+0000 7f8da67fc640 1 -- 172.21.15.163:0/1557206848 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dac00c940 con 0x7f8db006dc90 2024-05-04T00:30:18.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.429+0000 7f8da67fc640 1 -- 172.21.15.163:0/1557206848 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac00ccf0 con 0x7f8db006dc90 2024-05-04T00:30:18.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.429+0000 7f8db7f29640 1 -- 172.21.15.163:0/1557206848 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db0150280 con 0x7f8db006dc90 2024-05-04T00:30:18.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.429+0000 7f8db7f29640 1 -- 172.21.15.163:0/1557206848 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db01507e0 con 0x7f8db006dc90 2024-05-04T00:30:18.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.429+0000 7f8db7f29640 1 -- 172.21.15.163:0/1557206848 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8db0069a50 con 0x7f8db006dc90 2024-05-04T00:30:18.465 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:18.462+0000 7fc8ff580180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-04T00:30:18.499 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:18.493+0000 7f0dbe6f2180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-04T00:30:18.529 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-04T00:30:18.526+0000 7fc8ff580180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-04T00:30:18.552 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.549+0000 7f8da67fc640 1 -- 172.21.15.163:0/1557206848 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8dac01a070 con 0x7f8db006dc90 2024-05-04T00:30:18.552 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.549+0000 7f8da67fc640 1 -- 172.21.15.163:0/1557206848 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f8dac013470 con 0x7f8db006dc90 2024-05-04T00:30:18.552 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.549+0000 7f8da67fc640 1 -- 172.21.15.163:0/1557206848 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8dac006510 con 0x7f8db006dc90 2024-05-04T00:30:18.625 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:18.621+0000 7f8db7f29640 1 -- 172.21.15.163:0/1557206848 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ecf94166-cfdf-4ac8-a659-6ae907686e8a", "id": 4} v 0) -- 0x7f8db00cba40 con 0x7f8db006dc90 2024-05-04T00:30:19.584 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:19.581+0000 7f8da67fc640 1 -- 172.21.15.163:0/1557206848 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mgrmap(e 2) ==== 46645+0+0 (secure 0 0 0) 0x7f8dac0066f0 con 0x7f8db006dc90 2024-05-04T00:30:20.349 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.345+0000 7f8da67fc640 1 -- 172.21.15.163:0/1557206848 <== mon.2 v2:172.21.15.163:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ecf94166-cfdf-4ac8-a659-6ae907686e8a", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f8dac029120 con 0x7f8db006dc90 2024-05-04T00:30:20.349 INFO:teuthology.orchestra.run.smithi163.stdout:4 2024-05-04T00:30:20.351 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.345+0000 7f8db7f29640 1 -- 172.21.15.163:0/1557206848 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8db006dc90 msgr2=0x7f8db0153030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:20.351 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.345+0000 7f8db7f29640 1 --2- 172.21.15.163:0/1557206848 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8db006dc90 0x7f8db0153030 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00e870 tx=0x7f8dac00ec70 comp rx=0 tx=0).stop 2024-05-04T00:30:20.351 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.345+0000 7f8db7f29640 1 -- 172.21.15.163:0/1557206848 shutdown_connections 2024-05-04T00:30:20.351 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.345+0000 7f8db7f29640 1 --2- 172.21.15.163:0/1557206848 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8db015a320 0x7f8db0148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:20.351 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.345+0000 7f8db7f29640 1 --2- 172.21.15.163:0/1557206848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8db00c7b20 0x7f8db01f3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:20.351 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.345+0000 7f8db7f29640 1 --2- 172.21.15.163:0/1557206848 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8db006dc90 0x7f8db0153030 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:20.351 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.345+0000 7f8db7f29640 1 -- 172.21.15.163:0/1557206848 >> 172.21.15.163:0/1557206848 conn(0x7f8db00ce410 msgr2=0x7f8db0149f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:20.351 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.345+0000 7f8db7f29640 1 -- 172.21.15.163:0/1557206848 shutdown_connections 2024-05-04T00:30:20.351 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.345+0000 7f8db7f29640 1 -- 172.21.15.163:0/1557206848 wait complete. 2024-05-04T00:30:20.374 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new fc5cfa90-0e3a-4fc2-829c-5ff57d7a5953 5 2024-05-04T00:30:20.572 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.569+0000 7f1d57dd2640 1 Processor -- start 2024-05-04T00:30:20.572 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.569+0000 7f1d57dd2640 1 -- start start 2024-05-04T00:30:20.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.569+0000 7f1d57dd2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d500c4890 0x7f1d501541a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:20.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.569+0000 7f1d57dd2640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1d500709d0 0x7f1d500c8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:20.574 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.569+0000 7f1d57dd2640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d5015aac0 con 0x7f1d5006f860 2024-05-04T00:30:20.574 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.569+0000 7f1d57dd2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f1d500c81e0 con 0x7f1d500c4890 2024-05-04T00:30:20.574 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.569+0000 7f1d57dd2640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f1d500c7b90 con 0x7f1d500709d0 2024-05-04T00:30:20.602 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.597+0000 7f1d5536d640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1d500709d0 0x7f1d500c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:20.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.597+0000 7f1d5536d640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1d500709d0 0x7f1d500c8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50430/0 (socket says 172.21.15.163:50430) 2024-05-04T00:30:20.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.597+0000 7f1d5536d640 1 -- 172.21.15.163:0/737441363 learned_addr learned my addr 172.21.15.163:0/737441363 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-04T00:30:20.611 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.605+0000 7f1d5536d640 1 -- 172.21.15.163:0/737441363 >> v2:172.21.15.6:3300/0 conn(0x7f1d500c4890 msgr2=0x7f1d501541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:30:20.611 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.605+0000 7f1d5536d640 1 --2- 172.21.15.163:0/737441363 >> v2:172.21.15.6:3300/0 conn(0x7f1d500c4890 0x7f1d501541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:20.611 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.605+0000 7f1d5536d640 1 -- 172.21.15.163:0/737441363 >> v1:172.21.15.163:6789/0 conn(0x7f1d5006f860 legacy=0x7f1d5015d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:30:20.611 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.605+0000 7f1d5536d640 1 -- 172.21.15.163:0/737441363 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d500c7e70 con 0x7f1d500709d0 2024-05-04T00:30:20.621 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.617+0000 7f1d5536d640 1 --2- 172.21.15.163:0/737441363 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d500709d0 0x7f1d500c8670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1d500ca3f0 tx=0x7f1d4001c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fb29bcb0f5a8d7e server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:20.625 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.621+0000 7f1d54b6c640 1 -- 172.21.15.163:0/737441363 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d400b0070 con 0x7f1d500709d0 2024-05-04T00:30:20.625 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.621+0000 7f1d54b6c640 1 -- 172.21.15.163:0/737441363 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d400a4e50 con 0x7f1d500709d0 2024-05-04T00:30:20.625 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.621+0000 7f1d54b6c640 1 -- 172.21.15.163:0/737441363 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d400ab820 con 0x7f1d500709d0 2024-05-04T00:30:20.627 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.621+0000 7f1d57dd2640 1 -- 172.21.15.163:0/737441363 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d500709d0 msgr2=0x7f1d500c8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:20.627 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.621+0000 7f1d57dd2640 1 --2- 172.21.15.163:0/737441363 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d500709d0 0x7f1d500c8670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1d500ca3f0 tx=0x7f1d4001c400 comp rx=0 tx=0).stop 2024-05-04T00:30:20.627 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.621+0000 7f1d57dd2640 1 -- 172.21.15.163:0/737441363 shutdown_connections 2024-05-04T00:30:20.627 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.621+0000 7f1d57dd2640 1 --2- 172.21.15.163:0/737441363 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d500709d0 0x7f1d500c8670 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:20.627 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.621+0000 7f1d57dd2640 1 --2- 172.21.15.163:0/737441363 >> v2:172.21.15.6:3300/0 conn(0x7f1d500c4890 0x7f1d501541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:20.627 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.621+0000 7f1d57dd2640 1 -- 172.21.15.163:0/737441363 >> 172.21.15.163:0/737441363 conn(0x7f1d5006cf70 msgr2=0x7f1d500c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:20.627 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.621+0000 7f1d57dd2640 1 -- 172.21.15.163:0/737441363 shutdown_connections 2024-05-04T00:30:20.627 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.621+0000 7f1d57dd2640 1 -- 172.21.15.163:0/737441363 wait complete. 2024-05-04T00:30:20.629 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.625+0000 7f1d57dd2640 1 Processor -- start 2024-05-04T00:30:20.629 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.625+0000 7f1d57dd2640 1 -- start start 2024-05-04T00:30:20.631 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.625+0000 7f1d57dd2640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d5006f860 0x7f1d50155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:20.631 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.625+0000 7f1d57dd2640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d500709d0 0x7f1d5014ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:20.631 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.625+0000 7f1d57dd2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d500c4890 0x7f1d50159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:20.631 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.625+0000 7f1d57dd2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1d500c4f70 con 0x7f1d500c4890 2024-05-04T00:30:20.631 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.625+0000 7f1d57dd2640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5015ada0 con 0x7f1d500709d0 2024-05-04T00:30:20.631 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.625+0000 7f1d57dd2640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f1d500c50f0 con 0x7f1d5006f860 2024-05-04T00:30:20.632 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.629+0000 7f1d5536d640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d500709d0 0x7f1d5014ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:20.632 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.629+0000 7f1d55b6e640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d5006f860 0x7f1d50155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:20.632 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.629+0000 7f1d55b6e640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d5006f860 0x7f1d50155ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:36716/0 (socket says 172.21.15.163:36716) 2024-05-04T00:30:20.632 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.629+0000 7f1d55b6e640 1 -- 172.21.15.163:0/4272642059 learned_addr learned my addr 172.21.15.163:0/4272642059 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-04T00:30:20.636 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.633+0000 7f1d55b6e640 1 -- 172.21.15.163:0/4272642059 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d500709d0 msgr2=0x7f1d5014ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:20.636 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.633+0000 7f1d55b6e640 1 --2- 172.21.15.163:0/4272642059 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d500709d0 0x7f1d5014ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:20.636 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.633+0000 7f1d55b6e640 1 -- 172.21.15.163:0/4272642059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d500c4890 msgr2=0x7f1d50159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:20.636 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.633+0000 7f1d55b6e640 1 --2- 172.21.15.163:0/4272642059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d500c4890 0x7f1d50159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:20.636 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.633+0000 7f1d55b6e640 1 -- 172.21.15.163:0/4272642059 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d50156400 con 0x7f1d5006f860 2024-05-04T00:30:20.638 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.633+0000 7f1d55b6e640 1 --2- 172.21.15.163:0/4272642059 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d5006f860 0x7f1d50155ec0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800ba50 tx=0x7f1d4800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:20.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.637+0000 7f1d467fc640 1 -- 172.21.15.163:0/4272642059 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d48019070 con 0x7f1d5006f860 2024-05-04T00:30:20.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.637+0000 7f1d467fc640 1 -- 172.21.15.163:0/4272642059 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4800cba0 con 0x7f1d5006f860 2024-05-04T00:30:20.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.637+0000 7f1d57dd2640 1 -- 172.21.15.163:0/4272642059 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d501f1e90 con 0x7f1d5006f860 2024-05-04T00:30:20.644 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.637+0000 7f1d467fc640 1 -- 172.21.15.163:0/4272642059 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d48014440 con 0x7f1d5006f860 2024-05-04T00:30:20.644 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.637+0000 7f1d57dd2640 1 -- 172.21.15.163:0/4272642059 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d501f2450 con 0x7f1d5006f860 2024-05-04T00:30:20.644 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.641+0000 7f1d57dd2640 1 -- 172.21.15.163:0/4272642059 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d5006a390 con 0x7f1d5006f860 2024-05-04T00:30:20.781 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.777+0000 7f1d467fc640 1 -- 172.21.15.163:0/4272642059 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 2) ==== 46645+0+0 (secure 0 0 0) 0x7f1d4801c070 con 0x7f1d5006f860 2024-05-04T00:30:20.809 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.805+0000 7f1d467fc640 1 -- 172.21.15.163:0/4272642059 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f1d4801dd10 con 0x7f1d5006f860 2024-05-04T00:30:20.809 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.805+0000 7f1d467fc640 1 -- 172.21.15.163:0/4272642059 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f1d48023070 con 0x7f1d5006f860 2024-05-04T00:30:20.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:20.885+0000 7f1d57dd2640 1 -- 172.21.15.163:0/4272642059 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fc5cfa90-0e3a-4fc2-829c-5ff57d7a5953", "id": 5} v 0) -- 0x7f1d50153a40 con 0x7f1d5006f860 2024-05-04T00:30:22.025 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.021+0000 7f1d467fc640 1 -- 172.21.15.163:0/4272642059 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mgrmap(e 3) ==== 93045+0+0 (secure 0 0 0) 0x7f1d4801bcd0 con 0x7f1d5006f860 2024-05-04T00:30:22.026 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.021+0000 7f1d467fc640 1 --2- 172.21.15.163:0/4272642059 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1d3406f390 0x7f1d340717b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:22.026 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.021+0000 7f1d5536d640 1 --2- 172.21.15.163:0/4272642059 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1d3406f390 0x7f1d340717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:22.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.025+0000 7f1d5536d640 1 --2- 172.21.15.163:0/4272642059 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1d3406f390 0x7f1d340717b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1d400ad000 tx=0x7f1d400a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:22.051 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:22.045+0000 7f0d650a0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-04T00:30:22.298 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-04T00:30:22.293+0000 7f0d650a0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-04T00:30:22.610 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.605+0000 7f1d467fc640 1 -- 172.21.15.163:0/4272642059 <== mon.2 v2:172.21.15.163:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc5cfa90-0e3a-4fc2-829c-5ff57d7a5953", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f1d4805f1a0 con 0x7f1d5006f860 2024-05-04T00:30:22.610 INFO:teuthology.orchestra.run.smithi163.stdout:5 2024-05-04T00:30:22.612 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.609+0000 7f1d57dd2640 1 -- 172.21.15.163:0/4272642059 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1d3406f390 msgr2=0x7f1d340717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:22.612 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.609+0000 7f1d57dd2640 1 --2- 172.21.15.163:0/4272642059 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1d3406f390 0x7f1d340717b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1d400ad000 tx=0x7f1d400a6000 comp rx=0 tx=0).stop 2024-05-04T00:30:22.612 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.609+0000 7f1d57dd2640 1 -- 172.21.15.163:0/4272642059 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d5006f860 msgr2=0x7f1d50155ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:22.612 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.609+0000 7f1d57dd2640 1 --2- 172.21.15.163:0/4272642059 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d5006f860 0x7f1d50155ec0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800ba50 tx=0x7f1d4800bf10 comp rx=0 tx=0).stop 2024-05-04T00:30:22.612 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.609+0000 7f1d57dd2640 1 -- 172.21.15.163:0/4272642059 shutdown_connections 2024-05-04T00:30:22.612 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.609+0000 7f1d57dd2640 1 --2- 172.21.15.163:0/4272642059 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d500709d0 0x7f1d5014ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:22.612 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.609+0000 7f1d57dd2640 1 --2- 172.21.15.163:0/4272642059 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1d3406f390 0x7f1d340717b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:22.613 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.609+0000 7f1d57dd2640 1 --2- 172.21.15.163:0/4272642059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d500c4890 0x7f1d50159100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:22.613 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.609+0000 7f1d57dd2640 1 --2- 172.21.15.163:0/4272642059 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d5006f860 0x7f1d50155ec0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:22.613 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.609+0000 7f1d57dd2640 1 -- 172.21.15.163:0/4272642059 >> 172.21.15.163:0/4272642059 conn(0x7f1d5006cf70 msgr2=0x7f1d500cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:22.613 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.609+0000 7f1d57dd2640 1 -- 172.21.15.163:0/4272642059 shutdown_connections 2024-05-04T00:30:22.613 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.609+0000 7f1d57dd2640 1 -- 172.21.15.163:0/4272642059 wait complete. 2024-05-04T00:30:22.637 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new ed95f0cf-f309-4861-b47c-4a5a6b44ffdc 6 2024-05-04T00:30:22.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.781+0000 7f5dfa7d9640 1 Processor -- start 2024-05-04T00:30:22.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.781+0000 7f5dfa7d9640 1 -- start start 2024-05-04T00:30:22.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.785+0000 7f5dfa7d9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5df41541f0 0x7f5df4159e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:22.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.785+0000 7f5dfa7d9640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5df40c5c10 0x7f5df4164800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:22.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.785+0000 7f5dfa7d9640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5df415a6c0 con 0x7f5df40c5800 2024-05-04T00:30:22.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.785+0000 7f5dfa7d9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f5df40c4db0 con 0x7f5df41541f0 2024-05-04T00:30:22.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.785+0000 7f5dfa7d9640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f5df415a9a0 con 0x7f5df40c5c10 2024-05-04T00:30:22.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.785+0000 7f5df8d76640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5df40c5c10 0x7f5df4164800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:22.790 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.785+0000 7f5df37fe640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f5df40c5800 0x7f5df40ca420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:35754/0 (socket says 172.21.15.163:35754) 2024-05-04T00:30:22.790 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.785+0000 7f5df37fe640 1 -- 172.21.15.163:0/3934709920 learned_addr learned my addr 172.21.15.163:0/3934709920 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-05-04T00:30:22.793 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.789+0000 7f5df8d76640 1 -- 172.21.15.163:0/3934709920 >> v2:172.21.15.6:3300/0 conn(0x7f5df41541f0 msgr2=0x7f5df4159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:30:22.793 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.789+0000 7f5df8d76640 1 --2- 172.21.15.163:0/3934709920 >> v2:172.21.15.6:3300/0 conn(0x7f5df41541f0 0x7f5df4159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:22.793 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.789+0000 7f5df8d76640 1 -- 172.21.15.163:0/3934709920 >> v1:172.21.15.163:6789/0 conn(0x7f5df40c5800 legacy=0x7f5df40ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:22.794 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.789+0000 7f5df8d76640 1 -- 172.21.15.163:0/3934709920 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df415ac80 con 0x7f5df40c5c10 2024-05-04T00:30:22.800 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.797+0000 7f5df8d76640 1 --2- 172.21.15.163:0/3934709920 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5df40c5c10 0x7f5df4164800 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5df4074890 tx=0x7f5dec01c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7471f2fd7849b577 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:22.813 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.809+0000 7f5df2ffd640 1 -- 172.21.15.163:0/3934709920 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec0b2070 con 0x7f5df40c5c10 2024-05-04T00:30:22.813 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.809+0000 7f5df2ffd640 1 -- 172.21.15.163:0/3934709920 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dec0a57f0 con 0x7f5df40c5c10 2024-05-04T00:30:22.813 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.809+0000 7f5df2ffd640 1 -- 172.21.15.163:0/3934709920 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec0a5bc0 con 0x7f5df40c5c10 2024-05-04T00:30:22.814 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.809+0000 7f5dfa7d9640 1 -- 172.21.15.163:0/3934709920 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5df40c5c10 msgr2=0x7f5df4164800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:22.814 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.809+0000 7f5dfa7d9640 1 --2- 172.21.15.163:0/3934709920 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5df40c5c10 0x7f5df4164800 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5df4074890 tx=0x7f5dec01c930 comp rx=0 tx=0).stop 2024-05-04T00:30:22.814 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.809+0000 7f5dfa7d9640 1 -- 172.21.15.163:0/3934709920 shutdown_connections 2024-05-04T00:30:22.814 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.809+0000 7f5dfa7d9640 1 --2- 172.21.15.163:0/3934709920 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5df40c5c10 0x7f5df4164800 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:22.814 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.809+0000 7f5dfa7d9640 1 --2- 172.21.15.163:0/3934709920 >> v2:172.21.15.6:3300/0 conn(0x7f5df41541f0 0x7f5df4159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:22.814 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.809+0000 7f5dfa7d9640 1 -- 172.21.15.163:0/3934709920 >> 172.21.15.163:0/3934709920 conn(0x7f5df4072ce0 msgr2=0x7f5df40704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:22.815 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.809+0000 7f5dfa7d9640 1 -- 172.21.15.163:0/3934709920 shutdown_connections 2024-05-04T00:30:22.815 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.809+0000 7f5dfa7d9640 1 -- 172.21.15.163:0/3934709920 wait complete. 2024-05-04T00:30:22.816 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.813+0000 7f5dfa7d9640 1 Processor -- start 2024-05-04T00:30:22.816 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.813+0000 7f5dfa7d9640 1 -- start start 2024-05-04T00:30:22.817 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.813+0000 7f5dfa7d9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5df40c5800 0x7f5df41487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:22.817 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.813+0000 7f5dfa7d9640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5df40c5c10 0x7f5df41f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:22.817 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.813+0000 7f5dfa7d9640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5df41541f0 0x7f5df40c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:22.817 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.813+0000 7f5dfa7d9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5df40cab30 con 0x7f5df40c5800 2024-05-04T00:30:22.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.813+0000 7f5dfa7d9640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5df40cb800 con 0x7f5df40c5c10 2024-05-04T00:30:22.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.813+0000 7f5dfa7d9640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f5df40cacb0 con 0x7f5df41541f0 2024-05-04T00:30:22.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.813+0000 7f5df8d76640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5df41541f0 0x7f5df40c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:22.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.813+0000 7f5df8d76640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5df41541f0 0x7f5df40c9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:36718/0 (socket says 172.21.15.163:36718) 2024-05-04T00:30:22.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.813+0000 7f5df8d76640 1 -- 172.21.15.163:0/1070210611 learned_addr learned my addr 172.21.15.163:0/1070210611 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-04T00:30:22.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.817+0000 7f5df8d76640 1 -- 172.21.15.163:0/1070210611 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5df40c5c10 msgr2=0x7f5df41f7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:22.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.817+0000 7f5df8d76640 1 --2- 172.21.15.163:0/1070210611 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5df40c5c10 0x7f5df41f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:22.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.817+0000 7f5df8d76640 1 -- 172.21.15.163:0/1070210611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5df40c5800 msgr2=0x7f5df41487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:22.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.817+0000 7f5df8d76640 1 --2- 172.21.15.163:0/1070210611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5df40c5800 0x7f5df41487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:22.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.817+0000 7f5df8d76640 1 -- 172.21.15.163:0/1070210611 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df4148d00 con 0x7f5df41541f0 2024-05-04T00:30:22.825 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.821+0000 7f5df8d76640 1 --2- 172.21.15.163:0/1070210611 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5df41541f0 0x7f5df40c9250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5dec019540 tx=0x7f5dec0196d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:22.830 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.825+0000 7f5df0ff9640 1 -- 172.21.15.163:0/1070210611 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec0bd020 con 0x7f5df41541f0 2024-05-04T00:30:22.830 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.825+0000 7f5df0ff9640 1 -- 172.21.15.163:0/1070210611 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dec0b3040 con 0x7f5df41541f0 2024-05-04T00:30:22.830 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.825+0000 7f5df0ff9640 1 -- 172.21.15.163:0/1070210611 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec0b2070 con 0x7f5df41541f0 2024-05-04T00:30:22.830 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.825+0000 7f5dfa7d9640 1 -- 172.21.15.163:0/1070210611 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df41f84f0 con 0x7f5df41541f0 2024-05-04T00:30:22.830 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.825+0000 7f5dfa7d9640 1 -- 172.21.15.163:0/1070210611 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df414ddc0 con 0x7f5df41541f0 2024-05-04T00:30:22.831 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.829+0000 7f5dfa7d9640 1 -- 172.21.15.163:0/1070210611 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5df414e000 con 0x7f5df41541f0 2024-05-04T00:30:22.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.849+0000 7f5df0ff9640 1 -- 172.21.15.163:0/1070210611 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 3) ==== 93045+0+0 (secure 0 0 0) 0x7f5dec0c0020 con 0x7f5df41541f0 2024-05-04T00:30:22.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.849+0000 7f5df0ff9640 1 --2- 172.21.15.163:0/1070210611 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f5de006f250 0x7f5de0071760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:22.855 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.849+0000 7f5df3fff640 1 --2- 172.21.15.163:0/1070210611 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f5de006f250 0x7f5de0071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:22.855 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.853+0000 7f5df3fff640 1 --2- 172.21.15.163:0/1070210611 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f5de006f250 0x7f5de0071760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009690 tx=0x7f5de4006c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:22.858 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:22.853+0000 7f5df0ff9640 1 -- 172.21.15.163:0/1070210611 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f5dec0a5750 con 0x7f5df41541f0 2024-05-04T00:30:23.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:23.185+0000 7f5df0ff9640 1 -- 172.21.15.163:0/1070210611 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5df414e000 con 0x7f5df41541f0 2024-05-04T00:30:23.396 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:23.393+0000 7f5dfa7d9640 1 -- 172.21.15.163:0/1070210611 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ed95f0cf-f309-4861-b47c-4a5a6b44ffdc", "id": 6} v 0) -- 0x7f5df4069a50 con 0x7f5df41541f0 2024-05-04T00:30:23.434 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:23.429+0000 7f5df0ff9640 1 -- 172.21.15.163:0/1070210611 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7f5dec0f37c0 con 0x7f5df41541f0 2024-05-04T00:30:23.977 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:23.973+0000 7f5df0ff9640 1 -- 172.21.15.163:0/1070210611 <== mon.2 v2:172.21.15.163:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ed95f0cf-f309-4861-b47c-4a5a6b44ffdc", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f5dec016520 con 0x7f5df41541f0 2024-05-04T00:30:23.977 INFO:teuthology.orchestra.run.smithi163.stdout:6 2024-05-04T00:30:23.979 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:23.973+0000 7f5dfa7d9640 1 -- 172.21.15.163:0/1070210611 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f5de006f250 msgr2=0x7f5de0071760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:23.980 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:23.973+0000 7f5dfa7d9640 1 --2- 172.21.15.163:0/1070210611 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f5de006f250 0x7f5de0071760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009690 tx=0x7f5de4006c00 comp rx=0 tx=0).stop 2024-05-04T00:30:23.980 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:23.973+0000 7f5dfa7d9640 1 -- 172.21.15.163:0/1070210611 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5df41541f0 msgr2=0x7f5df40c9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:23.980 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:23.973+0000 7f5dfa7d9640 1 --2- 172.21.15.163:0/1070210611 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5df41541f0 0x7f5df40c9250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5dec019540 tx=0x7f5dec0196d0 comp rx=0 tx=0).stop 2024-05-04T00:30:23.980 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:23.977+0000 7f5dfa7d9640 1 -- 172.21.15.163:0/1070210611 shutdown_connections 2024-05-04T00:30:23.980 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:23.977+0000 7f5dfa7d9640 1 --2- 172.21.15.163:0/1070210611 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5df40c5c10 0x7f5df41f7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:23.980 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:23.977+0000 7f5dfa7d9640 1 --2- 172.21.15.163:0/1070210611 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f5de006f250 0x7f5de0071760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:23.980 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:23.977+0000 7f5dfa7d9640 1 --2- 172.21.15.163:0/1070210611 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5df41541f0 0x7f5df40c9250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:23.980 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:23.977+0000 7f5dfa7d9640 1 --2- 172.21.15.163:0/1070210611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5df40c5800 0x7f5df41487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:23.980 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:23.977+0000 7f5dfa7d9640 1 -- 172.21.15.163:0/1070210611 >> 172.21.15.163:0/1070210611 conn(0x7f5df4072ce0 msgr2=0x7f5df40cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:23.980 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:23.977+0000 7f5dfa7d9640 1 -- 172.21.15.163:0/1070210611 shutdown_connections 2024-05-04T00:30:23.980 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:23.977+0000 7f5dfa7d9640 1 -- 172.21.15.163:0/1070210611 wait complete. 2024-05-04T00:30:24.001 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 2f57afcd-567f-44f6-9db7-df0342c8c4f3 7 2024-05-04T00:30:24.156 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.153+0000 7fcd33b96640 1 Processor -- start 2024-05-04T00:30:24.156 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.153+0000 7fcd33b96640 1 -- start start 2024-05-04T00:30:24.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.153+0000 7fcd33b96640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcd2c0709d0 0x7fcd2c1541a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:24.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.153+0000 7fcd33b96640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd2c15aac0 con 0x7fcd2c0c4890 2024-05-04T00:30:24.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.153+0000 7fcd33b96640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd2c0c7b90 con 0x7fcd2c06f860 2024-05-04T00:30:24.158 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.153+0000 7fcd33b96640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fcd2c0c81e0 con 0x7fcd2c0709d0 2024-05-04T00:30:24.158 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.153+0000 7fcd31131640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcd2c0709d0 0x7fcd2c1541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:24.158 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.153+0000 7fcd31131640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcd2c0709d0 0x7fcd2c1541a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:41876/0 (socket says 172.21.15.163:41876) 2024-05-04T00:30:24.159 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.153+0000 7fcd31131640 1 -- 172.21.15.163:0/2980214747 learned_addr learned my addr 172.21.15.163:0/2980214747 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-04T00:30:24.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.161+0000 7fcd31131640 1 -- 172.21.15.163:0/2980214747 >> v1:172.21.15.163:6789/0 conn(0x7fcd2c06f860 legacy=0x7fcd2c164820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:24.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.161+0000 7fcd31131640 1 -- 172.21.15.163:0/2980214747 >> v1:172.21.15.6:6789/0 conn(0x7fcd2c0c4890 legacy=0x7fcd2c0c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:24.166 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.161+0000 7fcd31131640 1 -- 172.21.15.163:0/2980214747 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd2c0c7e70 con 0x7fcd2c0709d0 2024-05-04T00:30:24.172 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.169+0000 7fcd31131640 1 --2- 172.21.15.163:0/2980214747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcd2c0709d0 0x7fcd2c1541a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009870 tx=0x7fcd1c01c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1a221dfd0362e26 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:24.178 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.173+0000 7fcd30930640 1 -- 172.21.15.163:0/2980214747 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c0b0070 con 0x7fcd2c0709d0 2024-05-04T00:30:24.178 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.173+0000 7fcd30930640 1 -- 172.21.15.163:0/2980214747 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd1c0ab600 con 0x7fcd2c0709d0 2024-05-04T00:30:24.178 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.173+0000 7fcd30930640 1 -- 172.21.15.163:0/2980214747 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c0ab9d0 con 0x7fcd2c0709d0 2024-05-04T00:30:24.179 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.173+0000 7fcd33b96640 1 -- 172.21.15.163:0/2980214747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcd2c0709d0 msgr2=0x7fcd2c1541a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:24.181 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.173+0000 7fcd33b96640 1 --2- 172.21.15.163:0/2980214747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcd2c0709d0 0x7fcd2c1541a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009870 tx=0x7fcd1c01c440 comp rx=0 tx=0).stop 2024-05-04T00:30:24.181 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.177+0000 7fcd33b96640 1 -- 172.21.15.163:0/2980214747 shutdown_connections 2024-05-04T00:30:24.181 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.177+0000 7fcd33b96640 1 --2- 172.21.15.163:0/2980214747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcd2c0709d0 0x7fcd2c1541a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:24.181 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.177+0000 7fcd33b96640 1 -- 172.21.15.163:0/2980214747 >> 172.21.15.163:0/2980214747 conn(0x7fcd2c06cf70 msgr2=0x7fcd2c0c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:24.182 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.177+0000 7fcd33b96640 1 -- 172.21.15.163:0/2980214747 shutdown_connections 2024-05-04T00:30:24.182 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.177+0000 7fcd33b96640 1 -- 172.21.15.163:0/2980214747 wait complete. 2024-05-04T00:30:24.183 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.177+0000 7fcd33b96640 1 Processor -- start 2024-05-04T00:30:24.183 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.177+0000 7fcd33b96640 1 -- start start 2024-05-04T00:30:24.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.177+0000 7fcd33b96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd2c06f860 0x7fcd2c1464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:24.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.177+0000 7fcd33b96640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd2c0709d0 0x7fcd2c15d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:24.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.177+0000 7fcd33b96640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcd2c0c4890 0x7fcd2c145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:24.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.177+0000 7fcd33b96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c0c50f0 con 0x7fcd2c06f860 2024-05-04T00:30:24.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.177+0000 7fcd33b96640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c0c4f70 con 0x7fcd2c0c4890 2024-05-04T00:30:24.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.177+0000 7fcd33b96640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fcd2c168760 con 0x7fcd2c0709d0 2024-05-04T00:30:24.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.181+0000 7fcd32133640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcd2c0c4890 0x7fcd2c145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:24.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.181+0000 7fcd31131640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd2c0709d0 0x7fcd2c15d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:24.185 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.181+0000 7fcd31131640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd2c0709d0 0x7fcd2c15d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:36726/0 (socket says 172.21.15.163:36726) 2024-05-04T00:30:24.185 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.181+0000 7fcd31131640 1 -- 172.21.15.163:0/3877637981 learned_addr learned my addr 172.21.15.163:0/3877637981 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-04T00:30:24.185 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.181+0000 7fcd31932640 1 --2- 172.21.15.163:0/3877637981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd2c06f860 0x7fcd2c1464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:24.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.185+0000 7fcd31131640 1 -- 172.21.15.163:0/3877637981 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcd2c0c4890 msgr2=0x7fcd2c145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:24.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.185+0000 7fcd31131640 1 --2- 172.21.15.163:0/3877637981 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcd2c0c4890 0x7fcd2c145c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:24.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.185+0000 7fcd31131640 1 -- 172.21.15.163:0/3877637981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd2c06f860 msgr2=0x7fcd2c1464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:24.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.185+0000 7fcd31131640 1 --2- 172.21.15.163:0/3877637981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd2c06f860 0x7fcd2c1464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:24.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.185+0000 7fcd31131640 1 -- 172.21.15.163:0/3877637981 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd2c146e40 con 0x7fcd2c0709d0 2024-05-04T00:30:24.190 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.185+0000 7fcd31131640 1 --2- 172.21.15.163:0/3877637981 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd2c0709d0 0x7fcd2c15d1d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c019050 tx=0x7fcd1c0191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:24.195 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.189+0000 7fcd227fc640 1 -- 172.21.15.163:0/3877637981 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c0b0050 con 0x7fcd2c0709d0 2024-05-04T00:30:24.195 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.189+0000 7fcd227fc640 1 -- 172.21.15.163:0/3877637981 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd1c0b1040 con 0x7fcd2c0709d0 2024-05-04T00:30:24.195 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.189+0000 7fcd227fc640 1 -- 172.21.15.163:0/3877637981 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c0b47d0 con 0x7fcd2c0709d0 2024-05-04T00:30:24.195 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.189+0000 7fcd33b96640 1 -- 172.21.15.163:0/3877637981 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd2c156a30 con 0x7fcd2c0709d0 2024-05-04T00:30:24.195 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.193+0000 7fcd33b96640 1 -- 172.21.15.163:0/3877637981 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd2c156ff0 con 0x7fcd2c0709d0 2024-05-04T00:30:24.196 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.193+0000 7fcd33b96640 1 -- 172.21.15.163:0/3877637981 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd2c06a390 con 0x7fcd2c0709d0 2024-05-04T00:30:24.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.217+0000 7fcd227fc640 1 -- 172.21.15.163:0/3877637981 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7fcd1c0bc020 con 0x7fcd2c0709d0 2024-05-04T00:30:24.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.217+0000 7fcd227fc640 1 --2- 172.21.15.163:0/3877637981 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fcd1006f3c0 0x7fcd100718d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:24.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.217+0000 7fcd31932640 1 --2- 172.21.15.163:0/3877637981 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fcd1006f3c0 0x7fcd100718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:24.221 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.217+0000 7fcd31932640 1 --2- 172.21.15.163:0/3877637981 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fcd1006f3c0 0x7fcd100718d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcd28007fd0 tx=0x7fcd28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:24.491 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.485+0000 7fcd227fc640 1 -- 172.21.15.163:0/3877637981 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fcd1c0f4860 con 0x7fcd2c0709d0 2024-05-04T00:30:24.491 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.485+0000 7fcd227fc640 1 -- 172.21.15.163:0/3877637981 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fcd1c016150 con 0x7fcd2c0709d0 2024-05-04T00:30:24.733 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:24.729+0000 7fcd33b96640 1 -- 172.21.15.163:0/3877637981 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2f57afcd-567f-44f6-9db7-df0342c8c4f3", "id": 7} v 0) -- 0x7fcd2c1578c0 con 0x7fcd2c0709d0 2024-05-04T00:30:25.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:25.121+0000 7fcd227fc640 1 -- 172.21.15.163:0/3877637981 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2f57afcd-567f-44f6-9db7-df0342c8c4f3", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fcd1c0f5e30 con 0x7fcd2c0709d0 2024-05-04T00:30:25.127 INFO:teuthology.orchestra.run.smithi163.stdout:7 2024-05-04T00:30:25.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:25.125+0000 7fcd33b96640 1 -- 172.21.15.163:0/3877637981 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fcd1006f3c0 msgr2=0x7fcd100718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:25.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:25.125+0000 7fcd33b96640 1 --2- 172.21.15.163:0/3877637981 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fcd1006f3c0 0x7fcd100718d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcd28007fd0 tx=0x7fcd28009040 comp rx=0 tx=0).stop 2024-05-04T00:30:25.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:25.125+0000 7fcd33b96640 1 -- 172.21.15.163:0/3877637981 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd2c0709d0 msgr2=0x7fcd2c15d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:25.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:25.125+0000 7fcd33b96640 1 --2- 172.21.15.163:0/3877637981 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd2c0709d0 0x7fcd2c15d1d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c019050 tx=0x7fcd1c0191e0 comp rx=0 tx=0).stop 2024-05-04T00:30:25.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:25.125+0000 7fcd33b96640 1 -- 172.21.15.163:0/3877637981 shutdown_connections 2024-05-04T00:30:25.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:25.125+0000 7fcd33b96640 1 --2- 172.21.15.163:0/3877637981 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcd2c0c4890 0x7fcd2c145c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:25.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:25.125+0000 7fcd33b96640 1 --2- 172.21.15.163:0/3877637981 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fcd1006f3c0 0x7fcd100718d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:25.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:25.125+0000 7fcd33b96640 1 --2- 172.21.15.163:0/3877637981 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd2c0709d0 0x7fcd2c15d1d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:25.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:25.125+0000 7fcd33b96640 1 --2- 172.21.15.163:0/3877637981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd2c06f860 0x7fcd2c1464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:25.131 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:25.125+0000 7fcd33b96640 1 -- 172.21.15.163:0/3877637981 >> 172.21.15.163:0/3877637981 conn(0x7fcd2c06cf70 msgr2=0x7fcd2c073700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:25.131 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:25.125+0000 7fcd33b96640 1 -- 172.21.15.163:0/3877637981 shutdown_connections 2024-05-04T00:30:25.131 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-04T00:30:25.125+0000 7fcd33b96640 1 -- 172.21.15.163:0/3877637981 wait complete. 2024-05-04T00:30:25.152 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-04T00:30:25.152 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-05-04T00:30:25.154 INFO:tasks.ceph.osd.0:Started 2024-05-04T00:30:25.155 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-04T00:30:25.155 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-05-04T00:30:25.157 INFO:tasks.ceph.osd.1:Started 2024-05-04T00:30:25.157 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-04T00:30:25.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-05-04T00:30:25.160 INFO:tasks.ceph.osd.2:Started 2024-05-04T00:30:25.160 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-04T00:30:25.160 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-05-04T00:30:25.162 INFO:tasks.ceph.osd.3:Started 2024-05-04T00:30:25.162 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-04T00:30:25.163 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-05-04T00:30:25.165 INFO:tasks.ceph.osd.4:Started 2024-05-04T00:30:25.165 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-04T00:30:25.165 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-05-04T00:30:25.167 INFO:tasks.ceph.osd.5:Started 2024-05-04T00:30:25.167 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-04T00:30:25.167 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-05-04T00:30:25.169 INFO:tasks.ceph.osd.6:Started 2024-05-04T00:30:25.169 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-04T00:30:25.169 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-05-04T00:30:25.171 INFO:tasks.ceph.osd.7:Started 2024-05-04T00:30:25.172 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T00:30:25.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.346+0000 7fee54f24640 1 Processor -- start 2024-05-04T00:30:25.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.346+0000 7fee54f24640 1 -- start start 2024-05-04T00:30:25.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.350+0000 7fee54f24640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee5006dcf0 0x7fee501565e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:25.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.350+0000 7fee54f24640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee5015c7b0 0x7fee5015cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:25.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.350+0000 7fee54f24640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee5015c2b0 con 0x7fee5006cde0 2024-05-04T00:30:25.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.350+0000 7fee54f24640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fee500ca620 con 0x7fee5006dcf0 2024-05-04T00:30:25.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.350+0000 7fee54f24640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fee500cb1b0 con 0x7fee5015c7b0 2024-05-04T00:30:25.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.350+0000 7fee4ed9d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee5015c7b0 0x7fee5015cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:25.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.350+0000 7fee4e59c640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fee5006cde0 0x7fee500cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:56546/0 (socket says 172.21.15.6:56546) 2024-05-04T00:30:25.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.350+0000 7fee4e59c640 1 -- 172.21.15.6:0/2690255308 learned_addr learned my addr 172.21.15.6:0/2690255308 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:30:25.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.350+0000 7fee4dd9b640 1 --2- 172.21.15.6:0/2690255308 >> v2:172.21.15.6:3300/0 conn(0x7fee5006dcf0 0x7fee501565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:25.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.354+0000 7fee4ed9d640 1 -- 172.21.15.6:0/2690255308 >> v2:172.21.15.6:3300/0 conn(0x7fee5006dcf0 msgr2=0x7fee501565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:30:25.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.354+0000 7fee4ed9d640 1 --2- 172.21.15.6:0/2690255308 >> v2:172.21.15.6:3300/0 conn(0x7fee5006dcf0 0x7fee501565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:25.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.354+0000 7fee4ed9d640 1 -- 172.21.15.6:0/2690255308 >> v1:172.21.15.163:6789/0 conn(0x7fee5006cde0 legacy=0x7fee500cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:25.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.354+0000 7fee4ed9d640 1 -- 172.21.15.6:0/2690255308 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee500cb490 con 0x7fee5015c7b0 2024-05-04T00:30:25.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.358+0000 7fee4ed9d640 1 --2- 172.21.15.6:0/2690255308 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee5015c7b0 0x7fee5015cbc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fee48009d90 tx=0x7fee4801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c513440c53672a1b server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:25.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.362+0000 7fee4d59a640 1 -- 172.21.15.6:0/2690255308 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee480b2070 con 0x7fee5015c7b0 2024-05-04T00:30:25.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.362+0000 7fee4d59a640 1 -- 172.21.15.6:0/2690255308 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee480a5890 con 0x7fee5015c7b0 2024-05-04T00:30:25.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.362+0000 7fee4d59a640 1 -- 172.21.15.6:0/2690255308 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee480a5c60 con 0x7fee5015c7b0 2024-05-04T00:30:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.362+0000 7fee54f24640 1 -- 172.21.15.6:0/2690255308 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee5015c7b0 msgr2=0x7fee5015cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.362+0000 7fee54f24640 1 --2- 172.21.15.6:0/2690255308 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee5015c7b0 0x7fee5015cbc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fee48009d90 tx=0x7fee4801c8e0 comp rx=0 tx=0).stop 2024-05-04T00:30:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.362+0000 7fee54f24640 1 -- 172.21.15.6:0/2690255308 shutdown_connections 2024-05-04T00:30:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.362+0000 7fee54f24640 1 --2- 172.21.15.6:0/2690255308 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee5015c7b0 0x7fee5015cbc0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:25.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.362+0000 7fee54f24640 1 --2- 172.21.15.6:0/2690255308 >> v2:172.21.15.6:3300/0 conn(0x7fee5006dcf0 0x7fee501565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:25.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.362+0000 7fee54f24640 1 -- 172.21.15.6:0/2690255308 >> 172.21.15.6:0/2690255308 conn(0x7fee5006f1e0 msgr2=0x7fee50072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:25.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.362+0000 7fee54f24640 1 -- 172.21.15.6:0/2690255308 shutdown_connections 2024-05-04T00:30:25.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.362+0000 7fee54f24640 1 -- 172.21.15.6:0/2690255308 wait complete. 2024-05-04T00:30:25.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.366+0000 7fee54f24640 1 Processor -- start 2024-05-04T00:30:25.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.366+0000 7fee54f24640 1 -- start start 2024-05-04T00:30:25.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.366+0000 7fee54f24640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee5006cde0 0x7fee50158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:25.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.366+0000 7fee54f24640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee5006dcf0 0x7fee5014fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:25.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.366+0000 7fee54f24640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee5015c7b0 0x7fee500cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:25.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.366+0000 7fee54f24640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fee500cfd90 con 0x7fee5015c7b0 2024-05-04T00:30:25.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.366+0000 7fee54f24640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fee500cfc10 con 0x7fee5006cde0 2024-05-04T00:30:25.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.366+0000 7fee54f24640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fee50169370 con 0x7fee5006dcf0 2024-05-04T00:30:25.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.366+0000 7fee4ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee5015c7b0 0x7fee500cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:25.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.366+0000 7fee4dd9b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee5006dcf0 0x7fee5014fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:25.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.366+0000 7fee4ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee5015c7b0 0x7fee500cbaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54122/0 (socket says 172.21.15.6:54122) 2024-05-04T00:30:25.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.366+0000 7fee4ed9d640 1 -- 172.21.15.6:0/546763127 learned_addr learned my addr 172.21.15.6:0/546763127 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:30:25.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.366+0000 7fee4e59c640 1 --2- 172.21.15.6:0/546763127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee5006cde0 0x7fee50158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:25.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.370+0000 7fee4ed9d640 1 -- 172.21.15.6:0/546763127 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee5006dcf0 msgr2=0x7fee5014fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:25.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.370+0000 7fee4ed9d640 1 --2- 172.21.15.6:0/546763127 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee5006dcf0 0x7fee5014fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:25.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.370+0000 7fee4ed9d640 1 -- 172.21.15.6:0/546763127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee5006cde0 msgr2=0x7fee50158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:25.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.370+0000 7fee4ed9d640 1 --2- 172.21.15.6:0/546763127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee5006cde0 0x7fee50158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:25.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.370+0000 7fee4ed9d640 1 -- 172.21.15.6:0/546763127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee501588b0 con 0x7fee5015c7b0 2024-05-04T00:30:25.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.374+0000 7fee4ed9d640 1 --2- 172.21.15.6:0/546763127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee5015c7b0 0x7fee500cbaf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fee4801af90 tx=0x7fee48019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:25.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.378+0000 7fee46ffd640 1 -- 172.21.15.6:0/546763127 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee480b2040 con 0x7fee5015c7b0 2024-05-04T00:30:25.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.378+0000 7fee46ffd640 1 -- 172.21.15.6:0/546763127 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee480bd070 con 0x7fee5015c7b0 2024-05-04T00:30:25.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.378+0000 7fee46ffd640 1 -- 172.21.15.6:0/546763127 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee480ad840 con 0x7fee5015c7b0 2024-05-04T00:30:25.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.378+0000 7fee54f24640 1 -- 172.21.15.6:0/546763127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee50157bb0 con 0x7fee5015c7b0 2024-05-04T00:30:25.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.378+0000 7fee54f24640 1 -- 172.21.15.6:0/546763127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee500c6940 con 0x7fee5015c7b0 2024-05-04T00:30:25.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.378+0000 7fee54f24640 1 -- 172.21.15.6:0/546763127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee50069a50 con 0x7fee5015c7b0 2024-05-04T00:30:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.734+0000 7fee46ffd640 1 -- 172.21.15.6:0/546763127 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7fee480a5750 con 0x7fee5015c7b0 2024-05-04T00:30:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.734+0000 7fee46ffd640 1 --2- 172.21.15.6:0/546763127 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fee3006f3f0 0x7fee30071900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.734+0000 7fee4e59c640 1 --2- 172.21.15.6:0/546763127 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fee3006f3f0 0x7fee30071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:25.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.734+0000 7fee4e59c640 1 --2- 172.21.15.6:0/546763127 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fee3006f3f0 0x7fee30071900 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fee40000f70 tx=0x7fee40009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:25.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.770+0000 7fee46ffd640 1 -- 172.21.15.6:0/546763127 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fee480f56e0 con 0x7fee5015c7b0 2024-05-04T00:30:25.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.770+0000 7fee46ffd640 1 -- 172.21.15.6:0/546763127 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fee48016560 con 0x7fee5015c7b0 2024-05-04T00:30:25.837 INFO:tasks.ceph.osd.7.smithi163.stderr:2024-05-04T00:30:25.833+0000 7f9bae4507c0 -1 Falling back to public interface 2024-05-04T00:30:25.848 INFO:tasks.ceph.osd.6.smithi163.stderr:2024-05-04T00:30:25.845+0000 7f0b52a767c0 -1 Falling back to public interface 2024-05-04T00:30:25.849 INFO:tasks.ceph.osd.5.smithi163.stderr:2024-05-04T00:30:25.845+0000 7f3aea19b7c0 -1 Falling back to public interface 2024-05-04T00:30:25.849 INFO:tasks.ceph.osd.4.smithi163.stderr:2024-05-04T00:30:25.845+0000 7fa7006027c0 -1 Falling back to public interface 2024-05-04T00:30:25.859 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-05-04T00:30:25.858+0000 7f638b8eb7c0 -1 Falling back to public interface 2024-05-04T00:30:25.860 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-05-04T00:30:25.858+0000 7fdd5f6527c0 -1 Falling back to public interface 2024-05-04T00:30:25.860 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-05-04T00:30:25.858+0000 7ff76e5af7c0 -1 Falling back to public interface 2024-05-04T00:30:25.860 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-05-04T00:30:25.858+0000 7f07a3b147c0 -1 Falling back to public interface 2024-05-04T00:30:25.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:25.946+0000 7fee54f24640 1 -- 172.21.15.6:0/546763127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee500caef0 con 0x7fee5015c7b0 2024-05-04T00:30:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:26.002+0000 7fee46ffd640 1 -- 172.21.15.6:0/546763127 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fee480f6c40 con 0x7fee5015c7b0 2024-05-04T00:30:26.005 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:30:26.005 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":10,"fsid":"ad5951ed-0d5e-4770-b5d9-995e08a00213","created":"2024-05-04T00:30:11.236352+0000","modified":"2024-05-04T00:30:24.926330+0000","last_up_change":"0.000000","last_in_change":"2024-05-04T00:30:24.926330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a907d753-b7cf-499c-ae36-81e44ed933a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"eab41a32-d5f1-43b8-8835-f2d4bffc9cdb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f2540144-b533-4ffc-a9cf-24f0e4910a9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"982b7ace-fd02-4f03-aef2-0428468f8379","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ecf94166-cfdf-4ac8-a659-6ae907686e8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fc5cfa90-0e3a-4fc2-829c-5ff57d7a5953","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ed95f0cf-f309-4861-b47c-4a5a6b44ffdc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2f57afcd-567f-44f6-9db7-df0342c8c4f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T00:30:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:26.006+0000 7fee54f24640 1 -- 172.21.15.6:0/546763127 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fee3006f3f0 msgr2=0x7fee30071900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:26.006+0000 7fee54f24640 1 --2- 172.21.15.6:0/546763127 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fee3006f3f0 0x7fee30071900 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fee40000f70 tx=0x7fee40009040 comp rx=0 tx=0).stop 2024-05-04T00:30:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:26.006+0000 7fee54f24640 1 -- 172.21.15.6:0/546763127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee5015c7b0 msgr2=0x7fee500cbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:26.006+0000 7fee54f24640 1 --2- 172.21.15.6:0/546763127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee5015c7b0 0x7fee500cbaf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fee4801af90 tx=0x7fee48019680 comp rx=0 tx=0).stop 2024-05-04T00:30:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:26.006+0000 7fee54f24640 1 -- 172.21.15.6:0/546763127 shutdown_connections 2024-05-04T00:30:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:26.006+0000 7fee54f24640 1 --2- 172.21.15.6:0/546763127 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fee3006f3f0 0x7fee30071900 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:26.006+0000 7fee54f24640 1 --2- 172.21.15.6:0/546763127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee5015c7b0 0x7fee500cbaf0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:26.006+0000 7fee54f24640 1 --2- 172.21.15.6:0/546763127 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee5006dcf0 0x7fee5014fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:26.006+0000 7fee54f24640 1 --2- 172.21.15.6:0/546763127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee5006cde0 0x7fee50158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:26.006+0000 7fee54f24640 1 -- 172.21.15.6:0/546763127 >> 172.21.15.6:0/546763127 conn(0x7fee5006f1e0 msgr2=0x7fee50070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:26.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:26.006+0000 7fee54f24640 1 -- 172.21.15.6:0/546763127 shutdown_connections 2024-05-04T00:30:26.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:26.006+0000 7fee54f24640 1 -- 172.21.15.6:0/546763127 wait complete. 2024-05-04T00:30:26.029 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-04T00:30:26.029 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-04T00:30:26.837 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-04T00:30:26.990 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:26.990+0000 7f45e5274640 1 Processor -- start 2024-05-04T00:30:26.990 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:26.990+0000 7f45e5274640 1 -- start start 2024-05-04T00:30:26.992 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:26.990+0000 7f45e5274640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f45e0074440 0x7f45e00c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:26.992 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:26.990+0000 7f45e5274640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45e0152f70 0x7f45e00737b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:26.992 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:26.990+0000 7f45e5274640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45e00749a0 con 0x7f45e0073cf0 2024-05-04T00:30:26.992 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:26.990+0000 7f45e5274640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f45e00ca030 con 0x7f45e0152f70 2024-05-04T00:30:26.992 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:26.990+0000 7f45e5274640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f45e00ca280 con 0x7f45e0074440 2024-05-04T00:30:26.992 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:26.990+0000 7f45de7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45e0152f70 0x7f45e00737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:26.993 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:26.990+0000 7f45de7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45e0152f70 0x7f45e00737b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54126/0 (socket says 172.21.15.6:54126) 2024-05-04T00:30:26.993 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:26.990+0000 7f45de7fc640 1 -- 172.21.15.6:0/3799038740 learned_addr learned my addr 172.21.15.6:0/3799038740 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:30:26.993 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:26.994+0000 7f45deffd640 1 --2- 172.21.15.6:0/3799038740 >> v2:172.21.15.163:3300/0 conn(0x7f45e0074440 0x7f45e00c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:26.997 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:26.994+0000 7f45de7fc640 1 -- 172.21.15.6:0/3799038740 >> v2:172.21.15.163:3300/0 conn(0x7f45e0074440 msgr2=0x7f45e00c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:30:26.997 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:26.994+0000 7f45de7fc640 1 --2- 172.21.15.6:0/3799038740 >> v2:172.21.15.163:3300/0 conn(0x7f45e0074440 0x7f45e00c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:26.997 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:26.994+0000 7f45de7fc640 1 -- 172.21.15.6:0/3799038740 >> v1:172.21.15.6:6789/0 conn(0x7f45e0073cf0 legacy=0x7f45e00c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:26.997 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:26.994+0000 7f45de7fc640 1 -- 172.21.15.6:0/3799038740 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e00ca560 con 0x7f45e0152f70 2024-05-04T00:30:27.003 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.002+0000 7f45de7fc640 1 --2- 172.21.15.6:0/3799038740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45e0152f70 0x7f45e00737b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f45e0072640 tx=0x7f45d401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624e7bed141bc697 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:27.008 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.006+0000 7f45ddffb640 1 -- 172.21.15.6:0/3799038740 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d40b5070 con 0x7f45e0152f70 2024-05-04T00:30:27.008 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.006+0000 7f45ddffb640 1 -- 172.21.15.6:0/3799038740 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45d40a8a10 con 0x7f45e0152f70 2024-05-04T00:30:27.008 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.006+0000 7f45ddffb640 1 -- 172.21.15.6:0/3799038740 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d40a8de0 con 0x7f45e0152f70 2024-05-04T00:30:27.009 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.006+0000 7f45e5274640 1 -- 172.21.15.6:0/3799038740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45e0152f70 msgr2=0x7f45e00737b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:27.009 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.006+0000 7f45e5274640 1 --2- 172.21.15.6:0/3799038740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45e0152f70 0x7f45e00737b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f45e0072640 tx=0x7f45d401ed10 comp rx=0 tx=0).stop 2024-05-04T00:30:27.009 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.006+0000 7f45e5274640 1 -- 172.21.15.6:0/3799038740 shutdown_connections 2024-05-04T00:30:27.009 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.006+0000 7f45e5274640 1 --2- 172.21.15.6:0/3799038740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45e0152f70 0x7f45e00737b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:27.009 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.006+0000 7f45e5274640 1 --2- 172.21.15.6:0/3799038740 >> v2:172.21.15.163:3300/0 conn(0x7f45e0074440 0x7f45e00c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:27.009 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.006+0000 7f45e5274640 1 -- 172.21.15.6:0/3799038740 >> 172.21.15.6:0/3799038740 conn(0x7f45e00712a0 msgr2=0x7f45e00716b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:27.009 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.006+0000 7f45e5274640 1 -- 172.21.15.6:0/3799038740 shutdown_connections 2024-05-04T00:30:27.009 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.006+0000 7f45e5274640 1 -- 172.21.15.6:0/3799038740 wait complete. 2024-05-04T00:30:27.010 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.010+0000 7f45e5274640 1 Processor -- start 2024-05-04T00:30:27.011 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.010+0000 7f45e5274640 1 -- start start 2024-05-04T00:30:27.012 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.010+0000 7f45e5274640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45e0073cf0 0x7f45e01f3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:27.012 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.010+0000 7f45e5274640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45e0074440 0x7f45e0147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:27.012 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.010+0000 7f45e5274640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45e0152f70 0x7f45e0158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:27.012 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.010+0000 7f45e5274640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f45e0153380 con 0x7f45e0152f70 2024-05-04T00:30:27.012 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.010+0000 7f45e5274640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f45e00c9be0 con 0x7f45e0073cf0 2024-05-04T00:30:27.012 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.010+0000 7f45e5274640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f45e00c83a0 con 0x7f45e0074440 2024-05-04T00:30:27.013 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.010+0000 7f45df7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45e0152f70 0x7f45e0158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:27.013 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.010+0000 7f45df7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45e0152f70 0x7f45e0158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54136/0 (socket says 172.21.15.6:54136) 2024-05-04T00:30:27.013 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.010+0000 7f45df7fe640 1 -- 172.21.15.6:0/315018194 learned_addr learned my addr 172.21.15.6:0/315018194 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:30:27.013 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.010+0000 7f45deffd640 1 --2- 172.21.15.6:0/315018194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45e0073cf0 0x7f45e01f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:27.013 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.010+0000 7f45de7fc640 1 --2- 172.21.15.6:0/315018194 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45e0074440 0x7f45e0147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:27.017 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.014+0000 7f45df7fe640 1 -- 172.21.15.6:0/315018194 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45e0074440 msgr2=0x7f45e0147040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:27.017 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.014+0000 7f45df7fe640 1 --2- 172.21.15.6:0/315018194 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45e0074440 0x7f45e0147040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:27.017 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.014+0000 7f45df7fe640 1 -- 172.21.15.6:0/315018194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45e0073cf0 msgr2=0x7f45e01f3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:27.017 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.014+0000 7f45df7fe640 1 --2- 172.21.15.6:0/315018194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45e0073cf0 0x7f45e01f3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:27.017 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.014+0000 7f45df7fe640 1 -- 172.21.15.6:0/315018194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e0147580 con 0x7f45e0152f70 2024-05-04T00:30:27.019 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.018+0000 7f45df7fe640 1 --2- 172.21.15.6:0/315018194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45e0152f70 0x7f45e0158170 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f45d800c760 tx=0x7f45d800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:27.024 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.022+0000 7f45c77fe640 1 -- 172.21.15.6:0/315018194 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d8003b80 con 0x7f45e0152f70 2024-05-04T00:30:27.024 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.022+0000 7f45c77fe640 1 -- 172.21.15.6:0/315018194 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45d8003d20 con 0x7f45e0152f70 2024-05-04T00:30:27.024 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.022+0000 7f45e5274640 1 -- 172.21.15.6:0/315018194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45e01e4e90 con 0x7f45e0152f70 2024-05-04T00:30:27.024 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.022+0000 7f45c77fe640 1 -- 172.21.15.6:0/315018194 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d800aa70 con 0x7f45e0152f70 2024-05-04T00:30:27.024 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.022+0000 7f45e5274640 1 -- 172.21.15.6:0/315018194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e01e16d0 con 0x7f45e0152f70 2024-05-04T00:30:27.024 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.022+0000 7f45e5274640 1 -- 172.21.15.6:0/315018194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45e0069b10 con 0x7f45e0152f70 2024-05-04T00:30:27.347 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.346+0000 7f45c77fe640 1 -- 172.21.15.6:0/315018194 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7f45d800ac10 con 0x7f45e0152f70 2024-05-04T00:30:27.348 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.346+0000 7f45c77fe640 1 --2- 172.21.15.6:0/315018194 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f45cc06f370 0x7f45cc071880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:27.348 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.346+0000 7f45deffd640 1 --2- 172.21.15.6:0/315018194 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f45cc06f370 0x7f45cc071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:27.350 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.350+0000 7f45deffd640 1 --2- 172.21.15.6:0/315018194 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f45cc06f370 0x7f45cc071880 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009ac0 tx=0x7f45d0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:27.386 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.386+0000 7f45c77fe640 1 -- 172.21.15.6:0/315018194 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f45d805aea0 con 0x7f45e0152f70 2024-05-04T00:30:27.386 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.386+0000 7f45c77fe640 1 -- 172.21.15.6:0/315018194 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f45d805c400 con 0x7f45e0152f70 2024-05-04T00:30:27.566 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.566+0000 7f45e5274640 1 -- 172.21.15.6:0/315018194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45e0076750 con 0x7f45e0152f70 2024-05-04T00:30:27.613 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.610+0000 7f45c77fe640 1 -- 172.21.15.6:0/315018194 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f45d8060700 con 0x7f45e0152f70 2024-05-04T00:30:27.613 INFO:teuthology.misc.health.smithi006.stdout: 2024-05-04T00:30:27.614 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":10,"fsid":"ad5951ed-0d5e-4770-b5d9-995e08a00213","created":"2024-05-04T00:30:11.236352+0000","modified":"2024-05-04T00:30:24.926330+0000","last_up_change":"0.000000","last_in_change":"2024-05-04T00:30:24.926330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a907d753-b7cf-499c-ae36-81e44ed933a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"eab41a32-d5f1-43b8-8835-f2d4bffc9cdb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f2540144-b533-4ffc-a9cf-24f0e4910a9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"982b7ace-fd02-4f03-aef2-0428468f8379","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ecf94166-cfdf-4ac8-a659-6ae907686e8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fc5cfa90-0e3a-4fc2-829c-5ff57d7a5953","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ed95f0cf-f309-4861-b47c-4a5a6b44ffdc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2f57afcd-567f-44f6-9db7-df0342c8c4f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T00:30:27.616 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.614+0000 7f45e5274640 1 -- 172.21.15.6:0/315018194 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f45cc06f370 msgr2=0x7f45cc071880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:27.616 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.614+0000 7f45e5274640 1 --2- 172.21.15.6:0/315018194 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f45cc06f370 0x7f45cc071880 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009ac0 tx=0x7f45d0009190 comp rx=0 tx=0).stop 2024-05-04T00:30:27.616 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.614+0000 7f45e5274640 1 -- 172.21.15.6:0/315018194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45e0152f70 msgr2=0x7f45e0158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:27.616 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.614+0000 7f45e5274640 1 --2- 172.21.15.6:0/315018194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45e0152f70 0x7f45e0158170 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f45d800c760 tx=0x7f45d800cc20 comp rx=0 tx=0).stop 2024-05-04T00:30:27.616 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.614+0000 7f45e5274640 1 -- 172.21.15.6:0/315018194 shutdown_connections 2024-05-04T00:30:27.616 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.614+0000 7f45e5274640 1 --2- 172.21.15.6:0/315018194 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f45cc06f370 0x7f45cc071880 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:27.616 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.614+0000 7f45e5274640 1 --2- 172.21.15.6:0/315018194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45e0152f70 0x7f45e0158170 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:27.617 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.614+0000 7f45e5274640 1 --2- 172.21.15.6:0/315018194 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45e0074440 0x7f45e0147040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:27.617 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.614+0000 7f45e5274640 1 --2- 172.21.15.6:0/315018194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45e0073cf0 0x7f45e01f3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:27.617 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.614+0000 7f45e5274640 1 -- 172.21.15.6:0/315018194 >> 172.21.15.6:0/315018194 conn(0x7f45e00712a0 msgr2=0x7f45e00716b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:27.617 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.614+0000 7f45e5274640 1 -- 172.21.15.6:0/315018194 shutdown_connections 2024-05-04T00:30:27.617 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:27.614+0000 7f45e5274640 1 -- 172.21.15.6:0/315018194 wait complete. 2024-05-04T00:30:27.636 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-04T00:30:29.535 INFO:tasks.ceph.osd.7.smithi163.stderr:2024-05-04T00:30:29.533+0000 7f9bae4507c0 -1 osd.7 0 log_to_monitors true 2024-05-04T00:30:29.618 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-05-04T00:30:29.618+0000 7f07a3b147c0 -1 osd.3 0 log_to_monitors true 2024-05-04T00:30:29.704 INFO:tasks.ceph.osd.5.smithi163.stderr:2024-05-04T00:30:29.701+0000 7f3aea19b7c0 -1 osd.5 0 log_to_monitors true 2024-05-04T00:30:29.726 INFO:tasks.ceph.osd.4.smithi163.stderr:2024-05-04T00:30:29.721+0000 7fa7006027c0 -1 osd.4 0 log_to_monitors true 2024-05-04T00:30:29.746 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-05-04T00:30:29.746+0000 7f638b8eb7c0 -1 osd.1 0 log_to_monitors true 2024-05-04T00:30:29.777 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-05-04T00:30:29.774+0000 7ff76e5af7c0 -1 osd.0 0 log_to_monitors true 2024-05-04T00:30:29.793 INFO:tasks.ceph.osd.6.smithi163.stderr:2024-05-04T00:30:29.789+0000 7f0b52a767c0 -1 osd.6 0 log_to_monitors true 2024-05-04T00:30:29.806 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-05-04T00:30:29.806+0000 7fdd5f6527c0 -1 osd.2 0 log_to_monitors true 2024-05-04T00:30:32.915 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-05-04T00:30:32.914+0000 7f079fabb640 -1 osd.3 0 waiting for initial osdmap 2024-05-04T00:30:33.058 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-05-04T00:30:33.058+0000 7f07978bc640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T00:30:33.306 INFO:tasks.ceph.osd.7.smithi163.stderr:2024-05-04T00:30:33.305+0000 7f9baa3f7640 -1 osd.7 0 waiting for initial osdmap 2024-05-04T00:30:33.346 INFO:tasks.ceph.osd.7.smithi163.stderr:2024-05-04T00:30:33.345+0000 7f9ba21f8640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T00:30:34.033 INFO:tasks.ceph.osd.4.smithi163.stderr:2024-05-04T00:30:34.033+0000 7fa6fc5a9640 -1 osd.4 0 waiting for initial osdmap 2024-05-04T00:30:34.066 INFO:tasks.ceph.osd.5.smithi163.stderr:2024-05-04T00:30:34.065+0000 7f3ae6142640 -1 osd.5 0 waiting for initial osdmap 2024-05-04T00:30:34.108 INFO:tasks.ceph.osd.4.smithi163.stderr:2024-05-04T00:30:34.109+0000 7fa6f43aa640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T00:30:34.108 INFO:tasks.ceph.osd.5.smithi163.stderr:2024-05-04T00:30:34.109+0000 7f3addf43640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T00:30:34.111 INFO:tasks.ceph.osd.6.smithi163.stderr:2024-05-04T00:30:34.113+0000 7f0b4ea1d640 -1 osd.6 0 waiting for initial osdmap 2024-05-04T00:30:34.114 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-05-04T00:30:34.114+0000 7fdd5b5f9640 -1 osd.2 0 waiting for initial osdmap 2024-05-04T00:30:34.136 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-05-04T00:30:34.134+0000 7f63880a6640 -1 osd.1 0 waiting for initial osdmap 2024-05-04T00:30:34.139 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-05-04T00:30:34.138+0000 7ff76a556640 -1 osd.0 0 waiting for initial osdmap 2024-05-04T00:30:34.163 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-05-04T00:30:34.162+0000 7f637f693640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T00:30:34.182 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-05-04T00:30:34.182+0000 7fdd533fa640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T00:30:34.198 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-05-04T00:30:34.198+0000 7ff762357640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T00:30:34.245 INFO:tasks.ceph.osd.6.smithi163.stderr:2024-05-04T00:30:34.245+0000 7f0b4681e640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T00:30:34.442 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-04T00:30:34.601 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.598+0000 7f1410cd3640 1 Processor -- start 2024-05-04T00:30:34.601 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.598+0000 7f1410cd3640 1 -- start start 2024-05-04T00:30:34.602 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.602+0000 7f1410cd3640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f140c0cd910 0x7f140c15ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:34.602 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.602+0000 7f1410cd3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f140c164a90 0x7f140c166eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:34.602 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.602+0000 7f1410cd3640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f140c15f7b0 con 0x7f140c0b4270 2024-05-04T00:30:34.603 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.602+0000 7f1410cd3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f140c0ccf10 con 0x7f140c164a90 2024-05-04T00:30:34.603 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.602+0000 7f1410cd3640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f140c0ccc50 con 0x7f140c0cd910 2024-05-04T00:30:34.604 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.602+0000 7f140a59c640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f140c0cd910 0x7f140c15ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:34.604 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.602+0000 7f1409d9b640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f140c0b4270 0x7f140c0d1980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:34124/0 (socket says 172.21.15.6:34124) 2024-05-04T00:30:34.604 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.602+0000 7f1409d9b640 1 -- 172.21.15.6:0/3847192703 learned_addr learned my addr 172.21.15.6:0/3847192703 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:30:34.611 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.610+0000 7f140a59c640 1 -- 172.21.15.6:0/3847192703 >> v2:172.21.15.6:3300/0 conn(0x7f140c164a90 msgr2=0x7f140c166eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:30:34.612 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.610+0000 7f140a59c640 1 --2- 172.21.15.6:0/3847192703 >> v2:172.21.15.6:3300/0 conn(0x7f140c164a90 0x7f140c166eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:34.612 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.610+0000 7f140a59c640 1 -- 172.21.15.6:0/3847192703 >> v1:172.21.15.163:6789/0 conn(0x7f140c0b4270 legacy=0x7f140c0d1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:30:34.612 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.610+0000 7f140a59c640 1 -- 172.21.15.6:0/3847192703 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140c15ccd0 con 0x7f140c0cd910 2024-05-04T00:30:34.663 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.662+0000 7f140a59c640 1 --2- 172.21.15.6:0/3847192703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f140c0cd910 0x7f140c15ff70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f140c06d840 tx=0x7f13fc01c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0f852fe3a42ba23 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:34.805 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.802+0000 7f140959a640 1 -- 172.21.15.6:0/3847192703 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc0b0070 con 0x7f140c0cd910 2024-05-04T00:30:34.805 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.802+0000 7f140959a640 1 -- 172.21.15.6:0/3847192703 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13fc0ab600 con 0x7f140c0cd910 2024-05-04T00:30:34.806 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.802+0000 7f140959a640 1 -- 172.21.15.6:0/3847192703 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc0ab9d0 con 0x7f140c0cd910 2024-05-04T00:30:34.807 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.806+0000 7f1410cd3640 1 -- 172.21.15.6:0/3847192703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f140c0cd910 msgr2=0x7f140c15ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:34.807 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.806+0000 7f1410cd3640 1 --2- 172.21.15.6:0/3847192703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f140c0cd910 0x7f140c15ff70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f140c06d840 tx=0x7f13fc01c440 comp rx=0 tx=0).stop 2024-05-04T00:30:34.807 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.806+0000 7f1410cd3640 1 -- 172.21.15.6:0/3847192703 shutdown_connections 2024-05-04T00:30:34.807 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.806+0000 7f1410cd3640 1 --2- 172.21.15.6:0/3847192703 >> v2:172.21.15.6:3300/0 conn(0x7f140c164a90 0x7f140c166eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:34.807 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.806+0000 7f1410cd3640 1 --2- 172.21.15.6:0/3847192703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f140c0cd910 0x7f140c15ff70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:34.807 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.806+0000 7f1410cd3640 1 -- 172.21.15.6:0/3847192703 >> 172.21.15.6:0/3847192703 conn(0x7f140c06da40 msgr2=0x7f140c06de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:34.807 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.806+0000 7f1410cd3640 1 -- 172.21.15.6:0/3847192703 shutdown_connections 2024-05-04T00:30:34.807 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.806+0000 7f1410cd3640 1 -- 172.21.15.6:0/3847192703 wait complete. 2024-05-04T00:30:34.809 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.806+0000 7f1410cd3640 1 Processor -- start 2024-05-04T00:30:34.809 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.810+0000 7f1410cd3640 1 -- start start 2024-05-04T00:30:34.811 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.810+0000 7f1410cd3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f140c0b4270 0x7f140c165240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:34.811 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.810+0000 7f1410cd3640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f140c0cd910 0x7f140c14ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:34.811 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.810+0000 7f1410cd3640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f140c164a90 0x7f140c166480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:34.811 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.810+0000 7f1410cd3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f140c0cc240 con 0x7f140c0b4270 2024-05-04T00:30:34.812 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.810+0000 7f1410cd3640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f140c0cc0c0 con 0x7f140c164a90 2024-05-04T00:30:34.812 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.810+0000 7f1410cd3640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f140c1604b0 con 0x7f140c0cd910 2024-05-04T00:30:34.812 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.810+0000 7f140ad9d640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f140c164a90 0x7f140c166480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:34.812 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.810+0000 7f140ad9d640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f140c164a90 0x7f140c166480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:33620/0 (socket says 172.21.15.6:33620) 2024-05-04T00:30:34.812 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.810+0000 7f140ad9d640 1 -- 172.21.15.6:0/1877490175 learned_addr learned my addr 172.21.15.6:0/1877490175 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:30:34.817 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.814+0000 7f140ad9d640 1 -- 172.21.15.6:0/1877490175 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f140c0cd910 msgr2=0x7f140c14ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:34.817 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.814+0000 7f140ad9d640 1 --2- 172.21.15.6:0/1877490175 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f140c0cd910 0x7f140c14ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:34.817 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.814+0000 7f140ad9d640 1 -- 172.21.15.6:0/1877490175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f140c0b4270 msgr2=0x7f140c165240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:34.817 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.814+0000 7f140ad9d640 1 --2- 172.21.15.6:0/1877490175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f140c0b4270 0x7f140c165240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:34.817 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.814+0000 7f140ad9d640 1 -- 172.21.15.6:0/1877490175 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140c15d2e0 con 0x7f140c164a90 2024-05-04T00:30:34.819 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.818+0000 7f140ad9d640 1 --2- 172.21.15.6:0/1877490175 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f140c164a90 0x7f140c166480 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f140400b390 tx=0x7f140400b850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:34.826 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.826+0000 7f13faffd640 1 -- 172.21.15.6:0/1877490175 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404015020 con 0x7f140c164a90 2024-05-04T00:30:34.826 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.826+0000 7f13faffd640 1 -- 172.21.15.6:0/1877490175 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1404011830 con 0x7f140c164a90 2024-05-04T00:30:34.826 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.826+0000 7f1410cd3640 1 -- 172.21.15.6:0/1877490175 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f140c15e570 con 0x7f140c164a90 2024-05-04T00:30:34.826 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.826+0000 7f13faffd640 1 -- 172.21.15.6:0/1877490175 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404011c20 con 0x7f140c164a90 2024-05-04T00:30:34.826 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.826+0000 7f1410cd3640 1 -- 172.21.15.6:0/1877490175 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f140c15eb30 con 0x7f140c164a90 2024-05-04T00:30:34.827 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:34.826+0000 7f1410cd3640 1 -- 172.21.15.6:0/1877490175 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f140c1f5f00 con 0x7f140c164a90 2024-05-04T00:30:35.180 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:35.178+0000 7f13faffd640 1 -- 172.21.15.6:0/1877490175 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7f1404018020 con 0x7f140c164a90 2024-05-04T00:30:35.181 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:35.178+0000 7f13faffd640 1 --2- 172.21.15.6:0/1877490175 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f13ec06f3c0 0x7f13ec0718d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:35.182 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:35.182+0000 7f140a59c640 1 --2- 172.21.15.6:0/1877490175 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f13ec06f3c0 0x7f13ec0718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:35.183 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:35.182+0000 7f140a59c640 1 --2- 172.21.15.6:0/1877490175 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f13ec06f3c0 0x7f13ec0718d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0ad000 tx=0x7f13fc004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:35.200 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:35.198+0000 7f13faffd640 1 -- 172.21.15.6:0/1877490175 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3071+0+0 (secure 0 0 0) 0x7f1404011dc0 con 0x7f140c164a90 2024-05-04T00:30:35.260 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:35.258+0000 7f13faffd640 1 -- 172.21.15.6:0/1877490175 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f140c1f5f00 con 0x7f140c164a90 2024-05-04T00:30:35.459 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:35.458+0000 7f1410cd3640 1 -- 172.21.15.6:0/1877490175 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f140c06a390 con 0x7f140c164a90 2024-05-04T00:30:36.021 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:36.018+0000 7f13faffd640 1 -- 172.21.15.6:0/1877490175 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8491 (secure 0 0 0) 0x7f140401f020 con 0x7f140c164a90 2024-05-04T00:30:36.022 INFO:teuthology.misc.health.smithi006.stdout: 2024-05-04T00:30:36.022 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":14,"fsid":"ad5951ed-0d5e-4770-b5d9-995e08a00213","created":"2024-05-04T00:30:11.236352+0000","modified":"2024-05-04T00:30:34.147996+0000","last_up_change":"2024-05-04T00:30:34.147996+0000","last_in_change":"2024-05-04T00:30:24.926330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a907d753-b7cf-499c-ae36-81e44ed933a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"eab41a32-d5f1-43b8-8835-f2d4bffc9cdb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f2540144-b533-4ffc-a9cf-24f0e4910a9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"982b7ace-fd02-4f03-aef2-0428468f8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6818","nonce":3149875909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6826","nonce":3149875909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6831","nonce":3149875909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6829","nonce":3149875909}]},"public_addr":"172.21.15.6:6818/3149875909","cluster_addr":"172.21.15.6:6826/3149875909","heartbeat_back_addr":"172.21.15.6:6831/3149875909","heartbeat_front_addr":"172.21.15.6:6829/3149875909","state":["exists","up"]},{"osd":4,"uuid":"ecf94166-cfdf-4ac8-a659-6ae907686e8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fc5cfa90-0e3a-4fc2-829c-5ff57d7a5953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6815","nonce":167619435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6820","nonce":167619435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6827","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6829","nonce":167619435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6825","nonce":167619435}]},"public_addr":"172.21.15.163:6815/167619435","cluster_addr":"172.21.15.163:6820/167619435","heartbeat_back_addr":"172.21.15.163:6829/167619435","heartbeat_front_addr":"172.21.15.163:6825/167619435","state":["exists","up"]},{"osd":6,"uuid":"ed95f0cf-f309-4861-b47c-4a5a6b44ffdc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2f57afcd-567f-44f6-9db7-df0342c8c4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6803","nonce":239650691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6805","nonce":239650691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6809","nonce":239650691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6807","nonce":239650691}]},"public_addr":"172.21.15.163:6803/239650691","cluster_addr":"172.21.15.163:6805/239650691","heartbeat_back_addr":"172.21.15.163:6809/239650691","heartbeat_front_addr":"172.21.15.163:6807/239650691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T00:30:36.024 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:36.022+0000 7f1410cd3640 1 -- 172.21.15.6:0/1877490175 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f13ec06f3c0 msgr2=0x7f13ec0718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:36.025 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:36.022+0000 7f1410cd3640 1 --2- 172.21.15.6:0/1877490175 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f13ec06f3c0 0x7f13ec0718d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0ad000 tx=0x7f13fc004740 comp rx=0 tx=0).stop 2024-05-04T00:30:36.025 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:36.022+0000 7f1410cd3640 1 -- 172.21.15.6:0/1877490175 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f140c164a90 msgr2=0x7f140c166480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:36.025 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:36.022+0000 7f1410cd3640 1 --2- 172.21.15.6:0/1877490175 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f140c164a90 0x7f140c166480 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f140400b390 tx=0x7f140400b850 comp rx=0 tx=0).stop 2024-05-04T00:30:36.025 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:36.022+0000 7f1410cd3640 1 -- 172.21.15.6:0/1877490175 shutdown_connections 2024-05-04T00:30:36.025 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:36.022+0000 7f1410cd3640 1 --2- 172.21.15.6:0/1877490175 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f140c164a90 0x7f140c166480 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:36.025 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:36.022+0000 7f1410cd3640 1 --2- 172.21.15.6:0/1877490175 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f13ec06f3c0 0x7f13ec0718d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:36.025 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:36.022+0000 7f1410cd3640 1 --2- 172.21.15.6:0/1877490175 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f140c0cd910 0x7f140c14ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:36.025 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:36.022+0000 7f1410cd3640 1 --2- 172.21.15.6:0/1877490175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f140c0b4270 0x7f140c165240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:36.025 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:36.022+0000 7f1410cd3640 1 -- 172.21.15.6:0/1877490175 >> 172.21.15.6:0/1877490175 conn(0x7f140c06da40 msgr2=0x7f140c0c7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:36.025 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:36.022+0000 7f1410cd3640 1 -- 172.21.15.6:0/1877490175 shutdown_connections 2024-05-04T00:30:36.025 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:36.022+0000 7f1410cd3640 1 -- 172.21.15.6:0/1877490175 wait complete. 2024-05-04T00:30:36.049 DEBUG:teuthology.misc:3 of 8 OSDs are up 2024-05-04T00:30:42.856 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-04T00:30:43.006 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:43.006+0000 7f50b384f640 1 Processor -- start 2024-05-04T00:30:43.007 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:43.006+0000 7f50b384f640 1 -- start start 2024-05-04T00:30:43.008 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:43.006+0000 7f50b384f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50ac15f7d0 0x7f50ac1564c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:43.008 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:43.006+0000 7f50b384f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50ac15d140 con 0x7f50ac06d670 2024-05-04T00:30:43.008 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:43.006+0000 7f50b384f640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50ac15fd80 con 0x7f50ac0631c0 2024-05-04T00:30:43.008 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:43.006+0000 7f50b384f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f50ac15c5a0 con 0x7f50ac15f7d0 2024-05-04T00:30:43.009 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:43.006+0000 7f50b0dea640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50ac15f7d0 0x7f50ac1564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:43.009 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:43.006+0000 7f50b1dec640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f50ac0631c0 0x7f50ac166b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:34134/0 (socket says 172.21.15.6:34134) 2024-05-04T00:30:43.009 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:43.010+0000 7f50b1dec640 1 -- 172.21.15.6:0/2726731859 learned_addr learned my addr 172.21.15.6:0/2726731859 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:30:43.015 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:43.014+0000 7f50b0dea640 1 -- 172.21.15.6:0/2726731859 >> v1:172.21.15.163:6789/0 conn(0x7f50ac0631c0 legacy=0x7f50ac166b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:43.015 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:43.014+0000 7f50b0dea640 1 -- 172.21.15.6:0/2726731859 >> v1:172.21.15.6:6789/0 conn(0x7f50ac06d670 legacy=0x7f50ac15ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:43.016 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:43.014+0000 7f50b0dea640 1 -- 172.21.15.6:0/2726731859 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ac160060 con 0x7f50ac15f7d0 2024-05-04T00:30:43.020 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:43.018+0000 7f50b0dea640 1 --2- 172.21.15.6:0/2726731859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50ac15f7d0 0x7f50ac1564c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f509c0097c0 tx=0x7f509c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a68a83b90596d37 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:48.174 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.170+0000 7f50a3fff640 1 -- 172.21.15.6:0/2726731859 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c0b5070 con 0x7f50ac15f7d0 2024-05-04T00:30:48.174 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.174+0000 7f50a3fff640 1 -- 172.21.15.6:0/2726731859 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f509c0a89b0 con 0x7f50ac15f7d0 2024-05-04T00:30:48.174 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.174+0000 7f50a3fff640 1 -- 172.21.15.6:0/2726731859 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c0a8de0 con 0x7f50ac15f7d0 2024-05-04T00:30:48.175 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.174+0000 7f50b384f640 1 -- 172.21.15.6:0/2726731859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50ac15f7d0 msgr2=0x7f50ac1564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:48.175 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.174+0000 7f50b384f640 1 --2- 172.21.15.6:0/2726731859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50ac15f7d0 0x7f50ac1564c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f509c0097c0 tx=0x7f509c01ec90 comp rx=0 tx=0).stop 2024-05-04T00:30:48.175 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.174+0000 7f50b384f640 1 -- 172.21.15.6:0/2726731859 shutdown_connections 2024-05-04T00:30:48.175 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.174+0000 7f50b384f640 1 --2- 172.21.15.6:0/2726731859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50ac15f7d0 0x7f50ac1564c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:48.175 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.174+0000 7f50b384f640 1 -- 172.21.15.6:0/2726731859 >> 172.21.15.6:0/2726731859 conn(0x7f50ac0cb380 msgr2=0x7f50ac0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:48.175 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.174+0000 7f50b384f640 1 -- 172.21.15.6:0/2726731859 shutdown_connections 2024-05-04T00:30:48.175 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.174+0000 7f50b384f640 1 -- 172.21.15.6:0/2726731859 wait complete. 2024-05-04T00:30:48.178 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.178+0000 7f50b384f640 1 Processor -- start 2024-05-04T00:30:48.178 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.178+0000 7f50b384f640 1 -- start start 2024-05-04T00:30:48.180 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.178+0000 7f50b384f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50ac0631c0 0x7f50ac1f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:48.180 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.178+0000 7f50b384f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f50ac06d670 0x7f50ac0cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:48.180 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.178+0000 7f50b384f640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f50ac15f7d0 0x7f50ac153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:48.180 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.178+0000 7f50b384f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f50ac15c1e0 con 0x7f50ac0631c0 2024-05-04T00:30:48.180 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.178+0000 7f50b384f640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f50ac160620 con 0x7f50ac15f7d0 2024-05-04T00:30:48.180 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.178+0000 7f50b384f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f50ac0c9920 con 0x7f50ac06d670 2024-05-04T00:30:48.181 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.182+0000 7f50b0dea640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f50ac06d670 0x7f50ac0cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:48.182 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.182+0000 7f50b0dea640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f50ac06d670 0x7f50ac0cd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:59178/0 (socket says 172.21.15.6:59178) 2024-05-04T00:30:48.182 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.182+0000 7f50b0dea640 1 -- 172.21.15.6:0/3371376801 learned_addr learned my addr 172.21.15.6:0/3371376801 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:30:48.187 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.186+0000 7f50b1dec640 1 --2- 172.21.15.6:0/3371376801 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f50ac15f7d0 0x7f50ac153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:48.193 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.190+0000 7f50b0dea640 1 -- 172.21.15.6:0/3371376801 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f50ac15f7d0 msgr2=0x7f50ac153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:48.193 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.190+0000 7f50b0dea640 1 --2- 172.21.15.6:0/3371376801 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f50ac15f7d0 0x7f50ac153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:48.193 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.190+0000 7f50b0dea640 1 -- 172.21.15.6:0/3371376801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50ac0631c0 msgr2=0x7f50ac1f30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:48.193 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.190+0000 7f50b0dea640 1 --2- 172.21.15.6:0/3371376801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50ac0631c0 0x7f50ac1f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:48.193 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.190+0000 7f50b0dea640 1 -- 172.21.15.6:0/3371376801 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ac1f3630 con 0x7f50ac06d670 2024-05-04T00:30:48.200 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.198+0000 7f50b0dea640 1 --2- 172.21.15.6:0/3371376801 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f50ac06d670 0x7f50ac0cd5d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f509c0097c0 tx=0x7f509c01ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:48.213 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.210+0000 7f50a1ffb640 1 -- 172.21.15.6:0/3371376801 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c0b5050 con 0x7f50ac06d670 2024-05-04T00:30:48.213 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.210+0000 7f50a1ffb640 1 -- 172.21.15.6:0/3371376801 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f509c003840 con 0x7f50ac06d670 2024-05-04T00:30:48.213 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.210+0000 7f50b384f640 1 -- 172.21.15.6:0/3371376801 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50ac1450a0 con 0x7f50ac06d670 2024-05-04T00:30:48.213 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.210+0000 7f50a1ffb640 1 -- 172.21.15.6:0/3371376801 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c003c30 con 0x7f50ac06d670 2024-05-04T00:30:48.213 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.210+0000 7f50b384f640 1 -- 172.21.15.6:0/3371376801 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f50ac15b350 con 0x7f50ac06d670 2024-05-04T00:30:48.215 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.214+0000 7f50b384f640 1 -- 172.21.15.6:0/3371376801 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50ac14b130 con 0x7f50ac06d670 2024-05-04T00:30:48.471 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:30:48.474 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:30:48.574 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.574+0000 7f50a1ffb640 1 -- 172.21.15.6:0/3371376801 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7f509c0b0440 con 0x7f50ac06d670 2024-05-04T00:30:48.575 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.574+0000 7f50a1ffb640 1 --2- 172.21.15.6:0/3371376801 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f509806f3f0 0x7f5098071900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:48.575 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.574+0000 7f50b15eb640 1 --2- 172.21.15.6:0/3371376801 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f509806f3f0 0x7f5098071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:48.576 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.574+0000 7f50b15eb640 1 --2- 172.21.15.6:0/3371376801 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f509806f3f0 0x7f5098071900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50a8007fd0 tx=0x7f50a8007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:30:48.582 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.582+0000 7f50a1ffb640 1 -- 172.21.15.6:0/3371376801 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f509c1002a0 con 0x7f50ac06d670 2024-05-04T00:30:48.606 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.606+0000 7f50a1ffb640 1 -- 172.21.15.6:0/3371376801 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f509c0bd030 con 0x7f50ac06d670 2024-05-04T00:30:48.795 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:48.790+0000 7f50b384f640 1 -- 172.21.15.6:0/3371376801 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50ac069b10 con 0x7f50ac06d670 2024-05-04T00:30:55.182 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:55.178+0000 7f50a1ffb640 1 -- 172.21.15.6:0/3371376801 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12812 (secure 0 0 0) 0x7f509c0187f0 con 0x7f50ac06d670 2024-05-04T00:30:55.182 INFO:teuthology.misc.health.smithi006.stdout: 2024-05-04T00:30:55.182 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":19,"fsid":"ad5951ed-0d5e-4770-b5d9-995e08a00213","created":"2024-05-04T00:30:11.236352+0000","modified":"2024-05-04T00:30:41.508418+0000","last_up_change":"2024-05-04T00:30:35.679943+0000","last_in_change":"2024-05-04T00:30:24.926330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T00:30:36.311072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a907d753-b7cf-499c-ae36-81e44ed933a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6805","nonce":489144503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6810","nonce":489144503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6824","nonce":489144503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6813","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6817","nonce":489144503}]},"public_addr":"172.21.15.6:6805/489144503","cluster_addr":"172.21.15.6:6810/489144503","heartbeat_back_addr":"172.21.15.6:6824/489144503","heartbeat_front_addr":"172.21.15.6:6817/489144503","state":["exists","up"]},{"osd":1,"uuid":"eab41a32-d5f1-43b8-8835-f2d4bffc9cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6802","nonce":3099957279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6807","nonce":3099957279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6819","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6823","nonce":3099957279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6815","nonce":3099957279}]},"public_addr":"172.21.15.6:6802/3099957279","cluster_addr":"172.21.15.6:6807/3099957279","heartbeat_back_addr":"172.21.15.6:6823/3099957279","heartbeat_front_addr":"172.21.15.6:6815/3099957279","state":["exists","up"]},{"osd":2,"uuid":"f2540144-b533-4ffc-a9cf-24f0e4910a9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6801","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6806","nonce":2770857903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6809","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6812","nonce":2770857903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6827","nonce":2770857903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6821","nonce":2770857903}]},"public_addr":"172.21.15.6:6806/2770857903","cluster_addr":"172.21.15.6:6812/2770857903","heartbeat_back_addr":"172.21.15.6:6827/2770857903","heartbeat_front_addr":"172.21.15.6:6821/2770857903","state":["exists","up"]},{"osd":3,"uuid":"982b7ace-fd02-4f03-aef2-0428468f8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6818","nonce":3149875909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6826","nonce":3149875909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6831","nonce":3149875909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6829","nonce":3149875909}]},"public_addr":"172.21.15.6:6818/3149875909","cluster_addr":"172.21.15.6:6826/3149875909","heartbeat_back_addr":"172.21.15.6:6831/3149875909","heartbeat_front_addr":"172.21.15.6:6829/3149875909","state":["exists","up"]},{"osd":4,"uuid":"ecf94166-cfdf-4ac8-a659-6ae907686e8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6818","nonce":2508264225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6821","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6824","nonce":2508264225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6833","nonce":2508264225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6831","nonce":2508264225}]},"public_addr":"172.21.15.163:6818/2508264225","cluster_addr":"172.21.15.163:6824/2508264225","heartbeat_back_addr":"172.21.15.163:6833/2508264225","heartbeat_front_addr":"172.21.15.163:6831/2508264225","state":["exists","up"]},{"osd":5,"uuid":"fc5cfa90-0e3a-4fc2-829c-5ff57d7a5953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6815","nonce":167619435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6820","nonce":167619435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6827","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6829","nonce":167619435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6825","nonce":167619435}]},"public_addr":"172.21.15.163:6815/167619435","cluster_addr":"172.21.15.163:6820/167619435","heartbeat_back_addr":"172.21.15.163:6829/167619435","heartbeat_front_addr":"172.21.15.163:6825/167619435","state":["exists","up"]},{"osd":6,"uuid":"ed95f0cf-f309-4861-b47c-4a5a6b44ffdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6811","nonce":1460767610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6813","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6814","nonce":1460767610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6830","nonce":1460767610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6819","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6822","nonce":1460767610}]},"public_addr":"172.21.15.163:6811/1460767610","cluster_addr":"172.21.15.163:6814/1460767610","heartbeat_back_addr":"172.21.15.163:6830/1460767610","heartbeat_front_addr":"172.21.15.163:6822/1460767610","state":["exists","up"]},{"osd":7,"uuid":"2f57afcd-567f-44f6-9db7-df0342c8c4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6803","nonce":239650691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6805","nonce":239650691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6809","nonce":239650691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6807","nonce":239650691}]},"public_addr":"172.21.15.163:6803/239650691","cluster_addr":"172.21.15.163:6805/239650691","heartbeat_back_addr":"172.21.15.163:6809/239650691","heartbeat_front_addr":"172.21.15.163:6807/239650691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.818870+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.749094+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.805522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.576430+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.740084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.755726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.797961+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.577731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T00:30:55.186 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:55.182+0000 7f50b384f640 1 -- 172.21.15.6:0/3371376801 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f509806f3f0 msgr2=0x7f5098071900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:55.186 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:55.182+0000 7f50b384f640 1 --2- 172.21.15.6:0/3371376801 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f509806f3f0 0x7f5098071900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50a8007fd0 tx=0x7f50a8007d40 comp rx=0 tx=0).stop 2024-05-04T00:30:55.186 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:55.182+0000 7f50b384f640 1 -- 172.21.15.6:0/3371376801 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f50ac06d670 msgr2=0x7f50ac0cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:55.186 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:55.182+0000 7f50b384f640 1 --2- 172.21.15.6:0/3371376801 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f50ac06d670 0x7f50ac0cd5d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f509c0097c0 tx=0x7f509c01ba30 comp rx=0 tx=0).stop 2024-05-04T00:30:55.186 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:55.186+0000 7f50b384f640 1 -- 172.21.15.6:0/3371376801 shutdown_connections 2024-05-04T00:30:55.186 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:55.186+0000 7f50b384f640 1 --2- 172.21.15.6:0/3371376801 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f50ac15f7d0 0x7f50ac153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:55.186 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:55.186+0000 7f50b384f640 1 --2- 172.21.15.6:0/3371376801 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f509806f3f0 0x7f5098071900 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:55.186 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:55.186+0000 7f50b384f640 1 --2- 172.21.15.6:0/3371376801 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f50ac06d670 0x7f50ac0cd5d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:55.186 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:55.186+0000 7f50b384f640 1 --2- 172.21.15.6:0/3371376801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50ac0631c0 0x7f50ac1f30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:30:55.187 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:55.186+0000 7f50b384f640 1 -- 172.21.15.6:0/3371376801 >> 172.21.15.6:0/3371376801 conn(0x7f50ac0cb380 msgr2=0x7f50ac0713b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:30:55.187 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:55.186+0000 7f50b384f640 1 -- 172.21.15.6:0/3371376801 shutdown_connections 2024-05-04T00:30:55.187 INFO:teuthology.misc.health.smithi006.stderr:2024-05-04T00:30:55.186+0000 7f50b384f640 1 -- 172.21.15.6:0/3371376801 wait complete. 2024-05-04T00:30:55.219 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-04T00:30:55.219 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-04T00:30:55.220 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-05-04T00:30:55.220 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-04T00:30:55.220 DEBUG:teuthology.orchestra.run.smithi006:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-05-04T00:30:55.222 INFO:tasks.ceph.mds.a:Started 2024-05-04T00:30:55.222 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-05-04T00:30:55.222 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-04T00:30:55.223 DEBUG:teuthology.orchestra.run.smithi006:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-05-04T00:30:55.225 INFO:tasks.ceph.mds.c:Started 2024-05-04T00:30:55.225 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-05-04T00:30:55.225 INFO:tasks.ceph.mds.e:Restarting daemon 2024-05-04T00:30:55.225 DEBUG:teuthology.orchestra.run.smithi006:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-05-04T00:30:55.227 INFO:tasks.ceph.mds.e:Started 2024-05-04T00:30:55.227 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-05-04T00:30:55.227 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-04T00:30:55.228 DEBUG:teuthology.orchestra.run.smithi163:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-05-04T00:30:55.230 INFO:tasks.ceph.mds.b:Started 2024-05-04T00:30:55.230 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-05-04T00:30:55.230 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-04T00:30:55.231 DEBUG:teuthology.orchestra.run.smithi163:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-05-04T00:30:55.233 INFO:tasks.ceph.mds.d:Started 2024-05-04T00:30:55.233 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-05-04T00:30:55.233 INFO:tasks.ceph.mds.f:Restarting daemon 2024-05-04T00:30:55.233 DEBUG:teuthology.orchestra.run.smithi163:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-05-04T00:30:55.236 INFO:tasks.ceph.mds.f:Started 2024-05-04T00:30:55.236 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-04T00:30:55.236 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T00:30:55.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:55.418+0000 7f59a7c67640 1 Processor -- start 2024-05-04T00:30:55.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:55.418+0000 7f59a7c67640 1 -- start start 2024-05-04T00:30:55.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:55.422+0000 7f59a7c67640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f59a013f400 0x7f59a0165810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:30:55.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:55.422+0000 7f59a7c67640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a013f810 con 0x7f59a013eff0 2024-05-04T00:30:55.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:55.422+0000 7f59a7c67640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a00c9220 con 0x7f59a00c79e0 2024-05-04T00:30:55.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:55.422+0000 7f59a7c67640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f59a0159e80 con 0x7f59a013f400 2024-05-04T00:30:55.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:55.422+0000 7f59a6204640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f59a013f400 0x7f59a0165810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:30:55.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:55.422+0000 7f59a6204640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f59a013f400 0x7f59a0165810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:41908/0 (socket says 172.21.15.6:41908) 2024-05-04T00:30:55.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:55.422+0000 7f59a6204640 1 -- 172.21.15.6:0/915781418 learned_addr learned my addr 172.21.15.6:0/915781418 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:30:55.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:55.430+0000 7f59a6204640 1 -- 172.21.15.6:0/915781418 >> v1:172.21.15.163:6789/0 conn(0x7f59a00c79e0 legacy=0x7f59a015d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:30:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:55.430+0000 7f59a6204640 1 -- 172.21.15.6:0/915781418 >> v1:172.21.15.6:6789/0 conn(0x7f59a013eff0 legacy=0x7f59a00cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:30:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:55.430+0000 7f59a6204640 1 -- 172.21.15.6:0/915781418 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a013faa0 con 0x7f59a013f400 2024-05-04T00:30:55.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:30:55.438+0000 7f59a6204640 1 --2- 172.21.15.6:0/915781418 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59a013f400 0x7f59a0165810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5998009e50 tx=0x7f599801f210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5c1db673d5330a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:00.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.206+0000 7f59a4a01640 1 -- 172.21.15.6:0/915781418 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59980b4070 con 0x7f59a013f400 2024-05-04T00:31:00.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.218+0000 7f59a4a01640 1 -- 172.21.15.6:0/915781418 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59980af400 con 0x7f59a013f400 2024-05-04T00:31:00.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.218+0000 7f59a4a01640 1 -- 172.21.15.6:0/915781418 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59980af830 con 0x7f59a013f400 2024-05-04T00:31:00.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.218+0000 7f59a7c67640 1 -- 172.21.15.6:0/915781418 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59a013f400 msgr2=0x7f59a0165810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:00.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.218+0000 7f59a7c67640 1 --2- 172.21.15.6:0/915781418 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59a013f400 0x7f59a0165810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5998009e50 tx=0x7f599801f210 comp rx=0 tx=0).stop 2024-05-04T00:31:00.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.218+0000 7f59a7c67640 1 -- 172.21.15.6:0/915781418 shutdown_connections 2024-05-04T00:31:00.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.218+0000 7f59a7c67640 1 --2- 172.21.15.6:0/915781418 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59a013f400 0x7f59a0165810 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:00.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.218+0000 7f59a7c67640 1 -- 172.21.15.6:0/915781418 >> 172.21.15.6:0/915781418 conn(0x7f59a006cb80 msgr2=0x7f59a006cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:00.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.218+0000 7f59a7c67640 1 -- 172.21.15.6:0/915781418 shutdown_connections 2024-05-04T00:31:00.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.218+0000 7f59a7c67640 1 -- 172.21.15.6:0/915781418 wait complete. 2024-05-04T00:31:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.222+0000 7f59a7c67640 1 Processor -- start 2024-05-04T00:31:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.222+0000 7f59a7c67640 1 -- start start 2024-05-04T00:31:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.222+0000 7f59a7c67640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59a00c79e0 0x7f59a015b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.222+0000 7f59a7c67640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59a013eff0 0x7f59a01f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.222+0000 7f59a7c67640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a013f400 0x7f59a0070d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.222+0000 7f59a7c67640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f59a015a420 con 0x7f59a013f400 2024-05-04T00:31:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.222+0000 7f59a7c67640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f59a015a140 con 0x7f59a00c79e0 2024-05-04T00:31:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.222+0000 7f59a7c67640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f59a015a700 con 0x7f59a013eff0 2024-05-04T00:31:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.226+0000 7f59a5202640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59a013eff0 0x7f59a01f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.226+0000 7f59a5202640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59a013eff0 0x7f59a01f4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:40110/0 (socket says 172.21.15.6:40110) 2024-05-04T00:31:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.226+0000 7f59a5202640 1 -- 172.21.15.6:0/1781638113 learned_addr learned my addr 172.21.15.6:0/1781638113 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.230+0000 7f59a5a03640 1 --2- 172.21.15.6:0/1781638113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59a00c79e0 0x7f59a015b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.230+0000 7f59a5202640 1 -- 172.21.15.6:0/1781638113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59a00c79e0 msgr2=0x7f59a015b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.230+0000 7f59a5202640 1 --2- 172.21.15.6:0/1781638113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59a00c79e0 0x7f59a015b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.230+0000 7f59a5202640 1 -- 172.21.15.6:0/1781638113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a013f400 msgr2=0x7f59a0070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.230+0000 7f59a5202640 1 --2- 172.21.15.6:0/1781638113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a013f400 0x7f59a0070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.230+0000 7f59a5202640 1 -- 172.21.15.6:0/1781638113 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a01e47d0 con 0x7f59a013eff0 2024-05-04T00:31:00.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.238+0000 7f59a5202640 1 --2- 172.21.15.6:0/1781638113 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59a013eff0 0x7f59a01f4e50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f599000b3f0 tx=0x7f599000b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:00.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.242+0000 7f59967fc640 1 -- 172.21.15.6:0/1781638113 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990015020 con 0x7f59a013eff0 2024-05-04T00:31:00.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.242+0000 7f59a7c67640 1 -- 172.21.15.6:0/1781638113 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a01f1910 con 0x7f59a013eff0 2024-05-04T00:31:00.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.242+0000 7f59a7c67640 1 -- 172.21.15.6:0/1781638113 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a01f4650 con 0x7f59a013eff0 2024-05-04T00:31:00.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.242+0000 7f59a7c67640 1 -- 172.21.15.6:0/1781638113 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a006d710 con 0x7f59a013eff0 2024-05-04T00:31:00.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.538+0000 7f59967fc640 1 -- 172.21.15.6:0/1781638113 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5990011830 con 0x7f59a013eff0 2024-05-04T00:31:00.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.538+0000 7f59967fc640 1 -- 172.21.15.6:0/1781638113 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990011c20 con 0x7f59a013eff0 2024-05-04T00:31:00.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.542+0000 7f59967fc640 1 -- 172.21.15.6:0/1781638113 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7f5990018020 con 0x7f59a013eff0 2024-05-04T00:31:00.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.542+0000 7f59967fc640 1 --2- 172.21.15.6:0/1781638113 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f598406f370 0x7f5984071880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:00.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.542+0000 7f59a5a03640 1 --2- 172.21.15.6:0/1781638113 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f598406f370 0x7f5984071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:00.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.542+0000 7f59a5a03640 1 --2- 172.21.15.6:0/1781638113 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f598406f370 0x7f5984071880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f599c000f70 tx=0x7f599c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:00.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.546+0000 7f59967fc640 1 -- 172.21.15.6:0/1781638113 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f5990011dc0 con 0x7f59a013eff0 2024-05-04T00:31:00.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.662+0000 7f59967fc640 1 -- 172.21.15.6:0/1781638113 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f599001f020 con 0x7f59a013eff0 2024-05-04T00:31:00.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:00.858+0000 7f59a7c67640 1 -- 172.21.15.6:0/1781638113 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59a0154300 con 0x7f59a013eff0 2024-05-04T00:31:03.633 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-05-04T00:31:03.765 INFO:tasks.ceph.mds.d.smithi163.stdout:starting mds.d at 2024-05-04T00:31:05.914 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-05-04T00:31:07.247 INFO:tasks.ceph.mds.b.smithi163.stdout:starting mds.b at 2024-05-04T00:31:07.254 INFO:tasks.ceph.mds.e.smithi006.stdout:starting mds.e at 2024-05-04T00:31:07.270 INFO:tasks.ceph.mds.f.smithi163.stdout:starting mds.f at 2024-05-04T00:31:12.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:12.537+0000 7f59967fc640 1 -- 172.21.15.6:0/1781638113 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5990058210 con 0x7f59a013eff0 2024-05-04T00:31:12.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:12.765+0000 7f59967fc640 1 -- 172.21.15.6:0/1781638113 <== mon.2 v2:172.21.15.163:3301/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f5990040550 con 0x7f59a013eff0 2024-05-04T00:31:12.768 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:31:12.768 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-05-04T00:31:12.768 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 1 2024-05-04T00:31:12.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:12.769+0000 7f59a7c67640 1 -- 172.21.15.6:0/1781638113 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f598406f370 msgr2=0x7f5984071880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:12.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:12.769+0000 7f59a7c67640 1 --2- 172.21.15.6:0/1781638113 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f598406f370 0x7f5984071880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f599c000f70 tx=0x7f599c009040 comp rx=0 tx=0).stop 2024-05-04T00:31:12.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:12.769+0000 7f59a7c67640 1 -- 172.21.15.6:0/1781638113 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59a013eff0 msgr2=0x7f59a01f4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:12.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:12.769+0000 7f59a7c67640 1 --2- 172.21.15.6:0/1781638113 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59a013eff0 0x7f59a01f4e50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f599000b3f0 tx=0x7f599000b8b0 comp rx=0 tx=0).stop 2024-05-04T00:31:12.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:12.769+0000 7f59a7c67640 1 -- 172.21.15.6:0/1781638113 shutdown_connections 2024-05-04T00:31:12.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:12.769+0000 7f59a7c67640 1 --2- 172.21.15.6:0/1781638113 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f598406f370 0x7f5984071880 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:12.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:12.769+0000 7f59a7c67640 1 --2- 172.21.15.6:0/1781638113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a013f400 0x7f59a0070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:12.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:12.769+0000 7f59a7c67640 1 --2- 172.21.15.6:0/1781638113 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59a013eff0 0x7f59a01f4e50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:12.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:12.769+0000 7f59a7c67640 1 --2- 172.21.15.6:0/1781638113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59a00c79e0 0x7f59a015b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:12.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:12.769+0000 7f59a7c67640 1 -- 172.21.15.6:0/1781638113 >> 172.21.15.6:0/1781638113 conn(0x7f59a006cb80 msgr2=0x7f59a00c88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:12.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:12.769+0000 7f59a7c67640 1 -- 172.21.15.6:0/1781638113 shutdown_connections 2024-05-04T00:31:12.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:12.769+0000 7f59a7c67640 1 -- 172.21.15.6:0/1781638113 wait complete. 2024-05-04T00:31:14.797 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T00:31:14.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.949+0000 7fe89906b640 1 Processor -- start 2024-05-04T00:31:14.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.949+0000 7fe89906b640 1 -- start start 2024-05-04T00:31:14.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.949+0000 7fe89906b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe894154010 0x7fe894073f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:14.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.949+0000 7fe89906b640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe8940c7b20 0x7fe8940c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:14.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.949+0000 7fe89906b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8940c9b30 con 0x7fe89415a2f0 2024-05-04T00:31:14.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.949+0000 7fe89906b640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fe894074930 con 0x7fe8940c7b20 2024-05-04T00:31:14.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.949+0000 7fe89906b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe8940ca1d0 con 0x7fe894154010 2024-05-04T00:31:14.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.949+0000 7fe892d9d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe894154010 0x7fe894073f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:14.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.949+0000 7fe892d9d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe894154010 0x7fe894073f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:47284/0 (socket says 172.21.15.6:47284) 2024-05-04T00:31:14.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.949+0000 7fe892d9d640 1 -- 172.21.15.6:0/2982165948 learned_addr learned my addr 172.21.15.6:0/2982165948 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:14.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.949+0000 7fe89259c640 1 --2- 172.21.15.6:0/2982165948 >> v2:172.21.15.163:3300/0 conn(0x7fe8940c7b20 0x7fe8940c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:14.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.953+0000 7fe892d9d640 1 -- 172.21.15.6:0/2982165948 >> v2:172.21.15.163:3300/0 conn(0x7fe8940c7b20 msgr2=0x7fe8940c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:14.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.953+0000 7fe892d9d640 1 --2- 172.21.15.6:0/2982165948 >> v2:172.21.15.163:3300/0 conn(0x7fe8940c7b20 0x7fe8940c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:14.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.953+0000 7fe892d9d640 1 -- 172.21.15.6:0/2982165948 >> v1:172.21.15.6:6789/0 conn(0x7fe89415a2f0 legacy=0x7fe89415a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:14.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.953+0000 7fe892d9d640 1 -- 172.21.15.6:0/2982165948 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8940c8f20 con 0x7fe894154010 2024-05-04T00:31:14.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.957+0000 7fe892d9d640 1 --2- 172.21.15.6:0/2982165948 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe894154010 0x7fe894073f80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe8840098a0 tx=0x7fe88401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa017b7f86a3c3ef server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:14.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.965+0000 7fe891d9b640 1 -- 172.21.15.6:0/2982165948 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8840b0070 con 0x7fe894154010 2024-05-04T00:31:14.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.965+0000 7fe891d9b640 1 -- 172.21.15.6:0/2982165948 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8840ab600 con 0x7fe894154010 2024-05-04T00:31:14.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.965+0000 7fe891d9b640 1 -- 172.21.15.6:0/2982165948 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8840ab9d0 con 0x7fe894154010 2024-05-04T00:31:14.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.965+0000 7fe89906b640 1 -- 172.21.15.6:0/2982165948 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe894154010 msgr2=0x7fe894073f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:14.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.965+0000 7fe89906b640 1 --2- 172.21.15.6:0/2982165948 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe894154010 0x7fe894073f80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe8840098a0 tx=0x7fe88401c4b0 comp rx=0 tx=0).stop 2024-05-04T00:31:14.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.965+0000 7fe89906b640 1 -- 172.21.15.6:0/2982165948 shutdown_connections 2024-05-04T00:31:14.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.965+0000 7fe89906b640 1 --2- 172.21.15.6:0/2982165948 >> v2:172.21.15.163:3300/0 conn(0x7fe8940c7b20 0x7fe8940c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:14.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.965+0000 7fe89906b640 1 --2- 172.21.15.6:0/2982165948 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe894154010 0x7fe894073f80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:14.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.965+0000 7fe89906b640 1 -- 172.21.15.6:0/2982165948 >> 172.21.15.6:0/2982165948 conn(0x7fe8940ce410 msgr2=0x7fe8940ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:14.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.965+0000 7fe89906b640 1 -- 172.21.15.6:0/2982165948 shutdown_connections 2024-05-04T00:31:14.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.965+0000 7fe89906b640 1 -- 172.21.15.6:0/2982165948 wait complete. 2024-05-04T00:31:14.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.969+0000 7fe89906b640 1 Processor -- start 2024-05-04T00:31:14.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.969+0000 7fe89906b640 1 -- start start 2024-05-04T00:31:14.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.969+0000 7fe89906b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe8940c7b20 0x7fe894145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:14.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.969+0000 7fe89906b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe894154010 0x7fe894141f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:14.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.969+0000 7fe89906b640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe89415a2f0 0x7fe894146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:14.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.969+0000 7fe89906b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe89406c780 con 0x7fe894154010 2024-05-04T00:31:14.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.969+0000 7fe89906b640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe894154420 con 0x7fe89415a2f0 2024-05-04T00:31:14.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.969+0000 7fe89906b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe8940744c0 con 0x7fe8940c7b20 2024-05-04T00:31:14.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.973+0000 7fe892d9d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe8940c7b20 0x7fe894145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:14.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.973+0000 7fe892d9d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe8940c7b20 0x7fe894145200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:47300/0 (socket says 172.21.15.6:47300) 2024-05-04T00:31:14.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.973+0000 7fe892d9d640 1 -- 172.21.15.6:0/4150557894 learned_addr learned my addr 172.21.15.6:0/4150557894 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:14.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.973+0000 7fe89359e640 1 --2- 172.21.15.6:0/4150557894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe89415a2f0 0x7fe894146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:14.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.977+0000 7fe892d9d640 1 -- 172.21.15.6:0/4150557894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe89415a2f0 msgr2=0x7fe894146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:14.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.977+0000 7fe892d9d640 1 --2- 172.21.15.6:0/4150557894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe89415a2f0 0x7fe894146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:14.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.977+0000 7fe892d9d640 1 -- 172.21.15.6:0/4150557894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe894154010 msgr2=0x7fe894141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:14.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.977+0000 7fe892d9d640 1 --2- 172.21.15.6:0/4150557894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe894154010 0x7fe894141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:14.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.977+0000 7fe892d9d640 1 -- 172.21.15.6:0/4150557894 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe894145740 con 0x7fe8940c7b20 2024-05-04T00:31:14.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.977+0000 7fe892d9d640 1 --2- 172.21.15.6:0/4150557894 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe8940c7b20 0x7fe894145200 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe88401c2e0 tx=0x7fe884019250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:14.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.981+0000 7fe87b7fe640 1 -- 172.21.15.6:0/4150557894 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8840b9020 con 0x7fe8940c7b20 2024-05-04T00:31:14.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.981+0000 7fe89906b640 1 -- 172.21.15.6:0/4150557894 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8941f7b60 con 0x7fe8940c7b20 2024-05-04T00:31:14.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.981+0000 7fe89906b640 1 -- 172.21.15.6:0/4150557894 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8941f75a0 con 0x7fe8940c7b20 2024-05-04T00:31:14.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.981+0000 7fe89906b640 1 -- 172.21.15.6:0/4150557894 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe894069a50 con 0x7fe8940c7b20 2024-05-04T00:31:14.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.985+0000 7fe87b7fe640 1 -- 172.21.15.6:0/4150557894 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8840b1040 con 0x7fe8940c7b20 2024-05-04T00:31:14.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:14.985+0000 7fe87b7fe640 1 -- 172.21.15.6:0/4150557894 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8840b0050 con 0x7fe8940c7b20 2024-05-04T00:31:15.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.325+0000 7fe87b7fe640 1 -- 172.21.15.6:0/4150557894 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe8840bc020 con 0x7fe8940c7b20 2024-05-04T00:31:15.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.325+0000 7fe87b7fe640 1 --2- 172.21.15.6:0/4150557894 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe88006f400 0x7fe880071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:15.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.325+0000 7fe89259c640 1 --2- 172.21.15.6:0/4150557894 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe88006f400 0x7fe880071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:15.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.329+0000 7fe89259c640 1 --2- 172.21.15.6:0/4150557894 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe88006f400 0x7fe880071910 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe888006aa0 tx=0x7fe888006a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:15.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.329+0000 7fe87b7fe640 1 -- 172.21.15.6:0/4150557894 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fe8840fc480 con 0x7fe8940c7b20 2024-05-04T00:31:15.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.425+0000 7fe87b7fe640 1 -- 172.21.15.6:0/4150557894 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe8840c3070 con 0x7fe8940c7b20 2024-05-04T00:31:15.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.633+0000 7fe89906b640 1 -- 172.21.15.6:0/4150557894 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe894157950 con 0x7fe8940c7b20 2024-05-04T00:31:15.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.653+0000 7fe87b7fe640 1 -- 172.21.15.6:0/4150557894 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5497 (secure 0 0 0) 0x7fe884016130 con 0x7fe8940c7b20 2024-05-04T00:31:15.654 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:31:15.655 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4185,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/811470677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":811470677},{"type":"v1","addr":"172.21.15.6:6833","nonce":811470677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4194,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/50303985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":50303985},{"type":"v1","addr":"172.21.15.163:6839","nonce":50303985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2015777060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2015777060},{"type":"v1","addr":"172.21.15.6:6835","nonce":2015777060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/428471443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":428471443},{"type":"v1","addr":"172.21.15.163:6835","nonce":428471443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1055589916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1055589916},{"type":"v1","addr":"172.21.15.163:6837","nonce":1055589916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/639743836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":639743836},{"type":"v1","addr":"172.21.15.6:6837","nonce":639743836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-04T00:31:15.655 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 3 2024-05-04T00:31:15.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.653+0000 7fe89906b640 1 -- 172.21.15.6:0/4150557894 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe88006f400 msgr2=0x7fe880071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:15.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.653+0000 7fe89906b640 1 --2- 172.21.15.6:0/4150557894 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe88006f400 0x7fe880071910 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe888006aa0 tx=0x7fe888006a30 comp rx=0 tx=0).stop 2024-05-04T00:31:15.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.653+0000 7fe89906b640 1 -- 172.21.15.6:0/4150557894 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe8940c7b20 msgr2=0x7fe894145200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:15.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.653+0000 7fe89906b640 1 --2- 172.21.15.6:0/4150557894 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe8940c7b20 0x7fe894145200 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe88401c2e0 tx=0x7fe884019250 comp rx=0 tx=0).stop 2024-05-04T00:31:15.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.653+0000 7fe89906b640 1 -- 172.21.15.6:0/4150557894 shutdown_connections 2024-05-04T00:31:15.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.653+0000 7fe89906b640 1 --2- 172.21.15.6:0/4150557894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe89415a2f0 0x7fe894146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:15.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.653+0000 7fe89906b640 1 --2- 172.21.15.6:0/4150557894 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe88006f400 0x7fe880071910 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:15.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.653+0000 7fe89906b640 1 --2- 172.21.15.6:0/4150557894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe894154010 0x7fe894141f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:15.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.653+0000 7fe89906b640 1 --2- 172.21.15.6:0/4150557894 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe8940c7b20 0x7fe894145200 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:15.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.653+0000 7fe89906b640 1 -- 172.21.15.6:0/4150557894 >> 172.21.15.6:0/4150557894 conn(0x7fe8940ce410 msgr2=0x7fe894152fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:15.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.653+0000 7fe89906b640 1 -- 172.21.15.6:0/4150557894 shutdown_connections 2024-05-04T00:31:15.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.653+0000 7fe89906b640 1 -- 172.21.15.6:0/4150557894 wait complete. 2024-05-04T00:31:15.677 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-04T00:31:15.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.829+0000 7f4d7a0af640 1 Processor -- start 2024-05-04T00:31:15.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.829+0000 7f4d7a0af640 1 -- start start 2024-05-04T00:31:15.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.829+0000 7f4d7a0af640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f4d740709d0 0x7f4d741541a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:15.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.829+0000 7f4d7a0af640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d7406f860 0x7f4d7406fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:15.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.829+0000 7f4d7a0af640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d7415aac0 con 0x7f4d740c4890 2024-05-04T00:31:15.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.829+0000 7f4d7a0af640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f4d740c81e0 con 0x7f4d7406f860 2024-05-04T00:31:15.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.829+0000 7f4d7a0af640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f4d740c7b90 con 0x7f4d740709d0 2024-05-04T00:31:15.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.829+0000 7f4d73fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d7406f860 0x7f4d7406fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:15.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.829+0000 7f4d72ffd640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f4d740709d0 0x7f4d741541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:15.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.829+0000 7f4d73fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d7406f860 0x7f4d7406fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49854/0 (socket says 172.21.15.6:49854) 2024-05-04T00:31:15.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.829+0000 7f4d73fff640 1 -- 172.21.15.6:0/2534065385 learned_addr learned my addr 172.21.15.6:0/2534065385 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:15.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.833+0000 7f4d73fff640 1 -- 172.21.15.6:0/2534065385 >> v2:172.21.15.163:3300/0 conn(0x7f4d740709d0 msgr2=0x7f4d741541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:15.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.833+0000 7f4d73fff640 1 --2- 172.21.15.6:0/2534065385 >> v2:172.21.15.163:3300/0 conn(0x7f4d740709d0 0x7f4d741541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:15.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.833+0000 7f4d73fff640 1 -- 172.21.15.6:0/2534065385 >> v1:172.21.15.6:6789/0 conn(0x7f4d740c4890 legacy=0x7f4d740c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:15.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.833+0000 7f4d73fff640 1 -- 172.21.15.6:0/2534065385 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d740c7e70 con 0x7f4d7406f860 2024-05-04T00:31:15.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.841+0000 7f4d73fff640 1 --2- 172.21.15.6:0/2534065385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d7406f860 0x7f4d7406fc70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4d740ca3f0 tx=0x7f4d6c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2d623b1c65fb0e server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:15.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.845+0000 7f4d727fc640 1 -- 172.21.15.6:0/2534065385 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c0b0070 con 0x7f4d7406f860 2024-05-04T00:31:15.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.845+0000 7f4d727fc640 1 -- 172.21.15.6:0/2534065385 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d6c0ab600 con 0x7f4d7406f860 2024-05-04T00:31:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.845+0000 7f4d727fc640 1 -- 172.21.15.6:0/2534065385 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c0ab9d0 con 0x7f4d7406f860 2024-05-04T00:31:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.849+0000 7f4d7a0af640 1 -- 172.21.15.6:0/2534065385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d7406f860 msgr2=0x7f4d7406fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.849+0000 7f4d7a0af640 1 --2- 172.21.15.6:0/2534065385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d7406f860 0x7f4d7406fc70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4d740ca3f0 tx=0x7f4d6c01c400 comp rx=0 tx=0).stop 2024-05-04T00:31:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.849+0000 7f4d7a0af640 1 -- 172.21.15.6:0/2534065385 shutdown_connections 2024-05-04T00:31:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.849+0000 7f4d7a0af640 1 --2- 172.21.15.6:0/2534065385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d7406f860 0x7f4d7406fc70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.849+0000 7f4d7a0af640 1 --2- 172.21.15.6:0/2534065385 >> v2:172.21.15.163:3300/0 conn(0x7f4d740709d0 0x7f4d741541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.849+0000 7f4d7a0af640 1 -- 172.21.15.6:0/2534065385 >> 172.21.15.6:0/2534065385 conn(0x7f4d7406cf70 msgr2=0x7f4d740c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.849+0000 7f4d7a0af640 1 -- 172.21.15.6:0/2534065385 shutdown_connections 2024-05-04T00:31:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.849+0000 7f4d7a0af640 1 -- 172.21.15.6:0/2534065385 wait complete. 2024-05-04T00:31:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.849+0000 7f4d7a0af640 1 Processor -- start 2024-05-04T00:31:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.849+0000 7f4d7a0af640 1 -- start start 2024-05-04T00:31:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.853+0000 7f4d7a0af640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d7406f860 0x7f4d74155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.853+0000 7f4d7a0af640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d740709d0 0x7f4d74154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.853+0000 7f4d7a0af640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d740c4890 0x7f4d741431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.853+0000 7f4d7a0af640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4d741671c0 con 0x7f4d740709d0 2024-05-04T00:31:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.853+0000 7f4d7a0af640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f4d74167040 con 0x7f4d740c4890 2024-05-04T00:31:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.853+0000 7f4d7a0af640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f4d74167340 con 0x7f4d7406f860 2024-05-04T00:31:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.853+0000 7f4d72ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d740709d0 0x7f4d74154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.853+0000 7f4d72ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d740709d0 0x7f4d74154960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49856/0 (socket says 172.21.15.6:49856) 2024-05-04T00:31:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.853+0000 7f4d72ffd640 1 -- 172.21.15.6:0/2988549015 learned_addr learned my addr 172.21.15.6:0/2988549015 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.853+0000 7f4d737fe640 1 --2- 172.21.15.6:0/2988549015 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d7406f860 0x7f4d74155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.853+0000 7f4d73fff640 1 --2- 172.21.15.6:0/2988549015 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d740c4890 0x7f4d741431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:15.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.857+0000 7f4d72ffd640 1 -- 172.21.15.6:0/2988549015 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d7406f860 msgr2=0x7f4d74155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:15.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.857+0000 7f4d72ffd640 1 --2- 172.21.15.6:0/2988549015 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d7406f860 0x7f4d74155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:15.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.857+0000 7f4d72ffd640 1 -- 172.21.15.6:0/2988549015 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d740c4890 msgr2=0x7f4d741431a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:15.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.857+0000 7f4d72ffd640 1 --2- 172.21.15.6:0/2988549015 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d740c4890 0x7f4d741431a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:15.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.857+0000 7f4d72ffd640 1 -- 172.21.15.6:0/2988549015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d74141480 con 0x7f4d740709d0 2024-05-04T00:31:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.861+0000 7f4d72ffd640 1 --2- 172.21.15.6:0/2988549015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d740709d0 0x7f4d74154960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00e840 tx=0x7f4d5c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:15.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.865+0000 7f4d6bfff640 1 -- 172.21.15.6:0/2988549015 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c017070 con 0x7f4d740709d0 2024-05-04T00:31:15.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.865+0000 7f4d6bfff640 1 -- 172.21.15.6:0/2988549015 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5c00ee90 con 0x7f4d740709d0 2024-05-04T00:31:15.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.865+0000 7f4d6bfff640 1 -- 172.21.15.6:0/2988549015 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c00cb80 con 0x7f4d740709d0 2024-05-04T00:31:15.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.865+0000 7f4d7a0af640 1 -- 172.21.15.6:0/2988549015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d74150ea0 con 0x7f4d740709d0 2024-05-04T00:31:15.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.865+0000 7f4d7a0af640 1 -- 172.21.15.6:0/2988549015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d74141740 con 0x7f4d740709d0 2024-05-04T00:31:15.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:15.865+0000 7f4d7a0af640 1 -- 172.21.15.6:0/2988549015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d7406a390 con 0x7f4d740709d0 2024-05-04T00:31:16.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.165+0000 7f4d6bfff640 1 -- 172.21.15.6:0/2988549015 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4d5c01a070 con 0x7f4d740709d0 2024-05-04T00:31:16.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.165+0000 7f4d6bfff640 1 --2- 172.21.15.6:0/2988549015 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f4d5406f450 0x7f4d54071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:16.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.169+0000 7f4d737fe640 1 --2- 172.21.15.6:0/2988549015 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f4d5406f450 0x7f4d54071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:16.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.169+0000 7f4d737fe640 1 --2- 172.21.15.6:0/2988549015 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f4d5406f450 0x7f4d54071960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4d64001e40 tx=0x7f4d64009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:16.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.209+0000 7f4d6bfff640 1 -- 172.21.15.6:0/2988549015 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f4d5c00cd20 con 0x7f4d740709d0 2024-05-04T00:31:16.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.209+0000 7f4d6bfff640 1 -- 172.21.15.6:0/2988549015 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4d5c05c1c0 con 0x7f4d740709d0 2024-05-04T00:31:16.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.409+0000 7f4d7a0af640 1 -- 172.21.15.6:0/2988549015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4d741578c0 con 0x7f4d740709d0 2024-05-04T00:31:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.417+0000 7f4d6bfff640 1 -- 172.21.15.6:0/2988549015 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f4d5c0604c0 con 0x7f4d740709d0 2024-05-04T00:31:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:31:16.419 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-05-04T00:31:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-04T00:31:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-05-04T00:31:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-05-04T00:31:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-04T00:31:16.420 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-05-04T00:31:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.421+0000 7f4d7a0af640 1 -- 172.21.15.6:0/2988549015 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f4d5406f450 msgr2=0x7f4d54071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.421+0000 7f4d7a0af640 1 --2- 172.21.15.6:0/2988549015 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f4d5406f450 0x7f4d54071960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4d64001e40 tx=0x7f4d64009040 comp rx=0 tx=0).stop 2024-05-04T00:31:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.421+0000 7f4d7a0af640 1 -- 172.21.15.6:0/2988549015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d740709d0 msgr2=0x7f4d74154960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.421+0000 7f4d7a0af640 1 --2- 172.21.15.6:0/2988549015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d740709d0 0x7f4d74154960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00e840 tx=0x7f4d5c00ec40 comp rx=0 tx=0).stop 2024-05-04T00:31:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.421+0000 7f4d7a0af640 1 -- 172.21.15.6:0/2988549015 shutdown_connections 2024-05-04T00:31:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.421+0000 7f4d7a0af640 1 --2- 172.21.15.6:0/2988549015 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d740c4890 0x7f4d741431a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.421+0000 7f4d7a0af640 1 --2- 172.21.15.6:0/2988549015 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f4d5406f450 0x7f4d54071960 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.421+0000 7f4d7a0af640 1 --2- 172.21.15.6:0/2988549015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d740709d0 0x7f4d74154960 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.421+0000 7f4d7a0af640 1 --2- 172.21.15.6:0/2988549015 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d7406f860 0x7f4d74155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.421+0000 7f4d7a0af640 1 -- 172.21.15.6:0/2988549015 >> 172.21.15.6:0/2988549015 conn(0x7f4d7406cf70 msgr2=0x7f4d740cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.421+0000 7f4d7a0af640 1 -- 172.21.15.6:0/2988549015 shutdown_connections 2024-05-04T00:31:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.421+0000 7f4d7a0af640 1 -- 172.21.15.6:0/2988549015 wait complete. 2024-05-04T00:31:16.441 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-04T00:31:16.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-04T00:31:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.601+0000 7fe35a03f640 1 Processor -- start 2024-05-04T00:31:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.601+0000 7fe35a03f640 1 -- start start 2024-05-04T00:31:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.601+0000 7fe35a03f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe354156580 0x7fe3540631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.601+0000 7fe35a03f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3540637e0 con 0x7fe35415cac0 2024-05-04T00:31:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.601+0000 7fe35a03f640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe354063aa0 con 0x7fe35406c830 2024-05-04T00:31:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.601+0000 7fe35a03f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe3540c97c0 con 0x7fe354156580 2024-05-04T00:31:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.629+0000 7fe3537fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe354156580 0x7fe3540631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.629+0000 7fe3537fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe354156580 0x7fe3540631c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49864/0 (socket says 172.21.15.6:49864) 2024-05-04T00:31:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.629+0000 7fe3537fe640 1 -- 172.21.15.6:0/1588991927 learned_addr learned my addr 172.21.15.6:0/1588991927 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:16.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.633+0000 7fe3537fe640 1 -- 172.21.15.6:0/1588991927 >> v1:172.21.15.163:6789/0 conn(0x7fe35406c830 legacy=0x7fe3541669c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:16.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.633+0000 7fe3537fe640 1 -- 172.21.15.6:0/1588991927 >> v1:172.21.15.6:6789/0 conn(0x7fe35415cac0 legacy=0x7fe3540c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:16.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.633+0000 7fe3537fe640 1 -- 172.21.15.6:0/1588991927 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe35415f880 con 0x7fe354156580 2024-05-04T00:31:16.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.641+0000 7fe3537fe640 1 --2- 172.21.15.6:0/1588991927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe354156580 0x7fe3540631c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe344009e50 tx=0x7fe34401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ce6d697daafd13 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:16.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.661+0000 7fe3527fc640 1 -- 172.21.15.6:0/1588991927 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3440a5760 con 0x7fe354156580 2024-05-04T00:31:16.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.661+0000 7fe3527fc640 1 -- 172.21.15.6:0/1588991927 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3440a5900 con 0x7fe354156580 2024-05-04T00:31:16.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.661+0000 7fe3527fc640 1 -- 172.21.15.6:0/1588991927 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3440a5cd0 con 0x7fe354156580 2024-05-04T00:31:16.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.665+0000 7fe35a03f640 1 -- 172.21.15.6:0/1588991927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe354156580 msgr2=0x7fe3540631c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:16.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.665+0000 7fe35a03f640 1 --2- 172.21.15.6:0/1588991927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe354156580 0x7fe3540631c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe344009e50 tx=0x7fe34401ca30 comp rx=0 tx=0).stop 2024-05-04T00:31:16.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.665+0000 7fe35a03f640 1 -- 172.21.15.6:0/1588991927 shutdown_connections 2024-05-04T00:31:16.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.665+0000 7fe35a03f640 1 --2- 172.21.15.6:0/1588991927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe354156580 0x7fe3540631c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:16.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.665+0000 7fe35a03f640 1 -- 172.21.15.6:0/1588991927 >> 172.21.15.6:0/1588991927 conn(0x7fe3540ce310 msgr2=0x7fe3540ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:16.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.665+0000 7fe35a03f640 1 -- 172.21.15.6:0/1588991927 shutdown_connections 2024-05-04T00:31:16.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.665+0000 7fe35a03f640 1 -- 172.21.15.6:0/1588991927 wait complete. 2024-05-04T00:31:16.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.669+0000 7fe35a03f640 1 Processor -- start 2024-05-04T00:31:16.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.669+0000 7fe35a03f640 1 -- start start 2024-05-04T00:31:16.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.669+0000 7fe35a03f640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe35406c830 0x7fe3540c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:16.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.669+0000 7fe35a03f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe354156580 0x7fe354152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:16.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.669+0000 7fe35a03f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe35415cac0 0x7fe3541461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:16.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.669+0000 7fe35a03f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe354160360 con 0x7fe354156580 2024-05-04T00:31:16.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.669+0000 7fe35a03f640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe35406d050 con 0x7fe35406c830 2024-05-04T00:31:16.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.669+0000 7fe35a03f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe3541f91b0 con 0x7fe35415cac0 2024-05-04T00:31:16.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.673+0000 7fe352ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe354156580 0x7fe354152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:16.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.673+0000 7fe353fff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe35415cac0 0x7fe3541461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:16.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.673+0000 7fe352ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe354156580 0x7fe354152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49872/0 (socket says 172.21.15.6:49872) 2024-05-04T00:31:16.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.673+0000 7fe352ffd640 1 -- 172.21.15.6:0/1501790624 learned_addr learned my addr 172.21.15.6:0/1501790624 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:16.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.673+0000 7fe3537fe640 1 --2- 172.21.15.6:0/1501790624 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe35406c830 0x7fe3540c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.677+0000 7fe352ffd640 1 -- 172.21.15.6:0/1501790624 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe35415cac0 msgr2=0x7fe3541461e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.677+0000 7fe352ffd640 1 --2- 172.21.15.6:0/1501790624 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe35415cac0 0x7fe3541461e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.677+0000 7fe352ffd640 1 -- 172.21.15.6:0/1501790624 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe35406c830 msgr2=0x7fe3540c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.677+0000 7fe352ffd640 1 --2- 172.21.15.6:0/1501790624 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe35406c830 0x7fe3540c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.677+0000 7fe352ffd640 1 -- 172.21.15.6:0/1501790624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3541530b0 con 0x7fe354156580 2024-05-04T00:31:16.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.681+0000 7fe352ffd640 1 --2- 172.21.15.6:0/1501790624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe354156580 0x7fe354152b70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00b3e0 tx=0x7fe33c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.685+0000 7fe34bfff640 1 -- 172.21.15.6:0/1501790624 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c015020 con 0x7fe354156580 2024-05-04T00:31:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.685+0000 7fe34bfff640 1 -- 172.21.15.6:0/1501790624 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe33c011830 con 0x7fe354156580 2024-05-04T00:31:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.685+0000 7fe35a03f640 1 -- 172.21.15.6:0/1501790624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe354151300 con 0x7fe354156580 2024-05-04T00:31:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.685+0000 7fe34bfff640 1 -- 172.21.15.6:0/1501790624 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c011c60 con 0x7fe354156580 2024-05-04T00:31:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.685+0000 7fe35a03f640 1 -- 172.21.15.6:0/1501790624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe35415f0f0 con 0x7fe354156580 2024-05-04T00:31:16.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.689+0000 7fe35a03f640 1 -- 172.21.15.6:0/1501790624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe354151060 con 0x7fe354156580 2024-05-04T00:31:16.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.713+0000 7fe34bfff640 1 -- 172.21.15.6:0/1501790624 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe33c018020 con 0x7fe354156580 2024-05-04T00:31:16.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.717+0000 7fe34bfff640 1 --2- 172.21.15.6:0/1501790624 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe33406f430 0x7fe334071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:16.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.717+0000 7fe3537fe640 1 --2- 172.21.15.6:0/1501790624 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe33406f430 0x7fe334071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:16.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.717+0000 7fe3537fe640 1 --2- 172.21.15.6:0/1501790624 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe33406f430 0x7fe334071940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe3440ae000 tx=0x7fe3440a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:16.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:16.717+0000 7fe34bfff640 1 -- 172.21.15.6:0/1501790624 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fe33c011e00 con 0x7fe354156580 2024-05-04T00:31:17.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:17.005+0000 7fe34bfff640 1 -- 172.21.15.6:0/1501790624 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe354151060 con 0x7fe354156580 2024-05-04T00:31:17.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:17.209+0000 7fe35a03f640 1 -- 172.21.15.6:0/1501790624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe354069a50 con 0x7fe354156580 2024-05-04T00:31:18.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.001+0000 7fe34bfff640 1 -- 172.21.15.6:0/1501790624 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7fe33c01f020 con 0x7fe354156580 2024-05-04T00:31:18.006 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-05-04T00:31:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.005+0000 7fe35a03f640 1 -- 172.21.15.6:0/1501790624 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe33406f430 msgr2=0x7fe334071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.005+0000 7fe35a03f640 1 --2- 172.21.15.6:0/1501790624 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe33406f430 0x7fe334071940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe3440ae000 tx=0x7fe3440a7070 comp rx=0 tx=0).stop 2024-05-04T00:31:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.005+0000 7fe35a03f640 1 -- 172.21.15.6:0/1501790624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe354156580 msgr2=0x7fe354152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.005+0000 7fe35a03f640 1 --2- 172.21.15.6:0/1501790624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe354156580 0x7fe354152b70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00b3e0 tx=0x7fe33c00b8a0 comp rx=0 tx=0).stop 2024-05-04T00:31:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.005+0000 7fe35a03f640 1 -- 172.21.15.6:0/1501790624 shutdown_connections 2024-05-04T00:31:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.005+0000 7fe35a03f640 1 --2- 172.21.15.6:0/1501790624 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe33406f430 0x7fe334071940 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.005+0000 7fe35a03f640 1 --2- 172.21.15.6:0/1501790624 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe35415cac0 0x7fe3541461e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.005+0000 7fe35a03f640 1 --2- 172.21.15.6:0/1501790624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe354156580 0x7fe354152b70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.005+0000 7fe35a03f640 1 --2- 172.21.15.6:0/1501790624 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe35406c830 0x7fe3540c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.005+0000 7fe35a03f640 1 -- 172.21.15.6:0/1501790624 >> 172.21.15.6:0/1501790624 conn(0x7fe3540ce310 msgr2=0x7fe3540c9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.009+0000 7fe35a03f640 1 -- 172.21.15.6:0/1501790624 shutdown_connections 2024-05-04T00:31:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.009+0000 7fe35a03f640 1 -- 172.21.15.6:0/1501790624 wait complete. 2024-05-04T00:31:18.039 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-04T00:31:18.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.209+0000 7fbae5a0a640 1 Processor -- start 2024-05-04T00:31:18.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.209+0000 7fbae5a0a640 1 -- start start 2024-05-04T00:31:18.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.213+0000 7fbae5a0a640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbae0070af0 0x7fbae0070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:18.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.213+0000 7fbae5a0a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbae0159300 0x7fbae0159710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:18.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.213+0000 7fbae5a0a640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbae00c7b90 con 0x7fbae0142130 2024-05-04T00:31:18.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.213+0000 7fbae5a0a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fbae00c7e30 con 0x7fbae0159300 2024-05-04T00:31:18.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.213+0000 7fbae5a0a640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fbae0158e00 con 0x7fbae0070af0 2024-05-04T00:31:18.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.213+0000 7fbadeffd640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fbae0142130 0x7fbae00c8d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:44924/0 (socket says 172.21.15.6:44924) 2024-05-04T00:31:18.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.213+0000 7fbadeffd640 1 -- 172.21.15.6:0/183847167 learned_addr learned my addr 172.21.15.6:0/183847167 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:18.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.213+0000 7fbade7fc640 1 --2- 172.21.15.6:0/183847167 >> v2:172.21.15.163:3300/0 conn(0x7fbae0070af0 0x7fbae0070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:18.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.221+0000 7fbade7fc640 1 -- 172.21.15.6:0/183847167 >> v2:172.21.15.6:3300/0 conn(0x7fbae0159300 msgr2=0x7fbae0159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:18.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.221+0000 7fbade7fc640 1 --2- 172.21.15.6:0/183847167 >> v2:172.21.15.6:3300/0 conn(0x7fbae0159300 0x7fbae0159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:18.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.221+0000 7fbade7fc640 1 -- 172.21.15.6:0/183847167 >> v1:172.21.15.163:6789/0 conn(0x7fbae0142130 legacy=0x7fbae00c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:18.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.221+0000 7fbade7fc640 1 -- 172.21.15.6:0/183847167 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae00c80f0 con 0x7fbae0070af0 2024-05-04T00:31:18.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.233+0000 7fbade7fc640 1 --2- 172.21.15.6:0/183847167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbae0070af0 0x7fbae0070f00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbae00726a0 tx=0x7fbac801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85b7158cd6f574d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:18.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.245+0000 7fbaddffb640 1 -- 172.21.15.6:0/183847167 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac80b5070 con 0x7fbae0070af0 2024-05-04T00:31:18.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.245+0000 7fbaddffb640 1 -- 172.21.15.6:0/183847167 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac80a8970 con 0x7fbae0070af0 2024-05-04T00:31:18.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.245+0000 7fbaddffb640 1 -- 172.21.15.6:0/183847167 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac80a8d40 con 0x7fbae0070af0 2024-05-04T00:31:18.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.245+0000 7fbae5a0a640 1 -- 172.21.15.6:0/183847167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbae0070af0 msgr2=0x7fbae0070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:18.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.245+0000 7fbae5a0a640 1 --2- 172.21.15.6:0/183847167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbae0070af0 0x7fbae0070f00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbae00726a0 tx=0x7fbac801ec70 comp rx=0 tx=0).stop 2024-05-04T00:31:18.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.245+0000 7fbae5a0a640 1 -- 172.21.15.6:0/183847167 shutdown_connections 2024-05-04T00:31:18.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.245+0000 7fbae5a0a640 1 --2- 172.21.15.6:0/183847167 >> v2:172.21.15.6:3300/0 conn(0x7fbae0159300 0x7fbae0159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:18.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.245+0000 7fbae5a0a640 1 --2- 172.21.15.6:0/183847167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbae0070af0 0x7fbae0070f00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:18.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.245+0000 7fbae5a0a640 1 -- 172.21.15.6:0/183847167 >> 172.21.15.6:0/183847167 conn(0x7fbae00ce310 msgr2=0x7fbae00ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:18.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.245+0000 7fbae5a0a640 1 -- 172.21.15.6:0/183847167 shutdown_connections 2024-05-04T00:31:18.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.245+0000 7fbae5a0a640 1 -- 172.21.15.6:0/183847167 wait complete. 2024-05-04T00:31:18.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.249+0000 7fbae5a0a640 1 Processor -- start 2024-05-04T00:31:18.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.249+0000 7fbae5a0a640 1 -- start start 2024-05-04T00:31:18.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.253+0000 7fbae5a0a640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbae0070af0 0x7fbae01f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:18.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.253+0000 7fbae5a0a640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbae0142130 0x7fbae01eef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:18.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.253+0000 7fbae5a0a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbae0159300 0x7fbae00cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:18.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.253+0000 7fbae5a0a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbae0159c50 con 0x7fbae0159300 2024-05-04T00:31:18.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.253+0000 7fbae5a0a640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fbae00c86b0 con 0x7fbae0142130 2024-05-04T00:31:18.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.253+0000 7fbae5a0a640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fbae00c6340 con 0x7fbae0070af0 2024-05-04T00:31:18.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.253+0000 7fbadf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbae0159300 0x7fbae00cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:18.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.257+0000 7fbadf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbae0159300 0x7fbae00cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49888/0 (socket says 172.21.15.6:49888) 2024-05-04T00:31:18.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.257+0000 7fbadf7fe640 1 -- 172.21.15.6:0/2314241069 learned_addr learned my addr 172.21.15.6:0/2314241069 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:18.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.261+0000 7fbadf7fe640 1 -- 172.21.15.6:0/2314241069 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbae0070af0 msgr2=0x7fbae01f27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:18.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.261+0000 7fbadf7fe640 1 --2- 172.21.15.6:0/2314241069 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbae0070af0 0x7fbae01f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:18.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.261+0000 7fbadf7fe640 1 -- 172.21.15.6:0/2314241069 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbae0142130 msgr2=0x7fbae01eef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:18.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.261+0000 7fbadf7fe640 1 --2- 172.21.15.6:0/2314241069 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbae0142130 0x7fbae01eef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:18.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.261+0000 7fbadf7fe640 1 -- 172.21.15.6:0/2314241069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae01ef4a0 con 0x7fbae0159300 2024-05-04T00:31:18.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.265+0000 7fbadf7fe640 1 --2- 172.21.15.6:0/2314241069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbae0159300 0x7fbae00cafe0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbad800b410 tx=0x7fbad800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:18.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.269+0000 7fbad7fff640 1 -- 172.21.15.6:0/2314241069 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8015020 con 0x7fbae0159300 2024-05-04T00:31:18.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.269+0000 7fbad7fff640 1 -- 172.21.15.6:0/2314241069 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbad8011830 con 0x7fbae0159300 2024-05-04T00:31:18.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.269+0000 7fbad7fff640 1 -- 172.21.15.6:0/2314241069 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8011c20 con 0x7fbae0159300 2024-05-04T00:31:18.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.269+0000 7fbae5a0a640 1 -- 172.21.15.6:0/2314241069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbae00ccc40 con 0x7fbae0159300 2024-05-04T00:31:18.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.269+0000 7fbae5a0a640 1 -- 172.21.15.6:0/2314241069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbae00cd200 con 0x7fbae0159300 2024-05-04T00:31:18.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.273+0000 7fbae5a0a640 1 -- 172.21.15.6:0/2314241069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbae00cd400 con 0x7fbae0159300 2024-05-04T00:31:18.519 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:31:18.522 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:31:18.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.573+0000 7fbad7fff640 1 -- 172.21.15.6:0/2314241069 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbad8018020 con 0x7fbae0159300 2024-05-04T00:31:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.573+0000 7fbad7fff640 1 --2- 172.21.15.6:0/2314241069 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fbac006f450 0x7fbac0071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:18.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.573+0000 7fbadeffd640 1 --2- 172.21.15.6:0/2314241069 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fbac006f450 0x7fbac0071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:18.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.577+0000 7fbadeffd640 1 --2- 172.21.15.6:0/2314241069 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fbac006f450 0x7fbac0071960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbae00c7d60 tx=0x7fbad0001630 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:18.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.617+0000 7fbad7fff640 1 -- 172.21.15.6:0/2314241069 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7fbad8011dc0 con 0x7fbae0159300 2024-05-04T00:31:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.617+0000 7fbad7fff640 1 -- 172.21.15.6:0/2314241069 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fbae00cd400 con 0x7fbae0159300 2024-05-04T00:31:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:18.797+0000 7fbae5a0a640 1 -- 172.21.15.6:0/2314241069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbae0069a50 con 0x7fbae0159300 2024-05-04T00:31:20.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.173+0000 7fbad7fff640 1 -- 172.21.15.6:0/2314241069 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v22) ==== 170+0+0 (secure 0 0 0) 0x7fbad801f020 con 0x7fbae0159300 2024-05-04T00:31:20.176 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-05-04T00:31:20.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.177+0000 7fbae5a0a640 1 -- 172.21.15.6:0/2314241069 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fbac006f450 msgr2=0x7fbac0071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:20.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.177+0000 7fbae5a0a640 1 --2- 172.21.15.6:0/2314241069 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fbac006f450 0x7fbac0071960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbae00c7d60 tx=0x7fbad0001630 comp rx=0 tx=0).stop 2024-05-04T00:31:20.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.177+0000 7fbae5a0a640 1 -- 172.21.15.6:0/2314241069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbae0159300 msgr2=0x7fbae00cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:20.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.177+0000 7fbae5a0a640 1 --2- 172.21.15.6:0/2314241069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbae0159300 0x7fbae00cafe0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbad800b410 tx=0x7fbad800b8d0 comp rx=0 tx=0).stop 2024-05-04T00:31:20.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.177+0000 7fbae5a0a640 1 -- 172.21.15.6:0/2314241069 shutdown_connections 2024-05-04T00:31:20.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.177+0000 7fbae5a0a640 1 --2- 172.21.15.6:0/2314241069 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbae0142130 0x7fbae01eef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:20.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.177+0000 7fbae5a0a640 1 --2- 172.21.15.6:0/2314241069 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fbac006f450 0x7fbac0071960 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:20.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.177+0000 7fbae5a0a640 1 --2- 172.21.15.6:0/2314241069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbae0159300 0x7fbae00cafe0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:20.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.177+0000 7fbae5a0a640 1 --2- 172.21.15.6:0/2314241069 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbae0070af0 0x7fbae01f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:20.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.177+0000 7fbae5a0a640 1 -- 172.21.15.6:0/2314241069 >> 172.21.15.6:0/2314241069 conn(0x7fbae00ce310 msgr2=0x7fbae013e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:20.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.177+0000 7fbae5a0a640 1 -- 172.21.15.6:0/2314241069 shutdown_connections 2024-05-04T00:31:20.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.177+0000 7fbae5a0a640 1 -- 172.21.15.6:0/2314241069 wait complete. 2024-05-04T00:31:20.208 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-04T00:31:20.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.409+0000 7f0173349640 1 Processor -- start 2024-05-04T00:31:20.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.409+0000 7f0173349640 1 -- start start 2024-05-04T00:31:20.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.409+0000 7f0173349640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f016c14f930 0x7f016c0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:20.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.409+0000 7f0173349640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f016c0ce340 0x7f016c1638a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:20.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.409+0000 7f0173349640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f016c0c3930 con 0x7f016c0cdf30 2024-05-04T00:31:20.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.409+0000 7f0173349640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f016c0c3090 con 0x7f016c14f930 2024-05-04T00:31:20.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.409+0000 7f0173349640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f016c0c3370 con 0x7f016c0ce340 2024-05-04T00:31:20.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.409+0000 7f01710e5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f016c14f930 0x7f016c0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:20.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.409+0000 7f01710e5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f016c14f930 0x7f016c0c9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49902/0 (socket says 172.21.15.6:49902) 2024-05-04T00:31:20.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.409+0000 7f01710e5640 1 -- 172.21.15.6:0/3412206094 learned_addr learned my addr 172.21.15.6:0/3412206094 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:20.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.413+0000 7f01710e5640 1 -- 172.21.15.6:0/3412206094 >> v2:172.21.15.163:3300/0 conn(0x7f016c0ce340 msgr2=0x7f016c1638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:20.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.413+0000 7f01710e5640 1 --2- 172.21.15.6:0/3412206094 >> v2:172.21.15.163:3300/0 conn(0x7f016c0ce340 0x7f016c1638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:20.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.413+0000 7f01710e5640 1 -- 172.21.15.6:0/3412206094 >> v1:172.21.15.163:6789/0 conn(0x7f016c0cdf30 legacy=0x7f016c1595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:20.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.413+0000 7f01710e5640 1 -- 172.21.15.6:0/3412206094 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f016c0c3650 con 0x7f016c14f930 2024-05-04T00:31:20.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.417+0000 7f01710e5640 1 --2- 172.21.15.6:0/3412206094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f016c14f930 0x7f016c0c9c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f016c0c3c20 tx=0x7f016801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d965148290ba24b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:20.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.421+0000 7f0163fff640 1 -- 172.21.15.6:0/3412206094 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01680a7070 con 0x7f016c14f930 2024-05-04T00:31:20.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.421+0000 7f0163fff640 1 -- 172.21.15.6:0/3412206094 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01680b0070 con 0x7f016c14f930 2024-05-04T00:31:20.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.421+0000 7f0163fff640 1 -- 172.21.15.6:0/3412206094 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01680ab890 con 0x7f016c14f930 2024-05-04T00:31:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.421+0000 7f0173349640 1 -- 172.21.15.6:0/3412206094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f016c14f930 msgr2=0x7f016c0c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.421+0000 7f0173349640 1 --2- 172.21.15.6:0/3412206094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f016c14f930 0x7f016c0c9c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f016c0c3c20 tx=0x7f016801c490 comp rx=0 tx=0).stop 2024-05-04T00:31:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.421+0000 7f0173349640 1 -- 172.21.15.6:0/3412206094 shutdown_connections 2024-05-04T00:31:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.425+0000 7f0173349640 1 --2- 172.21.15.6:0/3412206094 >> v2:172.21.15.163:3300/0 conn(0x7f016c0ce340 0x7f016c1638a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.425+0000 7f0173349640 1 --2- 172.21.15.6:0/3412206094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f016c14f930 0x7f016c0c9c60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.425+0000 7f0173349640 1 -- 172.21.15.6:0/3412206094 >> 172.21.15.6:0/3412206094 conn(0x7f016c070d60 msgr2=0x7f016c0711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.425+0000 7f0173349640 1 -- 172.21.15.6:0/3412206094 shutdown_connections 2024-05-04T00:31:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.425+0000 7f0173349640 1 -- 172.21.15.6:0/3412206094 wait complete. 2024-05-04T00:31:20.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.425+0000 7f0173349640 1 Processor -- start 2024-05-04T00:31:20.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.425+0000 7f0173349640 1 -- start start 2024-05-04T00:31:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.429+0000 7f0173349640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f016c0cdf30 0x7f016c145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.429+0000 7f0173349640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f016c0ce340 0x7f016c147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.429+0000 7f0173349640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f016c14f930 0x7f016c0c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.429+0000 7f0173349640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f016c159e30 con 0x7f016c0ce340 2024-05-04T00:31:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.429+0000 7f0173349640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f016c159cb0 con 0x7f016c0cdf30 2024-05-04T00:31:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.429+0000 7f0173349640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f016c074980 con 0x7f016c14f930 2024-05-04T00:31:20.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.429+0000 7f01718e6640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f016c14f930 0x7f016c0c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:20.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.429+0000 7f01718e6640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f016c14f930 0x7f016c0c8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:47328/0 (socket says 172.21.15.6:47328) 2024-05-04T00:31:20.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.429+0000 7f01718e6640 1 -- 172.21.15.6:0/1687728603 learned_addr learned my addr 172.21.15.6:0/1687728603 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:20.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.433+0000 7f01710e5640 1 --2- 172.21.15.6:0/1687728603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f016c0cdf30 0x7f016c145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:20.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.437+0000 7f01718e6640 1 -- 172.21.15.6:0/1687728603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f016c0cdf30 msgr2=0x7f016c145350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:20.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.437+0000 7f01718e6640 1 --2- 172.21.15.6:0/1687728603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f016c0cdf30 0x7f016c145350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:20.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.437+0000 7f01718e6640 1 -- 172.21.15.6:0/1687728603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f016c0ce340 msgr2=0x7f016c147520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:20.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.437+0000 7f01718e6640 1 --2- 172.21.15.6:0/1687728603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f016c0ce340 0x7f016c147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:20.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.437+0000 7f01718e6640 1 -- 172.21.15.6:0/1687728603 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f016c0c9360 con 0x7f016c14f930 2024-05-04T00:31:20.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.441+0000 7f01718e6640 1 --2- 172.21.15.6:0/1687728603 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f016c14f930 0x7f016c0c8e20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f016400ba10 tx=0x7f016400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:20.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.449+0000 7f0161ffb640 1 -- 172.21.15.6:0/1687728603 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0164019070 con 0x7f016c14f930 2024-05-04T00:31:20.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.449+0000 7f0161ffb640 1 -- 172.21.15.6:0/1687728603 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f016400cb60 con 0x7f016c14f930 2024-05-04T00:31:20.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.449+0000 7f0161ffb640 1 -- 172.21.15.6:0/1687728603 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0164014440 con 0x7f016c14f930 2024-05-04T00:31:20.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.449+0000 7f0173349640 1 -- 172.21.15.6:0/1687728603 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f016c0c8660 con 0x7f016c14f930 2024-05-04T00:31:20.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.449+0000 7f0173349640 1 -- 172.21.15.6:0/1687728603 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f016c15bc60 con 0x7f016c14f930 2024-05-04T00:31:20.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.449+0000 7f0173349640 1 -- 172.21.15.6:0/1687728603 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f016c15b6f0 con 0x7f016c14f930 2024-05-04T00:31:20.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.861+0000 7f0161ffb640 1 -- 172.21.15.6:0/1687728603 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f016401c070 con 0x7f016c14f930 2024-05-04T00:31:20.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.865+0000 7f0161ffb640 1 --2- 172.21.15.6:0/1687728603 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f015006f450 0x7f0150071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:20.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.865+0000 7f01710e5640 1 --2- 172.21.15.6:0/1687728603 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f015006f450 0x7f0150071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:20.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.865+0000 7f01710e5640 1 --2- 172.21.15.6:0/1687728603 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f015006f450 0x7f0150071960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f01680af000 tx=0x7f01680a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.869+0000 7f0161ffb640 1 -- 172.21.15.6:0/1687728603 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5609+0+0 (secure 0 0 0) 0x7f0164057ec0 con 0x7f016c14f930 2024-05-04T00:31:20.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:20.897+0000 7f0161ffb640 1 -- 172.21.15.6:0/1687728603 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0164023020 con 0x7f016c14f930 2024-05-04T00:31:21.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:21.109+0000 7f0173349640 1 -- 172.21.15.6:0/1687728603 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f016c069a50 con 0x7f016c14f930 2024-05-04T00:31:23.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.529+0000 7f0161ffb640 1 -- 172.21.15.6:0/1687728603 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f016405bc30 con 0x7f016c14f930 2024-05-04T00:31:23.532 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 2 and data pool 3 2024-05-04T00:31:23.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.533+0000 7f0173349640 1 -- 172.21.15.6:0/1687728603 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f015006f450 msgr2=0x7f0150071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:23.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.533+0000 7f0173349640 1 --2- 172.21.15.6:0/1687728603 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f015006f450 0x7f0150071960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f01680af000 tx=0x7f01680a7000 comp rx=0 tx=0).stop 2024-05-04T00:31:23.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.533+0000 7f0173349640 1 -- 172.21.15.6:0/1687728603 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f016c14f930 msgr2=0x7f016c0c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:23.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.533+0000 7f0173349640 1 --2- 172.21.15.6:0/1687728603 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f016c14f930 0x7f016c0c8e20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f016400ba10 tx=0x7f016400bed0 comp rx=0 tx=0).stop 2024-05-04T00:31:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.533+0000 7f0173349640 1 -- 172.21.15.6:0/1687728603 shutdown_connections 2024-05-04T00:31:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.533+0000 7f0173349640 1 --2- 172.21.15.6:0/1687728603 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f015006f450 0x7f0150071960 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.533+0000 7f0173349640 1 --2- 172.21.15.6:0/1687728603 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f016c14f930 0x7f016c0c8e20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.533+0000 7f0173349640 1 --2- 172.21.15.6:0/1687728603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f016c0ce340 0x7f016c147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.533+0000 7f0173349640 1 --2- 172.21.15.6:0/1687728603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f016c0cdf30 0x7f016c145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.533+0000 7f0173349640 1 -- 172.21.15.6:0/1687728603 >> 172.21.15.6:0/1687728603 conn(0x7f016c070d60 msgr2=0x7f016c15cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.533+0000 7f0173349640 1 -- 172.21.15.6:0/1687728603 shutdown_connections 2024-05-04T00:31:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.533+0000 7f0173349640 1 -- 172.21.15.6:0/1687728603 wait complete. 2024-05-04T00:31:23.565 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T00:31:23.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.713+0000 7f67cc647640 1 Processor -- start 2024-05-04T00:31:23.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.713+0000 7f67cc647640 1 -- start start 2024-05-04T00:31:23.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.717+0000 7f67cc647640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67c415c3d0 0x7f67c40c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:23.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.717+0000 7f67cc647640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f67c4070c70 0x7f67c4071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:23.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.717+0000 7f67cc647640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67c40c5910 con 0x7f67c40c9030 2024-05-04T00:31:23.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.717+0000 7f67cc647640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f67c40c7b90 con 0x7f67c4070c70 2024-05-04T00:31:23.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.717+0000 7f67cc647640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f67c40c5bb0 con 0x7f67c415c3d0 2024-05-04T00:31:23.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.717+0000 7f67ca3e3640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67c415c3d0 0x7f67c40c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:23.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.717+0000 7f67cabe4640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f67c4070c70 0x7f67c4071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:23.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.717+0000 7f67ca3e3640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67c415c3d0 0x7f67c40c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:46638/0 (socket says 172.21.15.6:46638) 2024-05-04T00:31:23.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.717+0000 7f67ca3e3640 1 -- 172.21.15.6:0/195810819 learned_addr learned my addr 172.21.15.6:0/195810819 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:23.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.725+0000 7f67cabe4640 1 -- 172.21.15.6:0/195810819 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67c415c3d0 msgr2=0x7f67c40c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:23.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.725+0000 7f67cabe4640 1 --2- 172.21.15.6:0/195810819 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67c415c3d0 0x7f67c40c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:23.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.725+0000 7f67cabe4640 1 -- 172.21.15.6:0/195810819 >> v1:172.21.15.6:6789/0 conn(0x7f67c40c9030 legacy=0x7f67c4071a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:23.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.725+0000 7f67cabe4640 1 -- 172.21.15.6:0/195810819 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c40c5e90 con 0x7f67c4070c70 2024-05-04T00:31:23.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.733+0000 7f67cabe4640 1 --2- 172.21.15.6:0/195810819 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67c4070c70 0x7f67c4071080 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f67c40c79f0 tx=0x7f67bc01f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27db2c79ad1db3cd server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:23.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.745+0000 7f67c93e1640 1 -- 172.21.15.6:0/195810819 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0b5070 con 0x7f67c4070c70 2024-05-04T00:31:23.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.745+0000 7f67c93e1640 1 -- 172.21.15.6:0/195810819 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67bc0b0440 con 0x7f67c4070c70 2024-05-04T00:31:23.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.745+0000 7f67c93e1640 1 -- 172.21.15.6:0/195810819 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0b0810 con 0x7f67c4070c70 2024-05-04T00:31:23.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.745+0000 7f67cc647640 1 -- 172.21.15.6:0/195810819 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67c4070c70 msgr2=0x7f67c4071080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:23.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.745+0000 7f67cc647640 1 --2- 172.21.15.6:0/195810819 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67c4070c70 0x7f67c4071080 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f67c40c79f0 tx=0x7f67bc01f130 comp rx=0 tx=0).stop 2024-05-04T00:31:23.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.745+0000 7f67cc647640 1 -- 172.21.15.6:0/195810819 shutdown_connections 2024-05-04T00:31:23.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.745+0000 7f67cc647640 1 --2- 172.21.15.6:0/195810819 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67c4070c70 0x7f67c4071080 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:23.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.745+0000 7f67cc647640 1 --2- 172.21.15.6:0/195810819 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67c415c3d0 0x7f67c40c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:23.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.745+0000 7f67cc647640 1 -- 172.21.15.6:0/195810819 >> 172.21.15.6:0/195810819 conn(0x7f67c40cb310 msgr2=0x7f67c40cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:23.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.745+0000 7f67cc647640 1 -- 172.21.15.6:0/195810819 shutdown_connections 2024-05-04T00:31:23.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.745+0000 7f67cc647640 1 -- 172.21.15.6:0/195810819 wait complete. 2024-05-04T00:31:23.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.749+0000 7f67cc647640 1 Processor -- start 2024-05-04T00:31:23.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.749+0000 7f67cc647640 1 -- start start 2024-05-04T00:31:23.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.749+0000 7f67cc647640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67c4070c70 0x7f67c4156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:23.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.749+0000 7f67cc647640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c40c9030 0x7f67c414bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:23.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.749+0000 7f67cc647640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67c415c3d0 0x7f67c4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:23.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.749+0000 7f67cc647640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f67c40c8890 con 0x7f67c40c9030 2024-05-04T00:31:23.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.749+0000 7f67cc647640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f67c40c7e30 con 0x7f67c4070c70 2024-05-04T00:31:23.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.749+0000 7f67cc647640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f67c40c6450 con 0x7f67c415c3d0 2024-05-04T00:31:23.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.749+0000 7f67cabe4640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67c415c3d0 0x7f67c4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:23.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.753+0000 7f67cabe4640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67c415c3d0 0x7f67c4159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:46648/0 (socket says 172.21.15.6:46648) 2024-05-04T00:31:23.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.753+0000 7f67cabe4640 1 -- 172.21.15.6:0/433237061 learned_addr learned my addr 172.21.15.6:0/433237061 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:23.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.753+0000 7f67ca3e3640 1 --2- 172.21.15.6:0/433237061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67c4070c70 0x7f67c4156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:23.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.761+0000 7f67cabe4640 1 -- 172.21.15.6:0/433237061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67c4070c70 msgr2=0x7f67c4156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:23.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.761+0000 7f67cabe4640 1 --2- 172.21.15.6:0/433237061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67c4070c70 0x7f67c4156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:23.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.761+0000 7f67cabe4640 1 -- 172.21.15.6:0/433237061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c40c9030 msgr2=0x7f67c414bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:23.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.761+0000 7f67cabe4640 1 --2- 172.21.15.6:0/433237061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c40c9030 0x7f67c414bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:23.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.761+0000 7f67cabe4640 1 -- 172.21.15.6:0/433237061 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c4157450 con 0x7f67c415c3d0 2024-05-04T00:31:23.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.769+0000 7f67cabe4640 1 --2- 172.21.15.6:0/433237061 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67c415c3d0 0x7f67c4159fa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f67bc01ef60 tx=0x7f67bc01bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.785+0000 7f67baffd640 1 -- 172.21.15.6:0/433237061 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0b5050 con 0x7f67c415c3d0 2024-05-04T00:31:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.785+0000 7f67baffd640 1 -- 172.21.15.6:0/433237061 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67bc0c1070 con 0x7f67c415c3d0 2024-05-04T00:31:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.785+0000 7f67baffd640 1 -- 172.21.15.6:0/433237061 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0bc8b0 con 0x7f67c415c3d0 2024-05-04T00:31:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.785+0000 7f67cc647640 1 -- 172.21.15.6:0/433237061 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67c4159010 con 0x7f67c415c3d0 2024-05-04T00:31:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.785+0000 7f67cc647640 1 -- 172.21.15.6:0/433237061 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f67c41595d0 con 0x7f67c415c3d0 2024-05-04T00:31:23.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:23.785+0000 7f67cc647640 1 -- 172.21.15.6:0/433237061 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67c4069a50 con 0x7f67c415c3d0 2024-05-04T00:31:24.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.157+0000 7f67baffd640 1 -- 172.21.15.6:0/433237061 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f67bc0bca50 con 0x7f67c415c3d0 2024-05-04T00:31:24.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.157+0000 7f67baffd640 1 --2- 172.21.15.6:0/433237061 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f67a806f430 0x7f67a8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:24.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.157+0000 7f67ca3e3640 1 --2- 172.21.15.6:0/433237061 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f67a806f430 0x7f67a8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:24.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.157+0000 7f67ca3e3640 1 --2- 172.21.15.6:0/433237061 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f67a806f430 0x7f67a8071940 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f67c0009ab0 tx=0x7f67c0009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.165+0000 7f67baffd640 1 -- 172.21.15.6:0/433237061 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5709+0+0 (secure 0 0 0) 0x7f67bc0093b0 con 0x7f67c415c3d0 2024-05-04T00:31:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.217+0000 7f67baffd640 1 -- 172.21.15.6:0/433237061 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f67bc0ca020 con 0x7f67c415c3d0 2024-05-04T00:31:24.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.425+0000 7f67cc647640 1 -- 172.21.15.6:0/433237061 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67c40c8e10 con 0x7f67c415c3d0 2024-05-04T00:31:24.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.805+0000 7f67baffd640 1 -- 172.21.15.6:0/433237061 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16537 (secure 0 0 0) 0x7f67bc018c90 con 0x7f67c415c3d0 2024-05-04T00:31:24.808 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:31:24.808 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"ad5951ed-0d5e-4770-b5d9-995e08a00213","created":"2024-05-04T00:30:11.236352+0000","modified":"2024-05-04T00:31:23.389354+0000","last_up_change":"2024-05-04T00:30:35.679943+0000","last_in_change":"2024-05-04T00:30:24.926330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T00:30:36.311072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T00:31:17.278288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T00:31:18.957819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a907d753-b7cf-499c-ae36-81e44ed933a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6805","nonce":489144503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6810","nonce":489144503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6824","nonce":489144503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6813","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6817","nonce":489144503}]},"public_addr":"172.21.15.6:6805/489144503","cluster_addr":"172.21.15.6:6810/489144503","heartbeat_back_addr":"172.21.15.6:6824/489144503","heartbeat_front_addr":"172.21.15.6:6817/489144503","state":["exists","up"]},{"osd":1,"uuid":"eab41a32-d5f1-43b8-8835-f2d4bffc9cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6802","nonce":3099957279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6807","nonce":3099957279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6819","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6823","nonce":3099957279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6815","nonce":3099957279}]},"public_addr":"172.21.15.6:6802/3099957279","cluster_addr":"172.21.15.6:6807/3099957279","heartbeat_back_addr":"172.21.15.6:6823/3099957279","heartbeat_front_addr":"172.21.15.6:6815/3099957279","state":["exists","up"]},{"osd":2,"uuid":"f2540144-b533-4ffc-a9cf-24f0e4910a9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6801","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6806","nonce":2770857903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6809","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6812","nonce":2770857903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6827","nonce":2770857903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6821","nonce":2770857903}]},"public_addr":"172.21.15.6:6806/2770857903","cluster_addr":"172.21.15.6:6812/2770857903","heartbeat_back_addr":"172.21.15.6:6827/2770857903","heartbeat_front_addr":"172.21.15.6:6821/2770857903","state":["exists","up"]},{"osd":3,"uuid":"982b7ace-fd02-4f03-aef2-0428468f8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6818","nonce":3149875909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6826","nonce":3149875909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6831","nonce":3149875909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6829","nonce":3149875909}]},"public_addr":"172.21.15.6:6818/3149875909","cluster_addr":"172.21.15.6:6826/3149875909","heartbeat_back_addr":"172.21.15.6:6831/3149875909","heartbeat_front_addr":"172.21.15.6:6829/3149875909","state":["exists","up"]},{"osd":4,"uuid":"ecf94166-cfdf-4ac8-a659-6ae907686e8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6818","nonce":2508264225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6821","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6824","nonce":2508264225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6833","nonce":2508264225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6831","nonce":2508264225}]},"public_addr":"172.21.15.163:6818/2508264225","cluster_addr":"172.21.15.163:6824/2508264225","heartbeat_back_addr":"172.21.15.163:6833/2508264225","heartbeat_front_addr":"172.21.15.163:6831/2508264225","state":["exists","up"]},{"osd":5,"uuid":"fc5cfa90-0e3a-4fc2-829c-5ff57d7a5953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6815","nonce":167619435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6820","nonce":167619435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6827","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6829","nonce":167619435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6825","nonce":167619435}]},"public_addr":"172.21.15.163:6815/167619435","cluster_addr":"172.21.15.163:6820/167619435","heartbeat_back_addr":"172.21.15.163:6829/167619435","heartbeat_front_addr":"172.21.15.163:6825/167619435","state":["exists","up"]},{"osd":6,"uuid":"ed95f0cf-f309-4861-b47c-4a5a6b44ffdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6811","nonce":1460767610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6813","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6814","nonce":1460767610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6830","nonce":1460767610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6819","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6822","nonce":1460767610}]},"public_addr":"172.21.15.163:6811/1460767610","cluster_addr":"172.21.15.163:6814/1460767610","heartbeat_back_addr":"172.21.15.163:6830/1460767610","heartbeat_front_addr":"172.21.15.163:6822/1460767610","state":["exists","up"]},{"osd":7,"uuid":"2f57afcd-567f-44f6-9db7-df0342c8c4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6803","nonce":239650691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6805","nonce":239650691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6809","nonce":239650691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6807","nonce":239650691}]},"public_addr":"172.21.15.163:6803/239650691","cluster_addr":"172.21.15.163:6805/239650691","heartbeat_back_addr":"172.21.15.163:6809/239650691","heartbeat_front_addr":"172.21.15.163:6807/239650691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.818870+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.749094+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.805522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.576430+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.740084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.755726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.797961+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.577731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T00:31:24.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.805+0000 7f67cc647640 1 -- 172.21.15.6:0/433237061 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f67a806f430 msgr2=0x7f67a8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:24.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.805+0000 7f67cc647640 1 --2- 172.21.15.6:0/433237061 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f67a806f430 0x7f67a8071940 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f67c0009ab0 tx=0x7f67c0009240 comp rx=0 tx=0).stop 2024-05-04T00:31:24.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.805+0000 7f67cc647640 1 -- 172.21.15.6:0/433237061 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67c415c3d0 msgr2=0x7f67c4159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:24.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.805+0000 7f67cc647640 1 --2- 172.21.15.6:0/433237061 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67c415c3d0 0x7f67c4159fa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f67bc01ef60 tx=0x7f67bc01bed0 comp rx=0 tx=0).stop 2024-05-04T00:31:24.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.805+0000 7f67cc647640 1 -- 172.21.15.6:0/433237061 shutdown_connections 2024-05-04T00:31:24.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.805+0000 7f67cc647640 1 --2- 172.21.15.6:0/433237061 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f67a806f430 0x7f67a8071940 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:24.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.805+0000 7f67cc647640 1 --2- 172.21.15.6:0/433237061 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67c415c3d0 0x7f67c4159fa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:24.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.805+0000 7f67cc647640 1 --2- 172.21.15.6:0/433237061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c40c9030 0x7f67c414bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:24.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.805+0000 7f67cc647640 1 --2- 172.21.15.6:0/433237061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67c4070c70 0x7f67c4156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:24.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.805+0000 7f67cc647640 1 -- 172.21.15.6:0/433237061 >> 172.21.15.6:0/433237061 conn(0x7f67c40cb310 msgr2=0x7f67c41515a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:24.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.805+0000 7f67cc647640 1 -- 172.21.15.6:0/433237061 shutdown_connections 2024-05-04T00:31:24.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.805+0000 7f67cc647640 1 -- 172.21.15.6:0/433237061 wait complete. 2024-05-04T00:31:24.830 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T00:31:24.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.977+0000 7f20fcda0640 1 Processor -- start 2024-05-04T00:31:24.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.977+0000 7f20fcda0640 1 -- start start 2024-05-04T00:31:24.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.981+0000 7f20fcda0640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20f80ce520 0x7f20f80c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:24.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.981+0000 7f20fcda0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f20f815d3f0 0x7f20f815d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:24.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.981+0000 7f20fcda0640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f20f80c7300 0x7f20f80c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:24.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.981+0000 7f20fcda0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f20f813ffa0 con 0x7f20f815d3f0 2024-05-04T00:31:24.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.981+0000 7f20fcda0640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f20f80c91f0 con 0x7f20f80c7300 2024-05-04T00:31:24.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.981+0000 7f20fcda0640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f20f80c8f10 con 0x7f20f80ce520 2024-05-04T00:31:24.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.981+0000 7f20f5d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f20f815d3f0 0x7f20f815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:24.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.981+0000 7f20f5d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f20f815d3f0 0x7f20f815d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34808/0 (socket says 172.21.15.6:34808) 2024-05-04T00:31:24.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.981+0000 7f20f5d9b640 1 -- 172.21.15.6:0/2170631974 learned_addr learned my addr 172.21.15.6:0/2170631974 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:24.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.985+0000 7f20f5d9b640 1 -- 172.21.15.6:0/2170631974 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20f80ce520 msgr2=0x7f20f80c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:24.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.985+0000 7f20f5d9b640 1 --2- 172.21.15.6:0/2170631974 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20f80ce520 0x7f20f80c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:24.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.985+0000 7f20f5d9b640 1 -- 172.21.15.6:0/2170631974 >> v2:172.21.15.163:3300/0 conn(0x7f20f80c7300 msgr2=0x7f20f80c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:24.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.985+0000 7f20f5d9b640 1 --2- 172.21.15.6:0/2170631974 >> v2:172.21.15.163:3300/0 conn(0x7f20f80c7300 0x7f20f80c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:24.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.985+0000 7f20f5d9b640 1 -- 172.21.15.6:0/2170631974 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f813f1e0 con 0x7f20f815d3f0 2024-05-04T00:31:24.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.989+0000 7f20f5d9b640 1 --2- 172.21.15.6:0/2170631974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f815d3f0 0x7f20f815d800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f20f815e4f0 tx=0x7f20ec01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b10a49c970db2dd server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:24.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.993+0000 7f20f559a640 1 -- 172.21.15.6:0/2170631974 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0b5070 con 0x7f20f815d3f0 2024-05-04T00:31:24.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.993+0000 7f20f559a640 1 -- 172.21.15.6:0/2170631974 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ec0a89d0 con 0x7f20f815d3f0 2024-05-04T00:31:24.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.993+0000 7f20f559a640 1 -- 172.21.15.6:0/2170631974 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0a8da0 con 0x7f20f815d3f0 2024-05-04T00:31:24.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.993+0000 7f20fcda0640 1 -- 172.21.15.6:0/2170631974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f815d3f0 msgr2=0x7f20f815d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:24.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.993+0000 7f20fcda0640 1 --2- 172.21.15.6:0/2170631974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f815d3f0 0x7f20f815d800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f20f815e4f0 tx=0x7f20ec01ed10 comp rx=0 tx=0).stop 2024-05-04T00:31:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.993+0000 7f20fcda0640 1 -- 172.21.15.6:0/2170631974 shutdown_connections 2024-05-04T00:31:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.993+0000 7f20fcda0640 1 --2- 172.21.15.6:0/2170631974 >> v2:172.21.15.163:3300/0 conn(0x7f20f80c7300 0x7f20f80c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.993+0000 7f20fcda0640 1 --2- 172.21.15.6:0/2170631974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f815d3f0 0x7f20f815d800 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.993+0000 7f20fcda0640 1 --2- 172.21.15.6:0/2170631974 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20f80ce520 0x7f20f80c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.993+0000 7f20fcda0640 1 -- 172.21.15.6:0/2170631974 >> 172.21.15.6:0/2170631974 conn(0x7f20f8071100 msgr2=0x7f20f80cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.993+0000 7f20fcda0640 1 -- 172.21.15.6:0/2170631974 shutdown_connections 2024-05-04T00:31:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.993+0000 7f20fcda0640 1 -- 172.21.15.6:0/2170631974 wait complete. 2024-05-04T00:31:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.997+0000 7f20fcda0640 1 Processor -- start 2024-05-04T00:31:25.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.997+0000 7f20fcda0640 1 -- start start 2024-05-04T00:31:25.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.997+0000 7f20fcda0640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20f80c7300 0x7f20f81f0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:25.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.997+0000 7f20fcda0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f80ce520 0x7f20f81e4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:25.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.997+0000 7f20fcda0640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20f815d3f0 0x7f20f81e2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:25.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.997+0000 7f20fcda0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f20f813fa80 con 0x7f20f80ce520 2024-05-04T00:31:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.997+0000 7f20fcda0640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f20f813f7a0 con 0x7f20f80c7300 2024-05-04T00:31:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.997+0000 7f20fcda0640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f20f8154410 con 0x7f20f815d3f0 2024-05-04T00:31:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.997+0000 7f20f5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f80ce520 0x7f20f81e4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.997+0000 7f20f5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f80ce520 0x7f20f81e4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34824/0 (socket says 172.21.15.6:34824) 2024-05-04T00:31:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:24.997+0000 7f20f5d9b640 1 -- 172.21.15.6:0/1079403614 learned_addr learned my addr 172.21.15.6:0/1079403614 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.005+0000 7f20f5d9b640 1 -- 172.21.15.6:0/1079403614 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20f815d3f0 msgr2=0x7f20f81e2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.005+0000 7f20f5d9b640 1 --2- 172.21.15.6:0/1079403614 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20f815d3f0 0x7f20f81e2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.005+0000 7f20f5d9b640 1 -- 172.21.15.6:0/1079403614 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20f80c7300 msgr2=0x7f20f81f0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.005+0000 7f20f5d9b640 1 --2- 172.21.15.6:0/1079403614 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20f80c7300 0x7f20f81f0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.005+0000 7f20f5d9b640 1 -- 172.21.15.6:0/1079403614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f81f07d0 con 0x7f20f80ce520 2024-05-04T00:31:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.005+0000 7f20f5d9b640 1 --2- 172.21.15.6:0/1079403614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f80ce520 0x7f20f81e4390 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f20ec01d3c0 tx=0x7f20ec01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:25.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.013+0000 7f20e6ffd640 1 -- 172.21.15.6:0/1079403614 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0b5050 con 0x7f20f80ce520 2024-05-04T00:31:25.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.013+0000 7f20e6ffd640 1 -- 172.21.15.6:0/1079403614 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ec0bf070 con 0x7f20f80ce520 2024-05-04T00:31:25.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.013+0000 7f20fcda0640 1 -- 172.21.15.6:0/1079403614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f81e4c20 con 0x7f20f80ce520 2024-05-04T00:31:25.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.013+0000 7f20e6ffd640 1 -- 172.21.15.6:0/1079403614 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0b0cf0 con 0x7f20f80ce520 2024-05-04T00:31:25.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.013+0000 7f20fcda0640 1 -- 172.21.15.6:0/1079403614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f81e5830 con 0x7f20f80ce520 2024-05-04T00:31:25.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.013+0000 7f20fcda0640 1 -- 172.21.15.6:0/1079403614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f806a390 con 0x7f20f80ce520 2024-05-04T00:31:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.041+0000 7f20e6ffd640 1 -- 172.21.15.6:0/1079403614 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f20ec0ba440 con 0x7f20f80ce520 2024-05-04T00:31:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.041+0000 7f20e6ffd640 1 --2- 172.21.15.6:0/1079403614 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f20d806f450 0x7f20d8071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.045+0000 7f20f659c640 1 --2- 172.21.15.6:0/1079403614 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f20d806f450 0x7f20d8071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.045+0000 7f20f659c640 1 --2- 172.21.15.6:0/1079403614 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f20d806f450 0x7f20d8071960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009690 tx=0x7f20e8006c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:25.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.353+0000 7f20e6ffd640 1 -- 172.21.15.6:0/1079403614 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7f20ec0bbde0 con 0x7f20f80ce520 2024-05-04T00:31:25.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.353+0000 7f20e6ffd640 1 -- 172.21.15.6:0/1079403614 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f20ec018870 con 0x7f20f80ce520 2024-05-04T00:31:25.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.545+0000 7f20fcda0640 1 -- 172.21.15.6:0/1079403614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20f80cbca0 con 0x7f20f80ce520 2024-05-04T00:31:25.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.817+0000 7f20e6ffd640 1 -- 172.21.15.6:0/1079403614 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16537 (secure 0 0 0) 0x7f20ec0a89a0 con 0x7f20f80ce520 2024-05-04T00:31:25.819 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:31:25.819 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"ad5951ed-0d5e-4770-b5d9-995e08a00213","created":"2024-05-04T00:30:11.236352+0000","modified":"2024-05-04T00:31:23.389354+0000","last_up_change":"2024-05-04T00:30:35.679943+0000","last_in_change":"2024-05-04T00:30:24.926330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T00:30:36.311072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T00:31:17.278288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T00:31:18.957819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a907d753-b7cf-499c-ae36-81e44ed933a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6805","nonce":489144503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6810","nonce":489144503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6824","nonce":489144503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6813","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6817","nonce":489144503}]},"public_addr":"172.21.15.6:6805/489144503","cluster_addr":"172.21.15.6:6810/489144503","heartbeat_back_addr":"172.21.15.6:6824/489144503","heartbeat_front_addr":"172.21.15.6:6817/489144503","state":["exists","up"]},{"osd":1,"uuid":"eab41a32-d5f1-43b8-8835-f2d4bffc9cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6802","nonce":3099957279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6807","nonce":3099957279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6819","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6823","nonce":3099957279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6815","nonce":3099957279}]},"public_addr":"172.21.15.6:6802/3099957279","cluster_addr":"172.21.15.6:6807/3099957279","heartbeat_back_addr":"172.21.15.6:6823/3099957279","heartbeat_front_addr":"172.21.15.6:6815/3099957279","state":["exists","up"]},{"osd":2,"uuid":"f2540144-b533-4ffc-a9cf-24f0e4910a9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6801","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6806","nonce":2770857903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6809","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6812","nonce":2770857903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6827","nonce":2770857903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6821","nonce":2770857903}]},"public_addr":"172.21.15.6:6806/2770857903","cluster_addr":"172.21.15.6:6812/2770857903","heartbeat_back_addr":"172.21.15.6:6827/2770857903","heartbeat_front_addr":"172.21.15.6:6821/2770857903","state":["exists","up"]},{"osd":3,"uuid":"982b7ace-fd02-4f03-aef2-0428468f8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6818","nonce":3149875909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6826","nonce":3149875909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6831","nonce":3149875909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6829","nonce":3149875909}]},"public_addr":"172.21.15.6:6818/3149875909","cluster_addr":"172.21.15.6:6826/3149875909","heartbeat_back_addr":"172.21.15.6:6831/3149875909","heartbeat_front_addr":"172.21.15.6:6829/3149875909","state":["exists","up"]},{"osd":4,"uuid":"ecf94166-cfdf-4ac8-a659-6ae907686e8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6818","nonce":2508264225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6821","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6824","nonce":2508264225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6833","nonce":2508264225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6831","nonce":2508264225}]},"public_addr":"172.21.15.163:6818/2508264225","cluster_addr":"172.21.15.163:6824/2508264225","heartbeat_back_addr":"172.21.15.163:6833/2508264225","heartbeat_front_addr":"172.21.15.163:6831/2508264225","state":["exists","up"]},{"osd":5,"uuid":"fc5cfa90-0e3a-4fc2-829c-5ff57d7a5953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6815","nonce":167619435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6820","nonce":167619435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6827","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6829","nonce":167619435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6825","nonce":167619435}]},"public_addr":"172.21.15.163:6815/167619435","cluster_addr":"172.21.15.163:6820/167619435","heartbeat_back_addr":"172.21.15.163:6829/167619435","heartbeat_front_addr":"172.21.15.163:6825/167619435","state":["exists","up"]},{"osd":6,"uuid":"ed95f0cf-f309-4861-b47c-4a5a6b44ffdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6811","nonce":1460767610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6813","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6814","nonce":1460767610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6830","nonce":1460767610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6819","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6822","nonce":1460767610}]},"public_addr":"172.21.15.163:6811/1460767610","cluster_addr":"172.21.15.163:6814/1460767610","heartbeat_back_addr":"172.21.15.163:6830/1460767610","heartbeat_front_addr":"172.21.15.163:6822/1460767610","state":["exists","up"]},{"osd":7,"uuid":"2f57afcd-567f-44f6-9db7-df0342c8c4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6803","nonce":239650691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6805","nonce":239650691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6809","nonce":239650691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6807","nonce":239650691}]},"public_addr":"172.21.15.163:6803/239650691","cluster_addr":"172.21.15.163:6805/239650691","heartbeat_back_addr":"172.21.15.163:6809/239650691","heartbeat_front_addr":"172.21.15.163:6807/239650691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.818870+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.749094+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.805522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.576430+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.740084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.755726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.797961+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.577731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T00:31:25.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.821+0000 7f20fcda0640 1 -- 172.21.15.6:0/1079403614 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f20d806f450 msgr2=0x7f20d8071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:25.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.821+0000 7f20fcda0640 1 --2- 172.21.15.6:0/1079403614 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f20d806f450 0x7f20d8071960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009690 tx=0x7f20e8006c00 comp rx=0 tx=0).stop 2024-05-04T00:31:25.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.821+0000 7f20fcda0640 1 -- 172.21.15.6:0/1079403614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f80ce520 msgr2=0x7f20f81e4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:25.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.821+0000 7f20fcda0640 1 --2- 172.21.15.6:0/1079403614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f80ce520 0x7f20f81e4390 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f20ec01d3c0 tx=0x7f20ec01bab0 comp rx=0 tx=0).stop 2024-05-04T00:31:25.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.821+0000 7f20fcda0640 1 -- 172.21.15.6:0/1079403614 shutdown_connections 2024-05-04T00:31:25.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.821+0000 7f20fcda0640 1 --2- 172.21.15.6:0/1079403614 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f20d806f450 0x7f20d8071960 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:25.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.821+0000 7f20fcda0640 1 --2- 172.21.15.6:0/1079403614 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20f815d3f0 0x7f20f81e2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:25.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.821+0000 7f20fcda0640 1 --2- 172.21.15.6:0/1079403614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f80ce520 0x7f20f81e4390 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:25.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.821+0000 7f20fcda0640 1 --2- 172.21.15.6:0/1079403614 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20f80c7300 0x7f20f81f0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:25.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.821+0000 7f20fcda0640 1 -- 172.21.15.6:0/1079403614 >> 172.21.15.6:0/1079403614 conn(0x7f20f8071100 msgr2=0x7f20f8074660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:25.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.821+0000 7f20fcda0640 1 -- 172.21.15.6:0/1079403614 shutdown_connections 2024-05-04T00:31:25.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:25.821+0000 7f20fcda0640 1 -- 172.21.15.6:0/1079403614 wait complete. 2024-05-04T00:31:25.848 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-04T00:31:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.005+0000 7fb737f6a640 1 Processor -- start 2024-05-04T00:31:26.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.005+0000 7fb737f6a640 1 -- start start 2024-05-04T00:31:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.005+0000 7fb737f6a640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb73015c160 0x7fb7301562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.005+0000 7fb737f6a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb7300ccec0 0x7fb7300cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.005+0000 7fb737f6a640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb7300cc6a0 0x7fb7300caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:26.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.005+0000 7fb737f6a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb7300ca5e0 con 0x7fb7300ccec0 2024-05-04T00:31:26.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.005+0000 7fb737f6a640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fb7300ca2c0 con 0x7fb73015c160 2024-05-04T00:31:26.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.005+0000 7fb737f6a640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fb73015c610 con 0x7fb7300cc6a0 2024-05-04T00:31:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.057+0000 7fb735505640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb7300ccec0 0x7fb7300cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.057+0000 7fb735505640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb7300ccec0 0x7fb7300cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34832/0 (socket says 172.21.15.6:34832) 2024-05-04T00:31:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.057+0000 7fb735505640 1 -- 172.21.15.6:0/1159413148 learned_addr learned my addr 172.21.15.6:0/1159413148 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:26.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.065+0000 7fb735505640 1 -- 172.21.15.6:0/1159413148 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb7300cc6a0 msgr2=0x7fb7300caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:26.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.065+0000 7fb735505640 1 --2- 172.21.15.6:0/1159413148 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb7300cc6a0 0x7fb7300caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:26.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.065+0000 7fb735505640 1 -- 172.21.15.6:0/1159413148 >> v2:172.21.15.163:3300/0 conn(0x7fb73015c160 msgr2=0x7fb7301562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:26.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.065+0000 7fb735505640 1 --2- 172.21.15.6:0/1159413148 >> v2:172.21.15.163:3300/0 conn(0x7fb73015c160 0x7fb7301562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:26.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.065+0000 7fb735505640 1 -- 172.21.15.6:0/1159413148 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73015c8f0 con 0x7fb7300ccec0 2024-05-04T00:31:26.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.073+0000 7fb735505640 1 --2- 172.21.15.6:0/1159413148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7300ccec0 0x7fb7300cc160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb7300cd9d0 tx=0x7fb72401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee69d95314dd189 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:26.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.081+0000 7fb734d04640 1 -- 172.21.15.6:0/1159413148 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7240ab5f0 con 0x7fb7300ccec0 2024-05-04T00:31:26.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.081+0000 7fb734d04640 1 -- 172.21.15.6:0/1159413148 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7240b0070 con 0x7fb7300ccec0 2024-05-04T00:31:26.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.081+0000 7fb734d04640 1 -- 172.21.15.6:0/1159413148 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7240ab9b0 con 0x7fb7300ccec0 2024-05-04T00:31:26.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.081+0000 7fb737f6a640 1 -- 172.21.15.6:0/1159413148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7300ccec0 msgr2=0x7fb7300cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:26.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.081+0000 7fb737f6a640 1 --2- 172.21.15.6:0/1159413148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7300ccec0 0x7fb7300cc160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb7300cd9d0 tx=0x7fb72401c520 comp rx=0 tx=0).stop 2024-05-04T00:31:26.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.081+0000 7fb737f6a640 1 -- 172.21.15.6:0/1159413148 shutdown_connections 2024-05-04T00:31:26.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.081+0000 7fb737f6a640 1 --2- 172.21.15.6:0/1159413148 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb7300cc6a0 0x7fb7300caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:26.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.081+0000 7fb737f6a640 1 --2- 172.21.15.6:0/1159413148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7300ccec0 0x7fb7300cc160 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:26.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.081+0000 7fb737f6a640 1 --2- 172.21.15.6:0/1159413148 >> v2:172.21.15.163:3300/0 conn(0x7fb73015c160 0x7fb7301562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:26.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.081+0000 7fb737f6a640 1 -- 172.21.15.6:0/1159413148 >> 172.21.15.6:0/1159413148 conn(0x7fb73006cb80 msgr2=0x7fb73006cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:26.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.081+0000 7fb737f6a640 1 -- 172.21.15.6:0/1159413148 shutdown_connections 2024-05-04T00:31:26.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.081+0000 7fb737f6a640 1 -- 172.21.15.6:0/1159413148 wait complete. 2024-05-04T00:31:26.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.085+0000 7fb737f6a640 1 Processor -- start 2024-05-04T00:31:26.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.085+0000 7fb737f6a640 1 -- start start 2024-05-04T00:31:26.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.089+0000 7fb737f6a640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb7300cc6a0 0x7fb7301f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:26.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.089+0000 7fb737f6a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7300ccec0 0x7fb7300c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:26.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.089+0000 7fb737f6a640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb73015c160 0x7fb73014cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:26.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.089+0000 7fb737f6a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb73015ff60 con 0x7fb7300ccec0 2024-05-04T00:31:26.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.089+0000 7fb737f6a640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb7300cd2d0 con 0x7fb73015c160 2024-05-04T00:31:26.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.089+0000 7fb737f6a640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fb7301600e0 con 0x7fb7300cc6a0 2024-05-04T00:31:26.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.089+0000 7fb735505640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7300ccec0 0x7fb7300c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:26.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.093+0000 7fb735505640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7300ccec0 0x7fb7300c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34844/0 (socket says 172.21.15.6:34844) 2024-05-04T00:31:26.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.093+0000 7fb735505640 1 -- 172.21.15.6:0/2891671028 learned_addr learned my addr 172.21.15.6:0/2891671028 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:26.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.101+0000 7fb735505640 1 -- 172.21.15.6:0/2891671028 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb7300cc6a0 msgr2=0x7fb7301f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:26.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.101+0000 7fb735505640 1 --2- 172.21.15.6:0/2891671028 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb7300cc6a0 0x7fb7301f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:26.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.101+0000 7fb735505640 1 -- 172.21.15.6:0/2891671028 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb73015c160 msgr2=0x7fb73014cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:26.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.101+0000 7fb735505640 1 --2- 172.21.15.6:0/2891671028 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb73015c160 0x7fb73014cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:26.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.101+0000 7fb735505640 1 -- 172.21.15.6:0/2891671028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7301f9180 con 0x7fb7300ccec0 2024-05-04T00:31:26.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.109+0000 7fb735505640 1 --2- 172.21.15.6:0/2891671028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7300ccec0 0x7fb7300c7450 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb72401cdc0 tx=0x7fb72401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:26.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.121+0000 7fb72e7fc640 1 -- 172.21.15.6:0/2891671028 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7240be5f0 con 0x7fb7300ccec0 2024-05-04T00:31:26.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.121+0000 7fb72e7fc640 1 -- 172.21.15.6:0/2891671028 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7240be7b0 con 0x7fb7300ccec0 2024-05-04T00:31:26.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.121+0000 7fb72e7fc640 1 -- 172.21.15.6:0/2891671028 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7240beba0 con 0x7fb7300ccec0 2024-05-04T00:31:26.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.121+0000 7fb737f6a640 1 -- 172.21.15.6:0/2891671028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7301f9460 con 0x7fb7300ccec0 2024-05-04T00:31:26.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.121+0000 7fb737f6a640 1 -- 172.21.15.6:0/2891671028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb73014e2b0 con 0x7fb7300ccec0 2024-05-04T00:31:26.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.121+0000 7fb737f6a640 1 -- 172.21.15.6:0/2891671028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb730069a50 con 0x7fb7300ccec0 2024-05-04T00:31:26.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.493+0000 7fb72e7fc640 1 -- 172.21.15.6:0/2891671028 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb7240b43f0 con 0x7fb7300ccec0 2024-05-04T00:31:26.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.493+0000 7fb72e7fc640 1 --2- 172.21.15.6:0/2891671028 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb71c06f400 0x7fb71c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:26.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.493+0000 7fb735d06640 1 --2- 172.21.15.6:0/2891671028 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb71c06f400 0x7fb71c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:26.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.493+0000 7fb735d06640 1 --2- 172.21.15.6:0/2891671028 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb71c06f400 0x7fb71c071910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb72800ab90 tx=0x7fb728009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:26.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.533+0000 7fb72e7fc640 1 -- 172.21.15.6:0/2891671028 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fb7240f24c0 con 0x7fb7300ccec0 2024-05-04T00:31:26.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.533+0000 7fb72e7fc640 1 -- 172.21.15.6:0/2891671028 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb7240c4060 con 0x7fb7300ccec0 2024-05-04T00:31:26.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:26.781+0000 7fb737f6a640 1 -- 172.21.15.6:0/2891671028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb7300ccca0 con 0x7fb7300ccec0 2024-05-04T00:31:28.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.221+0000 7fb72e7fc640 1 -- 172.21.15.6:0/2891671028 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fb724016110 con 0x7fb7300ccec0 2024-05-04T00:31:28.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.225+0000 7fb737f6a640 1 -- 172.21.15.6:0/2891671028 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb71c06f400 msgr2=0x7fb71c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:28.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.225+0000 7fb737f6a640 1 --2- 172.21.15.6:0/2891671028 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb71c06f400 0x7fb71c071910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb72800ab90 tx=0x7fb728009250 comp rx=0 tx=0).stop 2024-05-04T00:31:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.225+0000 7fb737f6a640 1 -- 172.21.15.6:0/2891671028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7300ccec0 msgr2=0x7fb7300c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.225+0000 7fb737f6a640 1 --2- 172.21.15.6:0/2891671028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7300ccec0 0x7fb7300c7450 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb72401cdc0 tx=0x7fb72401ad60 comp rx=0 tx=0).stop 2024-05-04T00:31:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.225+0000 7fb737f6a640 1 -- 172.21.15.6:0/2891671028 shutdown_connections 2024-05-04T00:31:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.225+0000 7fb737f6a640 1 --2- 172.21.15.6:0/2891671028 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb73015c160 0x7fb73014cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.225+0000 7fb737f6a640 1 --2- 172.21.15.6:0/2891671028 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb71c06f400 0x7fb71c071910 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.225+0000 7fb737f6a640 1 --2- 172.21.15.6:0/2891671028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7300ccec0 0x7fb7300c7450 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.225+0000 7fb737f6a640 1 --2- 172.21.15.6:0/2891671028 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb7300cc6a0 0x7fb7301f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.225+0000 7fb737f6a640 1 -- 172.21.15.6:0/2891671028 >> 172.21.15.6:0/2891671028 conn(0x7fb73006cb80 msgr2=0x7fb7300cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.225+0000 7fb737f6a640 1 -- 172.21.15.6:0/2891671028 shutdown_connections 2024-05-04T00:31:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.225+0000 7fb737f6a640 1 -- 172.21.15.6:0/2891671028 wait complete. 2024-05-04T00:31:28.250 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300} 2024-05-04T00:31:28.251 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-05-04T00:31:28.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.409+0000 7f06cf52b640 1 Processor -- start 2024-05-04T00:31:28.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.409+0000 7f06cf52b640 1 -- start start 2024-05-04T00:31:28.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.409+0000 7f06cf52b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06c80cea80 0x7f06c80b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:28.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.409+0000 7f06cf52b640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f06c8164c90 0x7f06c81670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:28.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.409+0000 7f06cf52b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06c815ce40 con 0x7f06c80b4b00 2024-05-04T00:31:28.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.409+0000 7f06cf52b640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f06c80cdd50 con 0x7f06c8164c90 2024-05-04T00:31:28.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.409+0000 7f06cf52b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f06c80cbad0 con 0x7f06c80cea80 2024-05-04T00:31:28.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.413+0000 7f06cdac8640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f06c8164c90 0x7f06c81670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:28.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.413+0000 7f06ccac6640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06c80cea80 0x7f06c80b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:28.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.413+0000 7f06cdac8640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f06c8164c90 0x7f06c81670b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:47224/0 (socket says 172.21.15.6:47224) 2024-05-04T00:31:28.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.413+0000 7f06cdac8640 1 -- 172.21.15.6:0/3790801976 learned_addr learned my addr 172.21.15.6:0/3790801976 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:28.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.417+0000 7f06ccac6640 1 -- 172.21.15.6:0/3790801976 >> v2:172.21.15.163:3300/0 conn(0x7f06c8164c90 msgr2=0x7f06c81670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:28.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.417+0000 7f06ccac6640 1 --2- 172.21.15.6:0/3790801976 >> v2:172.21.15.163:3300/0 conn(0x7f06c8164c90 0x7f06c81670b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:28.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.417+0000 7f06ccac6640 1 -- 172.21.15.6:0/3790801976 >> v1:172.21.15.6:6789/0 conn(0x7f06c80b4b00 legacy=0x7f06c80d1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:28.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.417+0000 7f06ccac6640 1 -- 172.21.15.6:0/3790801976 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c815d120 con 0x7f06c80cea80 2024-05-04T00:31:28.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.425+0000 7f06ccac6640 1 --2- 172.21.15.6:0/3790801976 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06c80cea80 0x7f06c80b3ec0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f06b80097c0 tx=0x7f06b801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf21a734f84d4590 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:28.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.437+0000 7f06bffff640 1 -- 172.21.15.6:0/3790801976 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b80b0070 con 0x7f06c80cea80 2024-05-04T00:31:28.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.437+0000 7f06bffff640 1 -- 172.21.15.6:0/3790801976 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b80ab600 con 0x7f06c80cea80 2024-05-04T00:31:28.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.437+0000 7f06bffff640 1 -- 172.21.15.6:0/3790801976 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b80ab9d0 con 0x7f06c80cea80 2024-05-04T00:31:28.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.437+0000 7f06cf52b640 1 -- 172.21.15.6:0/3790801976 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06c80cea80 msgr2=0x7f06c80b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:28.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.437+0000 7f06cf52b640 1 --2- 172.21.15.6:0/3790801976 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06c80cea80 0x7f06c80b3ec0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f06b80097c0 tx=0x7f06b801c380 comp rx=0 tx=0).stop 2024-05-04T00:31:28.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.437+0000 7f06cf52b640 1 -- 172.21.15.6:0/3790801976 shutdown_connections 2024-05-04T00:31:28.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.437+0000 7f06cf52b640 1 --2- 172.21.15.6:0/3790801976 >> v2:172.21.15.163:3300/0 conn(0x7f06c8164c90 0x7f06c81670b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:28.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.437+0000 7f06cf52b640 1 --2- 172.21.15.6:0/3790801976 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06c80cea80 0x7f06c80b3ec0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:28.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.437+0000 7f06cf52b640 1 -- 172.21.15.6:0/3790801976 >> 172.21.15.6:0/3790801976 conn(0x7f06c806da40 msgr2=0x7f06c806de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:28.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.437+0000 7f06cf52b640 1 -- 172.21.15.6:0/3790801976 shutdown_connections 2024-05-04T00:31:28.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.437+0000 7f06cf52b640 1 -- 172.21.15.6:0/3790801976 wait complete. 2024-05-04T00:31:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.441+0000 7f06cf52b640 1 Processor -- start 2024-05-04T00:31:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.441+0000 7f06cf52b640 1 -- start start 2024-05-04T00:31:28.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.441+0000 7f06cf52b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06c80b4b00 0x7f06c81f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:28.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.441+0000 7f06cf52b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c80cea80 0x7f06c81600c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:28.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.441+0000 7f06cf52b640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f06c8164c90 0x7f06c8166480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:28.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.441+0000 7f06cf52b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f06c80cee90 con 0x7f06c80cea80 2024-05-04T00:31:28.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.441+0000 7f06cf52b640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f06c80cd440 con 0x7f06c8164c90 2024-05-04T00:31:28.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.441+0000 7f06cf52b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f06c80b4750 con 0x7f06c80b4b00 2024-05-04T00:31:28.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.445+0000 7f06ccac6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c80cea80 0x7f06c81600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:28.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.445+0000 7f06ccac6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c80cea80 0x7f06c81600c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34852/0 (socket says 172.21.15.6:34852) 2024-05-04T00:31:28.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.445+0000 7f06ccac6640 1 -- 172.21.15.6:0/2715660008 learned_addr learned my addr 172.21.15.6:0/2715660008 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:28.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.449+0000 7f06ccac6640 1 -- 172.21.15.6:0/2715660008 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06c80b4b00 msgr2=0x7f06c81f5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:28.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.449+0000 7f06ccac6640 1 --2- 172.21.15.6:0/2715660008 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06c80b4b00 0x7f06c81f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:28.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.449+0000 7f06ccac6640 1 -- 172.21.15.6:0/2715660008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f06c8164c90 msgr2=0x7f06c8166480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:28.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.449+0000 7f06ccac6640 1 --2- 172.21.15.6:0/2715660008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f06c8164c90 0x7f06c8166480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:28.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.449+0000 7f06ccac6640 1 -- 172.21.15.6:0/2715660008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c81669c0 con 0x7f06c80cea80 2024-05-04T00:31:28.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.453+0000 7f06ccac6640 1 --2- 172.21.15.6:0/2715660008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c80cea80 0x7f06c81600c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f06b801cc20 tx=0x7f06b8019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:28.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.461+0000 7f06bdffb640 1 -- 172.21.15.6:0/2715660008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b80b8020 con 0x7f06c80cea80 2024-05-04T00:31:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.461+0000 7f06bdffb640 1 -- 172.21.15.6:0/2715660008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b80b4600 con 0x7f06c80cea80 2024-05-04T00:31:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.461+0000 7f06cf52b640 1 -- 172.21.15.6:0/2715660008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c8165140 con 0x7f06c80cea80 2024-05-04T00:31:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.461+0000 7f06bdffb640 1 -- 172.21.15.6:0/2715660008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b80b0040 con 0x7f06c80cea80 2024-05-04T00:31:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.461+0000 7f06cf52b640 1 -- 172.21.15.6:0/2715660008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c81656c0 con 0x7f06c80cea80 2024-05-04T00:31:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.461+0000 7f06cf52b640 1 -- 172.21.15.6:0/2715660008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06c806a390 con 0x7f06c80cea80 2024-05-04T00:31:28.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.489+0000 7f06bdffb640 1 -- 172.21.15.6:0/2715660008 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f06b80bb020 con 0x7f06c80cea80 2024-05-04T00:31:28.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.489+0000 7f06bdffb640 1 --2- 172.21.15.6:0/2715660008 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f06ac06f400 0x7f06ac071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:28.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.493+0000 7f06cd2c7640 1 --2- 172.21.15.6:0/2715660008 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f06ac06f400 0x7f06ac071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:28.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.493+0000 7f06cd2c7640 1 --2- 172.21.15.6:0/2715660008 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f06ac06f400 0x7f06ac071910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f06c80c4ff0 tx=0x7f06c4009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.845+0000 7f06bdffb640 1 -- 172.21.15.6:0/2715660008 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f06b80ab4c0 con 0x7f06c80cea80 2024-05-04T00:31:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:28.845+0000 7f06bdffb640 1 -- 172.21.15.6:0/2715660008 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f06b8016090 con 0x7f06c80cea80 2024-05-04T00:31:29.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.081+0000 7f06cf52b640 1 -- 172.21.15.6:0/2715660008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f06c80d0ce0 con 0x7f06c80cea80 2024-05-04T00:31:29.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.785+0000 7f06bdffb640 1 -- 172.21.15.6:0/2715660008 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v8) ==== 105+0+0 (secure 0 0 0) 0x7f06b80f6880 con 0x7f06c80cea80 2024-05-04T00:31:29.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.789+0000 7f06cf52b640 1 -- 172.21.15.6:0/2715660008 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f06ac06f400 msgr2=0x7f06ac071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:29.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.789+0000 7f06cf52b640 1 --2- 172.21.15.6:0/2715660008 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f06ac06f400 0x7f06ac071910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f06c80c4ff0 tx=0x7f06c4009250 comp rx=0 tx=0).stop 2024-05-04T00:31:29.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.789+0000 7f06cf52b640 1 -- 172.21.15.6:0/2715660008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c80cea80 msgr2=0x7f06c81600c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:29.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.789+0000 7f06cf52b640 1 --2- 172.21.15.6:0/2715660008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c80cea80 0x7f06c81600c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f06b801cc20 tx=0x7f06b8019120 comp rx=0 tx=0).stop 2024-05-04T00:31:29.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.789+0000 7f06cf52b640 1 -- 172.21.15.6:0/2715660008 shutdown_connections 2024-05-04T00:31:29.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.789+0000 7f06cf52b640 1 --2- 172.21.15.6:0/2715660008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f06c8164c90 0x7f06c8166480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:29.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.789+0000 7f06cf52b640 1 --2- 172.21.15.6:0/2715660008 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f06ac06f400 0x7f06ac071910 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:29.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.789+0000 7f06cf52b640 1 --2- 172.21.15.6:0/2715660008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c80cea80 0x7f06c81600c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:29.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.789+0000 7f06cf52b640 1 --2- 172.21.15.6:0/2715660008 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06c80b4b00 0x7f06c81f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:29.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.789+0000 7f06cf52b640 1 -- 172.21.15.6:0/2715660008 >> 172.21.15.6:0/2715660008 conn(0x7f06c806da40 msgr2=0x7f06c80cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:29.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.789+0000 7f06cf52b640 1 -- 172.21.15.6:0/2715660008 shutdown_connections 2024-05-04T00:31:29.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.789+0000 7f06cf52b640 1 -- 172.21.15.6:0/2715660008 wait complete. 2024-05-04T00:31:29.819 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-04T00:31:29.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.981+0000 7fa776c31640 1 Processor -- start 2024-05-04T00:31:29.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.981+0000 7fa776c31640 1 -- start start 2024-05-04T00:31:29.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.981+0000 7fa776c31640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa7700738c0 0x7fa7700c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:29.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.981+0000 7fa776c31640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa770073cd0 0x7fa7700c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:29.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.981+0000 7fa776c31640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa770072bc0 con 0x7fa770159780 2024-05-04T00:31:29.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.981+0000 7fa776c31640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa7700c6710 con 0x7fa770073cd0 2024-05-04T00:31:29.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.981+0000 7fa776c31640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa7700ca420 con 0x7fa7700738c0 2024-05-04T00:31:29.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.981+0000 7fa7751ce640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa770073cd0 0x7fa7700c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:29.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.981+0000 7fa7751ce640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa770073cd0 0x7fa7700c4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34856/0 (socket says 172.21.15.6:34856) 2024-05-04T00:31:29.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.981+0000 7fa7751ce640 1 -- 172.21.15.6:0/1480646707 learned_addr learned my addr 172.21.15.6:0/1480646707 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:29.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.981+0000 7fa76ffff640 1 --2- 172.21.15.6:0/1480646707 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa7700738c0 0x7fa7700c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:29.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.985+0000 7fa7751ce640 1 -- 172.21.15.6:0/1480646707 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa7700738c0 msgr2=0x7fa7700c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:29.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.985+0000 7fa7751ce640 1 --2- 172.21.15.6:0/1480646707 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa7700738c0 0x7fa7700c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:29.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.985+0000 7fa7751ce640 1 -- 172.21.15.6:0/1480646707 >> v1:172.21.15.6:6789/0 conn(0x7fa770159780 legacy=0x7fa770152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:29.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.985+0000 7fa7751ce640 1 -- 172.21.15.6:0/1480646707 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa770072ea0 con 0x7fa770073cd0 2024-05-04T00:31:29.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:29.989+0000 7fa7751ce640 1 --2- 172.21.15.6:0/1480646707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa770073cd0 0x7fa7700c4b30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa770072680 tx=0x7fa76801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0f3f027da96f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.001+0000 7fa76f7fe640 1 -- 172.21.15.6:0/1480646707 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7680a5800 con 0x7fa770073cd0 2024-05-04T00:31:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.001+0000 7fa76f7fe640 1 -- 172.21.15.6:0/1480646707 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7680a59a0 con 0x7fa770073cd0 2024-05-04T00:31:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.001+0000 7fa76f7fe640 1 -- 172.21.15.6:0/1480646707 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7680a5d70 con 0x7fa770073cd0 2024-05-04T00:31:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.001+0000 7fa776c31640 1 -- 172.21.15.6:0/1480646707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa770073cd0 msgr2=0x7fa7700c4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.001+0000 7fa776c31640 1 --2- 172.21.15.6:0/1480646707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa770073cd0 0x7fa7700c4b30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa770072680 tx=0x7fa76801c9c0 comp rx=0 tx=0).stop 2024-05-04T00:31:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.001+0000 7fa776c31640 1 -- 172.21.15.6:0/1480646707 shutdown_connections 2024-05-04T00:31:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.001+0000 7fa776c31640 1 --2- 172.21.15.6:0/1480646707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa770073cd0 0x7fa7700c4b30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.001+0000 7fa776c31640 1 --2- 172.21.15.6:0/1480646707 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa7700738c0 0x7fa7700c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.001+0000 7fa776c31640 1 -- 172.21.15.6:0/1480646707 >> 172.21.15.6:0/1480646707 conn(0x7fa77006cf70 msgr2=0x7fa7700c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.001+0000 7fa776c31640 1 -- 172.21.15.6:0/1480646707 shutdown_connections 2024-05-04T00:31:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.001+0000 7fa776c31640 1 -- 172.21.15.6:0/1480646707 wait complete. 2024-05-04T00:31:30.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.001+0000 7fa776c31640 1 Processor -- start 2024-05-04T00:31:30.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.001+0000 7fa776c31640 1 -- start start 2024-05-04T00:31:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.005+0000 7fa776c31640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7700738c0 0x7fa7701f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.005+0000 7fa776c31640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa770073cd0 0x7fa7700cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.005+0000 7fa776c31640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa770159780 0x7fa77013d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.005+0000 7fa776c31640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa7700c7440 con 0x7fa770073cd0 2024-05-04T00:31:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.005+0000 7fa776c31640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa770159b90 con 0x7fa7700738c0 2024-05-04T00:31:30.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.005+0000 7fa776c31640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa7701f43e0 con 0x7fa770159780 2024-05-04T00:31:30.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.005+0000 7fa76ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa770073cd0 0x7fa7700cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:30.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.005+0000 7fa7751ce640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa770159780 0x7fa77013d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:30.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.005+0000 7fa76ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa770073cd0 0x7fa7700cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34860/0 (socket says 172.21.15.6:34860) 2024-05-04T00:31:30.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.005+0000 7fa76ffff640 1 -- 172.21.15.6:0/1215729211 learned_addr learned my addr 172.21.15.6:0/1215729211 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:30.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.005+0000 7fa7749cd640 1 --2- 172.21.15.6:0/1215729211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7700738c0 0x7fa7701f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:30.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.009+0000 7fa76ffff640 1 -- 172.21.15.6:0/1215729211 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa770159780 msgr2=0x7fa77013d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:30.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.009+0000 7fa76ffff640 1 --2- 172.21.15.6:0/1215729211 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa770159780 0x7fa77013d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:30.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.009+0000 7fa76ffff640 1 -- 172.21.15.6:0/1215729211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7700738c0 msgr2=0x7fa7701f39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:30.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.009+0000 7fa76ffff640 1 --2- 172.21.15.6:0/1215729211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7700738c0 0x7fa7701f39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:30.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.009+0000 7fa76ffff640 1 -- 172.21.15.6:0/1215729211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7701f3f10 con 0x7fa770073cd0 2024-05-04T00:31:30.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.013+0000 7fa76ffff640 1 --2- 172.21.15.6:0/1215729211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa770073cd0 0x7fa7700cb350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00e8a0 tx=0x7fa75c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:30.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.017+0000 7fa76d7fa640 1 -- 172.21.15.6:0/1215729211 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c017070 con 0x7fa770073cd0 2024-05-04T00:31:30.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.017+0000 7fa76d7fa640 1 -- 172.21.15.6:0/1215729211 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75c00c8e0 con 0x7fa770073cd0 2024-05-04T00:31:30.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.017+0000 7fa776c31640 1 -- 172.21.15.6:0/1215729211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7701f6f20 con 0x7fa770073cd0 2024-05-04T00:31:30.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.017+0000 7fa76d7fa640 1 -- 172.21.15.6:0/1215729211 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00cc90 con 0x7fa770073cd0 2024-05-04T00:31:30.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.017+0000 7fa776c31640 1 -- 172.21.15.6:0/1215729211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7701f74e0 con 0x7fa770073cd0 2024-05-04T00:31:30.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.017+0000 7fa776c31640 1 -- 172.21.15.6:0/1215729211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7701f6c90 con 0x7fa770073cd0 2024-05-04T00:31:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.345+0000 7fa76d7fa640 1 -- 172.21.15.6:0/1215729211 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa75c01a070 con 0x7fa770073cd0 2024-05-04T00:31:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.349+0000 7fa76d7fa640 1 --2- 172.21.15.6:0/1215729211 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fa75406f400 0x7fa754071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.349+0000 7fa7749cd640 1 --2- 172.21.15.6:0/1215729211 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fa75406f400 0x7fa754071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:30.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.349+0000 7fa7749cd640 1 --2- 172.21.15.6:0/1215729211 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fa75406f400 0x7fa754071910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa7640098e0 tx=0x7fa764009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:30.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.381+0000 7fa76d7fa640 1 -- 172.21.15.6:0/1215729211 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fa75c00ce30 con 0x7fa770073cd0 2024-05-04T00:31:30.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.381+0000 7fa76d7fa640 1 -- 172.21.15.6:0/1215729211 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa75c05c170 con 0x7fa770073cd0 2024-05-04T00:31:30.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:30.597+0000 7fa776c31640 1 -- 172.21.15.6:0/1215729211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa77006a390 con 0x7fa770073cd0 2024-05-04T00:31:31.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.505+0000 7fa76d7fa640 1 -- 172.21.15.6:0/1215729211 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7fa75c060470 con 0x7fa770073cd0 2024-05-04T00:31:31.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.509+0000 7fa776c31640 1 -- 172.21.15.6:0/1215729211 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fa75406f400 msgr2=0x7fa754071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:31.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.509+0000 7fa776c31640 1 --2- 172.21.15.6:0/1215729211 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fa75406f400 0x7fa754071910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa7640098e0 tx=0x7fa764009060 comp rx=0 tx=0).stop 2024-05-04T00:31:31.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.509+0000 7fa776c31640 1 -- 172.21.15.6:0/1215729211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa770073cd0 msgr2=0x7fa7700cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:31.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.509+0000 7fa776c31640 1 --2- 172.21.15.6:0/1215729211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa770073cd0 0x7fa7700cb350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00e8a0 tx=0x7fa75c00eca0 comp rx=0 tx=0).stop 2024-05-04T00:31:31.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.509+0000 7fa776c31640 1 -- 172.21.15.6:0/1215729211 shutdown_connections 2024-05-04T00:31:31.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.509+0000 7fa776c31640 1 --2- 172.21.15.6:0/1215729211 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fa75406f400 0x7fa754071910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:31.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.509+0000 7fa776c31640 1 --2- 172.21.15.6:0/1215729211 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa770159780 0x7fa77013d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:31.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.509+0000 7fa776c31640 1 --2- 172.21.15.6:0/1215729211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa770073cd0 0x7fa7700cb350 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:31.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.509+0000 7fa776c31640 1 --2- 172.21.15.6:0/1215729211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7700738c0 0x7fa7701f39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:31.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.509+0000 7fa776c31640 1 -- 172.21.15.6:0/1215729211 >> 172.21.15.6:0/1215729211 conn(0x7fa77006cf70 msgr2=0x7fa770158e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:31.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.509+0000 7fa776c31640 1 -- 172.21.15.6:0/1215729211 shutdown_connections 2024-05-04T00:31:31.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.509+0000 7fa776c31640 1 -- 172.21.15.6:0/1215729211 wait complete. 2024-05-04T00:31:31.536 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-05-04T00:31:31.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.701+0000 7f02dd2c5640 1 Processor -- start 2024-05-04T00:31:31.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.701+0000 7f02dd2c5640 1 -- start start 2024-05-04T00:31:31.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.701+0000 7f02dd2c5640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02d814f780 0x7f02d80cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:31.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.701+0000 7f02dd2c5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d8159090 con 0x7f02d80c9c60 2024-05-04T00:31:31.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.701+0000 7f02dd2c5640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d80c3340 con 0x7f02d814fb90 2024-05-04T00:31:31.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.701+0000 7f02dd2c5640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f02d80ca3a0 con 0x7f02d814f780 2024-05-04T00:31:31.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.705+0000 7f02d77fe640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f02d814fb90 0x7f02d8163900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:50358/0 (socket says 172.21.15.6:50358) 2024-05-04T00:31:31.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.705+0000 7f02d77fe640 1 -- 172.21.15.6:0/2716586528 learned_addr learned my addr 172.21.15.6:0/2716586528 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:31.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.717+0000 7f02cffff640 1 --2- 172.21.15.6:0/2716586528 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02d814f780 0x7f02d80cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:31.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.797+0000 7f02d67fc640 1 -- 172.21.15.6:0/2716586528 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 222645991 0 0) 0x7f02d8159090 con 0x7f02d80c9c60 2024-05-04T00:31:31.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.797+0000 7f02d67fc640 1 -- 172.21.15.6:0/2716586528 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02c4005740 con 0x7f02d80c9c60 2024-05-04T00:31:31.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.813+0000 7f02d67fc640 1 -- 172.21.15.6:0/2716586528 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3052820972 0 0) 0x7f02c4005740 con 0x7f02d80c9c60 2024-05-04T00:31:31.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.813+0000 7f02d67fc640 1 -- 172.21.15.6:0/2716586528 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02d814f780 msgr2=0x7f02d80cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:31.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.813+0000 7f02d67fc640 1 --2- 172.21.15.6:0/2716586528 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02d814f780 0x7f02d80cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:31.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.813+0000 7f02d67fc640 1 -- 172.21.15.6:0/2716586528 >> v1:172.21.15.163:6789/0 conn(0x7f02d814fb90 legacy=0x7f02d8163900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:31.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.813+0000 7f02d67fc640 1 -- 172.21.15.6:0/2716586528 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d80c3620 con 0x7f02d80c9c60 2024-05-04T00:31:31.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.813+0000 7f02d67fc640 1 -- 172.21.15.6:0/2716586528 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 557976392 0 0) 0x7f02c8001700 con 0x7f02d80c9c60 2024-05-04T00:31:31.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.813+0000 7f02d67fc640 1 -- 172.21.15.6:0/2716586528 >> v1:172.21.15.6:6789/0 conn(0x7f02d80c9c60 legacy=0x7f02d8159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:31.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.813+0000 7f02d67fc640 1 --2- 172.21.15.6:0/2716586528 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02d814f780 0x7f02c4005ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:31.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.813+0000 7f02d67fc640 1 --2- 172.21.15.6:0/2716586528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4006270 0x7f02c4006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:31.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.813+0000 7f02d67fc640 1 --2- 172.21.15.6:0/2716586528 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02c4007030 0x7f02c400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:31.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.813+0000 7f02d67fc640 1 -- 172.21.15.6:0/2716586528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f02d80ca3a0 con 0x7f02c4006270 2024-05-04T00:31:31.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.813+0000 7f02d67fc640 1 -- 172.21.15.6:0/2716586528 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f02c40078a0 con 0x7f02c4007030 2024-05-04T00:31:31.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.813+0000 7f02d67fc640 1 -- 172.21.15.6:0/2716586528 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f02c400e1a0 con 0x7f02d814f780 2024-05-04T00:31:31.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.817+0000 7f02cffff640 1 --2- 172.21.15.6:0/2716586528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4006270 0x7f02c4006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:31.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.821+0000 7f02cffff640 1 -- 172.21.15.6:0/2716586528 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02d814f780 msgr2=0x7f02c4005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:31.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.821+0000 7f02cffff640 1 --2- 172.21.15.6:0/2716586528 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02d814f780 0x7f02c4005ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:31.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.821+0000 7f02cffff640 1 -- 172.21.15.6:0/2716586528 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02c4007030 msgr2=0x7f02c400dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:31.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.821+0000 7f02cffff640 1 --2- 172.21.15.6:0/2716586528 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02c4007030 0x7f02c400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:31.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.821+0000 7f02cffff640 1 -- 172.21.15.6:0/2716586528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c4005740 con 0x7f02c4006270 2024-05-04T00:31:31.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.829+0000 7f02cffff640 1 --2- 172.21.15.6:0/2716586528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4006270 0x7f02c4006a20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f02d806e6c0 tx=0x7f02c001c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c894eeafb1342b77 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:31.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.841+0000 7f02d67fc640 1 -- 172.21.15.6:0/2716586528 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c00096b0 con 0x7f02c4006270 2024-05-04T00:31:31.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.841+0000 7f02d67fc640 1 -- 172.21.15.6:0/2716586528 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c00af070 con 0x7f02c4006270 2024-05-04T00:31:31.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.841+0000 7f02d67fc640 1 -- 172.21.15.6:0/2716586528 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c00aa660 con 0x7f02c4006270 2024-05-04T00:31:31.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.841+0000 7f02dd2c5640 1 -- 172.21.15.6:0/2716586528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4006270 msgr2=0x7f02c4006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:31.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.841+0000 7f02dd2c5640 1 --2- 172.21.15.6:0/2716586528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4006270 0x7f02c4006a20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f02d806e6c0 tx=0x7f02c001c790 comp rx=0 tx=0).stop 2024-05-04T00:31:31.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.841+0000 7f02d77fe640 1 -- 172.21.15.6:0/2716586528 reap_dead start 2024-05-04T00:31:31.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.841+0000 7f02dd2c5640 1 -- 172.21.15.6:0/2716586528 shutdown_connections 2024-05-04T00:31:31.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.841+0000 7f02dd2c5640 1 -- 172.21.15.6:0/2716586528 >> 172.21.15.6:0/2716586528 conn(0x7f02d8070d60 msgr2=0x7f02d80711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:31.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.841+0000 7f02dd2c5640 1 -- 172.21.15.6:0/2716586528 shutdown_connections 2024-05-04T00:31:31.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.841+0000 7f02dd2c5640 1 -- 172.21.15.6:0/2716586528 wait complete. 2024-05-04T00:31:31.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.845+0000 7f02dd2c5640 1 Processor -- start 2024-05-04T00:31:31.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.845+0000 7f02dd2c5640 1 -- start start 2024-05-04T00:31:31.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.849+0000 7f02dd2c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4006270 0x7f02d8145c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:31.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.849+0000 7f02dd2c5640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02d815d680 0x7f02d814d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:31.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.849+0000 7f02dd2c5640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02d815e810 0x7f02d814d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:31.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.849+0000 7f02dd2c5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f02d8074b80 con 0x7f02c4006270 2024-05-04T00:31:31.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.849+0000 7f02dd2c5640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f02d8074a00 con 0x7f02d815e810 2024-05-04T00:31:31.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.849+0000 7f02dd2c5640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f02d815c520 con 0x7f02d815d680 2024-05-04T00:31:31.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.849+0000 7f02cffff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02d815d680 0x7f02d814d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:31.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.849+0000 7f02cffff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02d815d680 0x7f02d814d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:46756/0 (socket says 172.21.15.6:46756) 2024-05-04T00:31:31.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.849+0000 7f02cffff640 1 -- 172.21.15.6:0/390095016 learned_addr learned my addr 172.21.15.6:0/390095016 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:31.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.849+0000 7f02d6ffd640 1 --2- 172.21.15.6:0/390095016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4006270 0x7f02d8145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:31.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.853+0000 7f02d77fe640 1 --2- 172.21.15.6:0/390095016 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02d815e810 0x7f02d814d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:31.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.861+0000 7f02cffff640 1 -- 172.21.15.6:0/390095016 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02d815e810 msgr2=0x7f02d814d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:31.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.861+0000 7f02cffff640 1 --2- 172.21.15.6:0/390095016 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02d815e810 0x7f02d814d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:31.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.861+0000 7f02cffff640 1 -- 172.21.15.6:0/390095016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4006270 msgr2=0x7f02d8145c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:31.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.861+0000 7f02cffff640 1 --2- 172.21.15.6:0/390095016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4006270 0x7f02d8145c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:31.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.861+0000 7f02cffff640 1 -- 172.21.15.6:0/390095016 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d81f5710 con 0x7f02d815d680 2024-05-04T00:31:31.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.869+0000 7f02cffff640 1 --2- 172.21.15.6:0/390095016 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02d815d680 0x7f02d814d0b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f02c001c5c0 tx=0x7f02c4007a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:31.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.877+0000 7f02cf7fe640 1 -- 172.21.15.6:0/390095016 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c0005c60 con 0x7f02d815d680 2024-05-04T00:31:31.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.877+0000 7f02cf7fe640 1 -- 172.21.15.6:0/390095016 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c0005e00 con 0x7f02d815d680 2024-05-04T00:31:31.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.877+0000 7f02cf7fe640 1 -- 172.21.15.6:0/390095016 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c0006280 con 0x7f02d815d680 2024-05-04T00:31:31.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.877+0000 7f02dd2c5640 1 -- 172.21.15.6:0/390095016 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d8146170 con 0x7f02d815d680 2024-05-04T00:31:31.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.877+0000 7f02dd2c5640 1 -- 172.21.15.6:0/390095016 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d815ef60 con 0x7f02d815d680 2024-05-04T00:31:31.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:31.881+0000 7f02dd2c5640 1 -- 172.21.15.6:0/390095016 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d8069a50 con 0x7f02d815d680 2024-05-04T00:31:32.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:32.233+0000 7f02cf7fe640 1 -- 172.21.15.6:0/390095016 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f02c0006420 con 0x7f02d815d680 2024-05-04T00:31:32.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:32.233+0000 7f02cf7fe640 1 --2- 172.21.15.6:0/390095016 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f02b806f450 0x7f02b8071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:32.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:32.233+0000 7f02d6ffd640 1 --2- 172.21.15.6:0/390095016 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f02b806f450 0x7f02b8071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:32.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:32.237+0000 7f02d6ffd640 1 --2- 172.21.15.6:0/390095016 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f02b806f450 0x7f02b8071960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f02c8001ec0 tx=0x7f02c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:32.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:32.245+0000 7f02cf7fe640 1 -- 172.21.15.6:0/390095016 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f02c00f26a0 con 0x7f02d815d680 2024-05-04T00:31:32.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:32.273+0000 7f02cf7fe640 1 -- 172.21.15.6:0/390095016 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f02d81f5710 con 0x7f02d815d680 2024-05-04T00:31:32.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:32.517+0000 7f02dd2c5640 1 -- 172.21.15.6:0/390095016 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f02d81496e0 con 0x7f02d815d680 2024-05-04T00:31:33.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.633+0000 7f02cf7fe640 1 -- 172.21.15.6:0/390095016 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7f02c0016760 con 0x7f02d815d680 2024-05-04T00:31:33.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.637+0000 7f02dd2c5640 1 -- 172.21.15.6:0/390095016 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f02b806f450 msgr2=0x7f02b8071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:33.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.637+0000 7f02dd2c5640 1 --2- 172.21.15.6:0/390095016 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f02b806f450 0x7f02b8071960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f02c8001ec0 tx=0x7f02c8009040 comp rx=0 tx=0).stop 2024-05-04T00:31:33.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.637+0000 7f02dd2c5640 1 -- 172.21.15.6:0/390095016 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02d815d680 msgr2=0x7f02d814d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:33.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.637+0000 7f02dd2c5640 1 --2- 172.21.15.6:0/390095016 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02d815d680 0x7f02d814d0b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f02c001c5c0 tx=0x7f02c4007a50 comp rx=0 tx=0).stop 2024-05-04T00:31:33.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.637+0000 7f02dd2c5640 1 -- 172.21.15.6:0/390095016 shutdown_connections 2024-05-04T00:31:33.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.637+0000 7f02dd2c5640 1 --2- 172.21.15.6:0/390095016 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02d815e810 0x7f02d814d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:33.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.637+0000 7f02dd2c5640 1 --2- 172.21.15.6:0/390095016 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f02b806f450 0x7f02b8071960 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:33.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.637+0000 7f02dd2c5640 1 --2- 172.21.15.6:0/390095016 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02d815d680 0x7f02d814d0b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:33.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.637+0000 7f02dd2c5640 1 --2- 172.21.15.6:0/390095016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4006270 0x7f02d8145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:33.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.637+0000 7f02dd2c5640 1 -- 172.21.15.6:0/390095016 >> 172.21.15.6:0/390095016 conn(0x7f02d8070d60 msgr2=0x7f02d8157da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:33.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.637+0000 7f02dd2c5640 1 -- 172.21.15.6:0/390095016 shutdown_connections 2024-05-04T00:31:33.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.637+0000 7f02dd2c5640 1 -- 172.21.15.6:0/390095016 wait complete. 2024-05-04T00:31:33.667 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-04T00:31:33.667 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T00:31:33.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.821+0000 7f6bd5366640 1 Processor -- start 2024-05-04T00:31:33.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.821+0000 7f6bd5366640 1 -- start start 2024-05-04T00:31:33.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.821+0000 7f6bd5366640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6bd006c8a0 0x7f6bd015ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:33.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.821+0000 7f6bd5366640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6bd00c91d0 0x7f6bd00631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:33.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.821+0000 7f6bd5366640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bd015d1f0 con 0x7f6bd006d670 2024-05-04T00:31:33.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.821+0000 7f6bd5366640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f6bd015f820 con 0x7f6bd00c91d0 2024-05-04T00:31:33.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.821+0000 7f6bd5366640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd01600c0 con 0x7f6bd006c8a0 2024-05-04T00:31:33.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.821+0000 7f6bceffd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6bd006c8a0 0x7f6bd015ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:33.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.825+0000 7f6bceffd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6bd006c8a0 0x7f6bd015ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38278/0 (socket says 172.21.15.6:38278) 2024-05-04T00:31:33.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.825+0000 7f6bceffd640 1 -- 172.21.15.6:0/3807816473 learned_addr learned my addr 172.21.15.6:0/3807816473 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:33.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.825+0000 7f6bcf7fe640 1 --2- 172.21.15.6:0/3807816473 >> v2:172.21.15.6:3300/0 conn(0x7f6bd00c91d0 0x7f6bd00631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:33.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.829+0000 7f6bceffd640 1 -- 172.21.15.6:0/3807816473 >> v2:172.21.15.6:3300/0 conn(0x7f6bd00c91d0 msgr2=0x7f6bd00631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:33.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.829+0000 7f6bceffd640 1 --2- 172.21.15.6:0/3807816473 >> v2:172.21.15.6:3300/0 conn(0x7f6bd00c91d0 0x7f6bd00631c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:33.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.829+0000 7f6bceffd640 1 -- 172.21.15.6:0/3807816473 >> v1:172.21.15.6:6789/0 conn(0x7f6bd006d670 legacy=0x7f6bd01561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:33.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.829+0000 7f6bceffd640 1 -- 172.21.15.6:0/3807816473 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd006cda0 con 0x7f6bd006c8a0 2024-05-04T00:31:33.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.833+0000 7f6bceffd640 1 --2- 172.21.15.6:0/3807816473 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6bd006c8a0 0x7f6bd015ccb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009e50 tx=0x7f6bc801f030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46d2ba1f4e28f934 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:33.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.973+0000 7f6bcdffb640 1 -- 172.21.15.6:0/3807816473 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc80a8bc0 con 0x7f6bd006c8a0 2024-05-04T00:31:33.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.973+0000 7f6bcdffb640 1 -- 172.21.15.6:0/3807816473 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc80a8d60 con 0x7f6bd006c8a0 2024-05-04T00:31:33.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.973+0000 7f6bcdffb640 1 -- 172.21.15.6:0/3807816473 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc80b0610 con 0x7f6bd006c8a0 2024-05-04T00:31:33.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.973+0000 7f6bd5366640 1 -- 172.21.15.6:0/3807816473 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6bd006c8a0 msgr2=0x7f6bd015ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:33.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.973+0000 7f6bd5366640 1 --2- 172.21.15.6:0/3807816473 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6bd006c8a0 0x7f6bd015ccb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009e50 tx=0x7f6bc801f030 comp rx=0 tx=0).stop 2024-05-04T00:31:33.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.973+0000 7f6bd5366640 1 -- 172.21.15.6:0/3807816473 shutdown_connections 2024-05-04T00:31:33.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.973+0000 7f6bd5366640 1 --2- 172.21.15.6:0/3807816473 >> v2:172.21.15.6:3300/0 conn(0x7f6bd00c91d0 0x7f6bd00631c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:33.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.973+0000 7f6bd5366640 1 --2- 172.21.15.6:0/3807816473 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6bd006c8a0 0x7f6bd015ccb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:33.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.973+0000 7f6bd5366640 1 -- 172.21.15.6:0/3807816473 >> 172.21.15.6:0/3807816473 conn(0x7f6bd00ce410 msgr2=0x7f6bd00ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:33.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.973+0000 7f6bd5366640 1 -- 172.21.15.6:0/3807816473 shutdown_connections 2024-05-04T00:31:33.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.973+0000 7f6bd5366640 1 -- 172.21.15.6:0/3807816473 wait complete. 2024-05-04T00:31:33.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.977+0000 7f6bd5366640 1 Processor -- start 2024-05-04T00:31:33.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.977+0000 7f6bd5366640 1 -- start start 2024-05-04T00:31:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.981+0000 7f6bd5366640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6bd006c8a0 0x7f6bd015b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.981+0000 7f6bd5366640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6bd006d670 0x7f6bd01f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.981+0000 7f6bd5366640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bd00c91d0 0x7f6bd015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.981+0000 7f6bd5366640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd015fd50 con 0x7f6bd00c91d0 2024-05-04T00:31:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.981+0000 7f6bd5366640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd015fa70 con 0x7f6bd006d670 2024-05-04T00:31:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.981+0000 7f6bd5366640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd00c95e0 con 0x7f6bd006c8a0 2024-05-04T00:31:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.981+0000 7f6bceffd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6bd006c8a0 0x7f6bd015b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.981+0000 7f6bcf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bd00c91d0 0x7f6bd015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.981+0000 7f6bceffd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6bd006c8a0 0x7f6bd015b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38282/0 (socket says 172.21.15.6:38282) 2024-05-04T00:31:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.981+0000 7f6bceffd640 1 -- 172.21.15.6:0/2216890839 learned_addr learned my addr 172.21.15.6:0/2216890839 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.981+0000 7f6bce7fc640 1 --2- 172.21.15.6:0/2216890839 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6bd006d670 0x7f6bd01f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.989+0000 7f6bceffd640 1 -- 172.21.15.6:0/2216890839 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6bd006d670 msgr2=0x7f6bd01f23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.989+0000 7f6bceffd640 1 --2- 172.21.15.6:0/2216890839 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6bd006d670 0x7f6bd01f23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.989+0000 7f6bceffd640 1 -- 172.21.15.6:0/2216890839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bd00c91d0 msgr2=0x7f6bd015bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.989+0000 7f6bceffd640 1 --2- 172.21.15.6:0/2216890839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bd00c91d0 0x7f6bd015bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.989+0000 7f6bceffd640 1 -- 172.21.15.6:0/2216890839 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd015f650 con 0x7f6bd006c8a0 2024-05-04T00:31:33.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:33.993+0000 7f6bceffd640 1 --2- 172.21.15.6:0/2216890839 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6bd006c8a0 0x7f6bd015b2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6bc801f8d0 tx=0x7f6bc801bdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:34.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.001+0000 7f6bb77fe640 1 -- 172.21.15.6:0/2216890839 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc80a8bc0 con 0x7f6bd006c8a0 2024-05-04T00:31:34.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.001+0000 7f6bb77fe640 1 -- 172.21.15.6:0/2216890839 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc8007ca0 con 0x7f6bd006c8a0 2024-05-04T00:31:34.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.001+0000 7f6bb77fe640 1 -- 172.21.15.6:0/2216890839 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc80bb6b0 con 0x7f6bd006c8a0 2024-05-04T00:31:34.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.001+0000 7f6bd5366640 1 -- 172.21.15.6:0/2216890839 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bd01f2930 con 0x7f6bd006c8a0 2024-05-04T00:31:34.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.001+0000 7f6bd5366640 1 -- 172.21.15.6:0/2216890839 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bd015f090 con 0x7f6bd006c8a0 2024-05-04T00:31:34.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.001+0000 7f6bd5366640 1 -- 172.21.15.6:0/2216890839 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bd0069a50 con 0x7f6bd006c8a0 2024-05-04T00:31:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.037+0000 7f6bb77fe640 1 -- 172.21.15.6:0/2216890839 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6bc80c3020 con 0x7f6bd006c8a0 2024-05-04T00:31:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.041+0000 7f6bb77fe640 1 --2- 172.21.15.6:0/2216890839 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f6bbc06f480 0x7f6bbc071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:34.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.041+0000 7f6bce7fc640 1 --2- 172.21.15.6:0/2216890839 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f6bbc06f480 0x7f6bbc071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:34.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.041+0000 7f6bce7fc640 1 --2- 172.21.15.6:0/2216890839 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f6bbc06f480 0x7f6bbc071990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00c8a50 tx=0x7f6bc0009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:34.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.361+0000 7f6bb77fe640 1 -- 172.21.15.6:0/2216890839 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f6bc80f66e0 con 0x7f6bd006c8a0 2024-05-04T00:31:34.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.377+0000 7f6bb77fe640 1 -- 172.21.15.6:0/2216890839 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6bc80ca020 con 0x7f6bd006c8a0 2024-05-04T00:31:34.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.605+0000 7f6bd5366640 1 -- 172.21.15.6:0/2216890839 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6bd006d3e0 con 0x7f6bd006c8a0 2024-05-04T00:31:34.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.681+0000 7f6bb77fe640 1 -- 172.21.15.6:0/2216890839 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6847 (secure 0 0 0) 0x7f6bd015d1f0 con 0x7f6bd006c8a0 2024-05-04T00:31:34.685 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:31:34.685 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4185,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/811470677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":811470677},{"type":"v1","addr":"172.21.15.6:6833","nonce":811470677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4194,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/50303985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":50303985},{"type":"v1","addr":"172.21.15.163:6839","nonce":50303985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2015777060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2015777060},{"type":"v1","addr":"172.21.15.6:6835","nonce":2015777060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T00:31:21.468790+0000","modified":"2024-05-04T00:31:33.122762+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":2,"incarnation":11,"state":"up:creating","state_seq":1,"addr":"172.21.15.163:6835/428471443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":428471443},{"type":"v1","addr":"172.21.15.163:6835","nonce":428471443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"b","rank":1,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6837/1055589916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1055589916},{"type":"v1","addr":"172.21.15.163:6837","nonce":1055589916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.6:6837/639743836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":639743836},{"type":"v1","addr":"172.21.15.6:6837","nonce":639743836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4276,4270]},"id":1}]} 2024-05-04T00:31:34.686 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 11 2024-05-04T00:31:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.685+0000 7f6bd5366640 1 -- 172.21.15.6:0/2216890839 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f6bbc06f480 msgr2=0x7f6bbc071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.685+0000 7f6bd5366640 1 --2- 172.21.15.6:0/2216890839 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f6bbc06f480 0x7f6bbc071990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00c8a50 tx=0x7f6bc0009060 comp rx=0 tx=0).stop 2024-05-04T00:31:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.685+0000 7f6bd5366640 1 -- 172.21.15.6:0/2216890839 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6bd006c8a0 msgr2=0x7f6bd015b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.685+0000 7f6bd5366640 1 --2- 172.21.15.6:0/2216890839 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6bd006c8a0 0x7f6bd015b2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6bc801f8d0 tx=0x7f6bc801bdd0 comp rx=0 tx=0).stop 2024-05-04T00:31:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.685+0000 7f6bd5366640 1 -- 172.21.15.6:0/2216890839 shutdown_connections 2024-05-04T00:31:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.685+0000 7f6bd5366640 1 --2- 172.21.15.6:0/2216890839 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6bd006d670 0x7f6bd01f23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.685+0000 7f6bd5366640 1 --2- 172.21.15.6:0/2216890839 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f6bbc06f480 0x7f6bbc071990 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.685+0000 7f6bd5366640 1 --2- 172.21.15.6:0/2216890839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bd00c91d0 0x7f6bd015bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.685+0000 7f6bd5366640 1 --2- 172.21.15.6:0/2216890839 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6bd006c8a0 0x7f6bd015b2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.685+0000 7f6bd5366640 1 -- 172.21.15.6:0/2216890839 >> 172.21.15.6:0/2216890839 conn(0x7f6bd00ce410 msgr2=0x7f6bd01506e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.685+0000 7f6bd5366640 1 -- 172.21.15.6:0/2216890839 shutdown_connections 2024-05-04T00:31:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.685+0000 7f6bd5366640 1 -- 172.21.15.6:0/2216890839 wait complete. 2024-05-04T00:31:34.711 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T00:31:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.853+0000 7fb5ba0bd640 1 Processor -- start 2024-05-04T00:31:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.853+0000 7fb5ba0bd640 1 -- start start 2024-05-04T00:31:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.853+0000 7fb5ba0bd640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb5b40b4b00 0x7fb5b40cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.853+0000 7fb5ba0bd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb5b40b3ec0 0x7fb5b40d1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:34.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.853+0000 7fb5ba0bd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5b40d1cd0 0x7fb5b415f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:34.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.853+0000 7fb5ba0bd640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb5b40cdd50 con 0x7fb5b40b3ec0 2024-05-04T00:31:34.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.853+0000 7fb5ba0bd640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fb5b40cbad0 con 0x7fb5b40b4b00 2024-05-04T00:31:34.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.853+0000 7fb5ba0bd640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b415ce40 con 0x7fb5b40d1cd0 2024-05-04T00:31:34.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.853+0000 7fb5b2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb5b40b3ec0 0x7fb5b40d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:34.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.853+0000 7fb5b2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb5b40b3ec0 0x7fb5b40d1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40526/0 (socket says 172.21.15.6:40526) 2024-05-04T00:31:34.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.853+0000 7fb5b2ffd640 1 -- 172.21.15.6:0/3591418004 learned_addr learned my addr 172.21.15.6:0/3591418004 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:34.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.853+0000 7fb5b3fff640 1 --2- 172.21.15.6:0/3591418004 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5b40d1cd0 0x7fb5b415f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:34.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.853+0000 7fb5b37fe640 1 --2- 172.21.15.6:0/3591418004 >> v2:172.21.15.163:3300/0 conn(0x7fb5b40b4b00 0x7fb5b40cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.857+0000 7fb5b2ffd640 1 -- 172.21.15.6:0/3591418004 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5b40d1cd0 msgr2=0x7fb5b415f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.857+0000 7fb5b2ffd640 1 --2- 172.21.15.6:0/3591418004 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5b40d1cd0 0x7fb5b415f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.857+0000 7fb5b2ffd640 1 -- 172.21.15.6:0/3591418004 >> v2:172.21.15.163:3300/0 conn(0x7fb5b40b4b00 msgr2=0x7fb5b40cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.857+0000 7fb5b2ffd640 1 --2- 172.21.15.6:0/3591418004 >> v2:172.21.15.163:3300/0 conn(0x7fb5b40b4b00 0x7fb5b40cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.857+0000 7fb5b2ffd640 1 -- 172.21.15.6:0/3591418004 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b415d120 con 0x7fb5b40b3ec0 2024-05-04T00:31:34.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.861+0000 7fb5b2ffd640 1 --2- 172.21.15.6:0/3591418004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b40b3ec0 0x7fb5b40d1790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40d2760 tx=0x7fb5a801c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b23b2a4dcd9ccf server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:34.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.865+0000 7fb5b27fc640 1 -- 172.21.15.6:0/3591418004 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80b1070 con 0x7fb5b40b3ec0 2024-05-04T00:31:34.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.865+0000 7fb5b27fc640 1 -- 172.21.15.6:0/3591418004 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5a80ac440 con 0x7fb5b40b3ec0 2024-05-04T00:31:34.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.865+0000 7fb5b27fc640 1 -- 172.21.15.6:0/3591418004 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80ac810 con 0x7fb5b40b3ec0 2024-05-04T00:31:34.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.869+0000 7fb5ba0bd640 1 -- 172.21.15.6:0/3591418004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b40b3ec0 msgr2=0x7fb5b40d1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:34.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.869+0000 7fb5ba0bd640 1 --2- 172.21.15.6:0/3591418004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b40b3ec0 0x7fb5b40d1790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40d2760 tx=0x7fb5a801c140 comp rx=0 tx=0).stop 2024-05-04T00:31:34.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.869+0000 7fb5ba0bd640 1 -- 172.21.15.6:0/3591418004 shutdown_connections 2024-05-04T00:31:34.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.869+0000 7fb5ba0bd640 1 --2- 172.21.15.6:0/3591418004 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5b40d1cd0 0x7fb5b415f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:34.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.869+0000 7fb5ba0bd640 1 --2- 172.21.15.6:0/3591418004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b40b3ec0 0x7fb5b40d1790 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:34.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.869+0000 7fb5ba0bd640 1 --2- 172.21.15.6:0/3591418004 >> v2:172.21.15.163:3300/0 conn(0x7fb5b40b4b00 0x7fb5b40cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:34.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.869+0000 7fb5ba0bd640 1 -- 172.21.15.6:0/3591418004 >> 172.21.15.6:0/3591418004 conn(0x7fb5b406da40 msgr2=0x7fb5b406de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:34.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.869+0000 7fb5ba0bd640 1 -- 172.21.15.6:0/3591418004 shutdown_connections 2024-05-04T00:31:34.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.869+0000 7fb5ba0bd640 1 -- 172.21.15.6:0/3591418004 wait complete. 2024-05-04T00:31:34.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.869+0000 7fb5ba0bd640 1 Processor -- start 2024-05-04T00:31:34.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.869+0000 7fb5ba0bd640 1 -- start start 2024-05-04T00:31:34.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.869+0000 7fb5ba0bd640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb5b40b3ec0 0x7fb5b41f6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:34.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.869+0000 7fb5ba0bd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b40b4b00 0x7fb5b4151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:34.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.869+0000 7fb5ba0bd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5b40d1cd0 0x7fb5b41f8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:34.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.869+0000 7fb5ba0bd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b40b42d0 con 0x7fb5b40b4b00 2024-05-04T00:31:34.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.869+0000 7fb5ba0bd640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b40cd440 con 0x7fb5b40b3ec0 2024-05-04T00:31:34.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.869+0000 7fb5ba0bd640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b40b4750 con 0x7fb5b40d1cd0 2024-05-04T00:31:34.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.873+0000 7fb5b2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b40b4b00 0x7fb5b4151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:34.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.873+0000 7fb5b2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b40b4b00 0x7fb5b4151c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40532/0 (socket says 172.21.15.6:40532) 2024-05-04T00:31:34.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.873+0000 7fb5b2ffd640 1 -- 172.21.15.6:0/2689375291 learned_addr learned my addr 172.21.15.6:0/2689375291 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:34.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.873+0000 7fb5b3fff640 1 --2- 172.21.15.6:0/2689375291 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5b40d1cd0 0x7fb5b41f8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:34.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.873+0000 7fb5b37fe640 1 --2- 172.21.15.6:0/2689375291 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb5b40b3ec0 0x7fb5b41f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:34.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.877+0000 7fb5b2ffd640 1 -- 172.21.15.6:0/2689375291 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5b40d1cd0 msgr2=0x7fb5b41f8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:34.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.877+0000 7fb5b2ffd640 1 --2- 172.21.15.6:0/2689375291 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5b40d1cd0 0x7fb5b41f8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:34.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.877+0000 7fb5b2ffd640 1 -- 172.21.15.6:0/2689375291 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb5b40b3ec0 msgr2=0x7fb5b41f6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:34.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.877+0000 7fb5b2ffd640 1 --2- 172.21.15.6:0/2689375291 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb5b40b3ec0 0x7fb5b41f6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:34.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.877+0000 7fb5b2ffd640 1 -- 172.21.15.6:0/2689375291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b41f94a0 con 0x7fb5b40b4b00 2024-05-04T00:31:34.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.877+0000 7fb5b2ffd640 1 --2- 172.21.15.6:0/2689375291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b40b4b00 0x7fb5b4151c00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb5a801a7f0 tx=0x7fb5a8018ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.885+0000 7fb59bfff640 1 -- 172.21.15.6:0/2689375291 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80bc070 con 0x7fb5b40b4b00 2024-05-04T00:31:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.885+0000 7fb59bfff640 1 -- 172.21.15.6:0/2689375291 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5a80ace50 con 0x7fb5b40b4b00 2024-05-04T00:31:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.885+0000 7fb59bfff640 1 -- 172.21.15.6:0/2689375291 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80b1070 con 0x7fb5b40b4b00 2024-05-04T00:31:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.885+0000 7fb5ba0bd640 1 -- 172.21.15.6:0/2689375291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b41f9740 con 0x7fb5b40b4b00 2024-05-04T00:31:34.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.885+0000 7fb5ba0bd640 1 -- 172.21.15.6:0/2689375291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b41f6f80 con 0x7fb5b40b4b00 2024-05-04T00:31:34.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.885+0000 7fb5ba0bd640 1 -- 172.21.15.6:0/2689375291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5b406a390 con 0x7fb5b40b4b00 2024-05-04T00:31:34.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.909+0000 7fb59bfff640 1 -- 172.21.15.6:0/2689375291 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb5a80bf070 con 0x7fb5b40b4b00 2024-05-04T00:31:34.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.909+0000 7fb59bfff640 1 --2- 172.21.15.6:0/2689375291 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb5a006f480 0x7fb5a0071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:34.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.909+0000 7fb5b37fe640 1 --2- 172.21.15.6:0/2689375291 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb5a006f480 0x7fb5a0071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.909+0000 7fb5b37fe640 1 --2- 172.21.15.6:0/2689375291 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb5a006f480 0x7fb5a0071990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4006fd0 tx=0x7fb5a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:34.913+0000 7fb59bfff640 1 -- 172.21.15.6:0/2689375291 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fb5a80f1d30 con 0x7fb5b40b4b00 2024-05-04T00:31:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.217+0000 7fb59bfff640 1 -- 172.21.15.6:0/2689375291 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb5a80c6020 con 0x7fb5b40b4b00 2024-05-04T00:31:35.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.393+0000 7fb5ba0bd640 1 -- 172.21.15.6:0/2689375291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5b406d700 con 0x7fb5b40b4b00 2024-05-04T00:31:35.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.477+0000 7fb59bfff640 1 -- 172.21.15.6:0/2689375291 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+16537 (secure 0 0 0) 0x7fb5a8016110 con 0x7fb5b40b4b00 2024-05-04T00:31:35.479 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:31:35.479 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"ad5951ed-0d5e-4770-b5d9-995e08a00213","created":"2024-05-04T00:30:11.236352+0000","modified":"2024-05-04T00:31:25.449331+0000","last_up_change":"2024-05-04T00:30:35.679943+0000","last_in_change":"2024-05-04T00:30:24.926330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T00:30:36.311072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T00:31:17.278288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T00:31:18.957819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a907d753-b7cf-499c-ae36-81e44ed933a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6805","nonce":489144503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6810","nonce":489144503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6824","nonce":489144503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6813","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6817","nonce":489144503}]},"public_addr":"172.21.15.6:6805/489144503","cluster_addr":"172.21.15.6:6810/489144503","heartbeat_back_addr":"172.21.15.6:6824/489144503","heartbeat_front_addr":"172.21.15.6:6817/489144503","state":["exists","up"]},{"osd":1,"uuid":"eab41a32-d5f1-43b8-8835-f2d4bffc9cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6802","nonce":3099957279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6807","nonce":3099957279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6819","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6823","nonce":3099957279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6815","nonce":3099957279}]},"public_addr":"172.21.15.6:6802/3099957279","cluster_addr":"172.21.15.6:6807/3099957279","heartbeat_back_addr":"172.21.15.6:6823/3099957279","heartbeat_front_addr":"172.21.15.6:6815/3099957279","state":["exists","up"]},{"osd":2,"uuid":"f2540144-b533-4ffc-a9cf-24f0e4910a9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6801","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6806","nonce":2770857903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6809","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6812","nonce":2770857903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6827","nonce":2770857903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6821","nonce":2770857903}]},"public_addr":"172.21.15.6:6806/2770857903","cluster_addr":"172.21.15.6:6812/2770857903","heartbeat_back_addr":"172.21.15.6:6827/2770857903","heartbeat_front_addr":"172.21.15.6:6821/2770857903","state":["exists","up"]},{"osd":3,"uuid":"982b7ace-fd02-4f03-aef2-0428468f8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6818","nonce":3149875909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6826","nonce":3149875909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6831","nonce":3149875909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6829","nonce":3149875909}]},"public_addr":"172.21.15.6:6818/3149875909","cluster_addr":"172.21.15.6:6826/3149875909","heartbeat_back_addr":"172.21.15.6:6831/3149875909","heartbeat_front_addr":"172.21.15.6:6829/3149875909","state":["exists","up"]},{"osd":4,"uuid":"ecf94166-cfdf-4ac8-a659-6ae907686e8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6818","nonce":2508264225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6821","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6824","nonce":2508264225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6833","nonce":2508264225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6831","nonce":2508264225}]},"public_addr":"172.21.15.163:6818/2508264225","cluster_addr":"172.21.15.163:6824/2508264225","heartbeat_back_addr":"172.21.15.163:6833/2508264225","heartbeat_front_addr":"172.21.15.163:6831/2508264225","state":["exists","up"]},{"osd":5,"uuid":"fc5cfa90-0e3a-4fc2-829c-5ff57d7a5953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6815","nonce":167619435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6820","nonce":167619435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6827","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6829","nonce":167619435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6825","nonce":167619435}]},"public_addr":"172.21.15.163:6815/167619435","cluster_addr":"172.21.15.163:6820/167619435","heartbeat_back_addr":"172.21.15.163:6829/167619435","heartbeat_front_addr":"172.21.15.163:6825/167619435","state":["exists","up"]},{"osd":6,"uuid":"ed95f0cf-f309-4861-b47c-4a5a6b44ffdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6811","nonce":1460767610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6813","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6814","nonce":1460767610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6830","nonce":1460767610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6819","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6822","nonce":1460767610}]},"public_addr":"172.21.15.163:6811/1460767610","cluster_addr":"172.21.15.163:6814/1460767610","heartbeat_back_addr":"172.21.15.163:6830/1460767610","heartbeat_front_addr":"172.21.15.163:6822/1460767610","state":["exists","up"]},{"osd":7,"uuid":"2f57afcd-567f-44f6-9db7-df0342c8c4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6803","nonce":239650691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6805","nonce":239650691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6809","nonce":239650691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6807","nonce":239650691}]},"public_addr":"172.21.15.163:6803/239650691","cluster_addr":"172.21.15.163:6805/239650691","heartbeat_back_addr":"172.21.15.163:6809/239650691","heartbeat_front_addr":"172.21.15.163:6807/239650691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.818870+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.749094+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.805522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.576430+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.740084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.755726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.797961+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.577731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T00:31:35.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.477+0000 7fb5ba0bd640 1 -- 172.21.15.6:0/2689375291 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb5a006f480 msgr2=0x7fb5a0071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:35.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.477+0000 7fb5ba0bd640 1 --2- 172.21.15.6:0/2689375291 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb5a006f480 0x7fb5a0071990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4006fd0 tx=0x7fb5a4008040 comp rx=0 tx=0).stop 2024-05-04T00:31:35.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.477+0000 7fb5ba0bd640 1 -- 172.21.15.6:0/2689375291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b40b4b00 msgr2=0x7fb5b4151c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:35.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.477+0000 7fb5ba0bd640 1 --2- 172.21.15.6:0/2689375291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b40b4b00 0x7fb5b4151c00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb5a801a7f0 tx=0x7fb5a8018ee0 comp rx=0 tx=0).stop 2024-05-04T00:31:35.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.477+0000 7fb5ba0bd640 1 -- 172.21.15.6:0/2689375291 shutdown_connections 2024-05-04T00:31:35.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.477+0000 7fb5ba0bd640 1 --2- 172.21.15.6:0/2689375291 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb5a006f480 0x7fb5a0071990 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:35.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.477+0000 7fb5ba0bd640 1 --2- 172.21.15.6:0/2689375291 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5b40d1cd0 0x7fb5b41f8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:35.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.477+0000 7fb5ba0bd640 1 --2- 172.21.15.6:0/2689375291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b40b4b00 0x7fb5b4151c00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:35.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.477+0000 7fb5ba0bd640 1 --2- 172.21.15.6:0/2689375291 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb5b40b3ec0 0x7fb5b41f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:35.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.477+0000 7fb5ba0bd640 1 -- 172.21.15.6:0/2689375291 >> 172.21.15.6:0/2689375291 conn(0x7fb5b406da40 msgr2=0x7fb5b4155bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:35.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.477+0000 7fb5ba0bd640 1 -- 172.21.15.6:0/2689375291 shutdown_connections 2024-05-04T00:31:35.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.477+0000 7fb5ba0bd640 1 -- 172.21.15.6:0/2689375291 wait complete. 2024-05-04T00:31:35.500 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-04T00:31:35.500 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T00:31:35.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.653+0000 7f0f6253e640 1 Processor -- start 2024-05-04T00:31:35.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.653+0000 7f0f6253e640 1 -- start start 2024-05-04T00:31:35.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.653+0000 7f0f6253e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0f5c156650 0x7f0f5c0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:35.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.653+0000 7f0f6253e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5c156a60 con 0x7f0f5c0cfad0 2024-05-04T00:31:35.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.653+0000 7f0f6253e640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5c15c4c0 con 0x7f0f5c06cf90 2024-05-04T00:31:35.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.653+0000 7f0f6253e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f0f5c070f90 con 0x7f0f5c156650 2024-05-04T00:31:35.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.657+0000 7f0f5bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0f5c156650 0x7f0f5c0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:35.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.657+0000 7f0f60adb640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f0f5c06cf90 0x7f0f5c06d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:52496/0 (socket says 172.21.15.6:52496) 2024-05-04T00:31:35.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.657+0000 7f0f60adb640 1 -- 172.21.15.6:0/2805708036 learned_addr learned my addr 172.21.15.6:0/2805708036 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:35.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.661+0000 7f0f5bfff640 1 -- 172.21.15.6:0/2805708036 >> v1:172.21.15.163:6789/0 conn(0x7f0f5c06cf90 legacy=0x7f0f5c06d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:35.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.661+0000 7f0f5bfff640 1 -- 172.21.15.6:0/2805708036 >> v1:172.21.15.6:6789/0 conn(0x7f0f5c0cfad0 legacy=0x7f0f5c0ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:35.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.661+0000 7f0f5bfff640 1 -- 172.21.15.6:0/2805708036 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c15c7a0 con 0x7f0f5c156650 2024-05-04T00:31:35.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.665+0000 7f0f5bfff640 1 --2- 172.21.15.6:0/2805708036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f5c156650 0x7f0f5c0cf590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0097c0 tx=0x7f0f4c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5a4b7004b7317e server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.673+0000 7f0f5affd640 1 -- 172.21.15.6:0/2805708036 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c0b5070 con 0x7f0f5c156650 2024-05-04T00:31:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.673+0000 7f0f5affd640 1 -- 172.21.15.6:0/2805708036 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4c0a8990 con 0x7f0f5c156650 2024-05-04T00:31:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.673+0000 7f0f5affd640 1 -- 172.21.15.6:0/2805708036 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c0a8d60 con 0x7f0f5c156650 2024-05-04T00:31:35.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.673+0000 7f0f6253e640 1 -- 172.21.15.6:0/2805708036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f5c156650 msgr2=0x7f0f5c0cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:35.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.673+0000 7f0f6253e640 1 --2- 172.21.15.6:0/2805708036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f5c156650 0x7f0f5c0cf590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0097c0 tx=0x7f0f4c01ec90 comp rx=0 tx=0).stop 2024-05-04T00:31:35.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.673+0000 7f0f6253e640 1 -- 172.21.15.6:0/2805708036 shutdown_connections 2024-05-04T00:31:35.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.673+0000 7f0f6253e640 1 --2- 172.21.15.6:0/2805708036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f5c156650 0x7f0f5c0cf590 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:35.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.673+0000 7f0f6253e640 1 -- 172.21.15.6:0/2805708036 >> 172.21.15.6:0/2805708036 conn(0x7f0f5c072ce0 msgr2=0x7f0f5c0704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:35.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.673+0000 7f0f6253e640 1 -- 172.21.15.6:0/2805708036 shutdown_connections 2024-05-04T00:31:35.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.673+0000 7f0f6253e640 1 -- 172.21.15.6:0/2805708036 wait complete. 2024-05-04T00:31:35.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.677+0000 7f0f6253e640 1 Processor -- start 2024-05-04T00:31:35.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.677+0000 7f0f6253e640 1 -- start start 2024-05-04T00:31:35.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.677+0000 7f0f6253e640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f5c06cf90 0x7f0f5c0b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:35.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.677+0000 7f0f6253e640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0f5c0cfad0 0x7f0f5c14e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:35.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.677+0000 7f0f6253e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f5c156650 0x7f0f5c148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:35.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.677+0000 7f0f6253e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c15cd60 con 0x7f0f5c156650 2024-05-04T00:31:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.677+0000 7f0f6253e640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c15d0d0 con 0x7f0f5c06cf90 2024-05-04T00:31:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.677+0000 7f0f6253e640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f0f5c0cab30 con 0x7f0f5c0cfad0 2024-05-04T00:31:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.677+0000 7f0f60adb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f5c156650 0x7f0f5c148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.677+0000 7f0f60adb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f5c156650 0x7f0f5c148d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40560/0 (socket says 172.21.15.6:40560) 2024-05-04T00:31:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.677+0000 7f0f60adb640 1 -- 172.21.15.6:0/4280669248 learned_addr learned my addr 172.21.15.6:0/4280669248 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.677+0000 7f0f5bfff640 1 --2- 172.21.15.6:0/4280669248 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f5c06cf90 0x7f0f5c0b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.677+0000 7f0f5b7fe640 1 --2- 172.21.15.6:0/4280669248 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0f5c0cfad0 0x7f0f5c14e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:35.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.681+0000 7f0f60adb640 1 -- 172.21.15.6:0/4280669248 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0f5c0cfad0 msgr2=0x7f0f5c14e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.681+0000 7f0f60adb640 1 --2- 172.21.15.6:0/4280669248 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0f5c0cfad0 0x7f0f5c14e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.681+0000 7f0f60adb640 1 -- 172.21.15.6:0/4280669248 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f5c06cf90 msgr2=0x7f0f5c0b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.681+0000 7f0f60adb640 1 --2- 172.21.15.6:0/4280669248 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f5c06cf90 0x7f0f5c0b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.681+0000 7f0f60adb640 1 -- 172.21.15.6:0/4280669248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c0b0790 con 0x7f0f5c156650 2024-05-04T00:31:35.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.685+0000 7f0f60adb640 1 --2- 172.21.15.6:0/4280669248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f5c156650 0x7f0f5c148d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400ca80 tx=0x7f0f5400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:35.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.689+0000 7f0f58ff9640 1 -- 172.21.15.6:0/4280669248 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54017070 con 0x7f0f5c156650 2024-05-04T00:31:35.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.689+0000 7f0f58ff9640 1 -- 172.21.15.6:0/4280669248 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f5400ac30 con 0x7f0f5c156650 2024-05-04T00:31:35.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.689+0000 7f0f58ff9640 1 -- 172.21.15.6:0/4280669248 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54012600 con 0x7f0f5c156650 2024-05-04T00:31:35.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.689+0000 7f0f6253e640 1 -- 172.21.15.6:0/4280669248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5c0b1d80 con 0x7f0f5c156650 2024-05-04T00:31:35.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.689+0000 7f0f6253e640 1 -- 172.21.15.6:0/4280669248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f5c1f38b0 con 0x7f0f5c156650 2024-05-04T00:31:35.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.689+0000 7f0f6253e640 1 -- 172.21.15.6:0/4280669248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f5c069a50 con 0x7f0f5c156650 2024-05-04T00:31:35.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.713+0000 7f0f58ff9640 1 -- 172.21.15.6:0/4280669248 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0f5401a070 con 0x7f0f5c156650 2024-05-04T00:31:35.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.713+0000 7f0f58ff9640 1 --2- 172.21.15.6:0/4280669248 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f0f4806f480 0x7f0f48071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:35.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.713+0000 7f0f5bfff640 1 --2- 172.21.15.6:0/4280669248 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f0f4806f480 0x7f0f48071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:35.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.717+0000 7f0f5bfff640 1 --2- 172.21.15.6:0/4280669248 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f0f4806f480 0x7f0f48071990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0b2000 tx=0x7f0f4c0aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:35.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:35.717+0000 7f0f58ff9640 1 -- 172.21.15.6:0/4280669248 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f0f54057d00 con 0x7f0f5c156650 2024-05-04T00:31:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.009+0000 7f0f58ff9640 1 -- 172.21.15.6:0/4280669248 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0f54022080 con 0x7f0f5c156650 2024-05-04T00:31:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.189+0000 7f0f6253e640 1 -- 172.21.15.6:0/4280669248 --> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f5c070d70 con 0x7f0f4806f480 2024-05-04T00:31:36.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.213+0000 7f0f58ff9640 1 -- 172.21.15.6:0/4280669248 <== mgr.4103 v2:172.21.15.163:6800/2152694980 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7f0f4c0fd840 con 0x7f0f4806f480 2024-05-04T00:31:36.217 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:31:36.219 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-04T00:31:36.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.217+0000 7f0f6253e640 1 -- 172.21.15.6:0/4280669248 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f0f4806f480 msgr2=0x7f0f48071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:36.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.217+0000 7f0f6253e640 1 --2- 172.21.15.6:0/4280669248 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f0f4806f480 0x7f0f48071990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0b2000 tx=0x7f0f4c0aa070 comp rx=0 tx=0).stop 2024-05-04T00:31:36.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.217+0000 7f0f6253e640 1 -- 172.21.15.6:0/4280669248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f5c156650 msgr2=0x7f0f5c148d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:36.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.217+0000 7f0f6253e640 1 --2- 172.21.15.6:0/4280669248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f5c156650 0x7f0f5c148d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400ca80 tx=0x7f0f5400cf40 comp rx=0 tx=0).stop 2024-05-04T00:31:36.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.217+0000 7f0f6253e640 1 -- 172.21.15.6:0/4280669248 shutdown_connections 2024-05-04T00:31:36.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.217+0000 7f0f6253e640 1 --2- 172.21.15.6:0/4280669248 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f0f4806f480 0x7f0f48071990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:36.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.217+0000 7f0f6253e640 1 --2- 172.21.15.6:0/4280669248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f5c156650 0x7f0f5c148d80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:36.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.217+0000 7f0f6253e640 1 --2- 172.21.15.6:0/4280669248 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0f5c0cfad0 0x7f0f5c14e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:36.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.217+0000 7f0f6253e640 1 --2- 172.21.15.6:0/4280669248 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f5c06cf90 0x7f0f5c0b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:36.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.217+0000 7f0f6253e640 1 -- 172.21.15.6:0/4280669248 >> 172.21.15.6:0/4280669248 conn(0x7f0f5c072ce0 msgr2=0x7f0f5c14ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:36.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.217+0000 7f0f6253e640 1 -- 172.21.15.6:0/4280669248 shutdown_connections 2024-05-04T00:31:36.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.217+0000 7f0f6253e640 1 -- 172.21.15.6:0/4280669248 wait complete. 2024-05-04T00:31:36.240 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-05-04T00:31:35.562487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594308,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":199,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219516,"kb_used_data":3380,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755204,"statfs":{"total":773094113280,"available":772869328896,"internally_reserved":0,"allocated":3461120,"data_stored":1985742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3746,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.004414"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334539+0000","last_change":"2024-05-04T00:31:21.410516+0000","last_active":"2024-05-04T00:31:26.334539+0000","last_peered":"2024-05-04T00:31:26.334539+0000","last_clean":"2024-05-04T00:31:26.334539+0000","last_became_active":"2024-05-04T00:31:21.409386+0000","last_became_peered":"2024-05-04T00:31:21.409386+0000","last_unstale":"2024-05-04T00:31:26.334539+0000","last_undegraded":"2024-05-04T00:31:26.334539+0000","last_fullsized":"2024-05-04T00:31:26.334539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:09:40.562107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336298+0000","last_change":"2024-05-04T00:31:21.397440+0000","last_active":"2024-05-04T00:31:26.336298+0000","last_peered":"2024-05-04T00:31:26.336298+0000","last_clean":"2024-05-04T00:31:26.336298+0000","last_became_active":"2024-05-04T00:31:21.396255+0000","last_became_peered":"2024-05-04T00:31:21.396255+0000","last_unstale":"2024-05-04T00:31:26.336298+0000","last_undegraded":"2024-05-04T00:31:26.336298+0000","last_fullsized":"2024-05-04T00:31:26.336298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:07.460897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336101+0000","last_change":"2024-05-04T00:31:21.442932+0000","last_active":"2024-05-04T00:31:26.336101+0000","last_peered":"2024-05-04T00:31:26.336101+0000","last_clean":"2024-05-04T00:31:26.336101+0000","last_became_active":"2024-05-04T00:31:21.442507+0000","last_became_peered":"2024-05-04T00:31:21.442507+0000","last_unstale":"2024-05-04T00:31:26.336101+0000","last_undegraded":"2024-05-04T00:31:26.336101+0000","last_fullsized":"2024-05-04T00:31:26.336101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:52:48.345813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333683+0000","last_change":"2024-05-04T00:31:21.442087+0000","last_active":"2024-05-04T00:31:26.333683+0000","last_peered":"2024-05-04T00:31:26.333683+0000","last_clean":"2024-05-04T00:31:26.333683+0000","last_became_active":"2024-05-04T00:31:21.440935+0000","last_became_peered":"2024-05-04T00:31:21.440935+0000","last_unstale":"2024-05-04T00:31:26.333683+0000","last_undegraded":"2024-05-04T00:31:26.333683+0000","last_fullsized":"2024-05-04T00:31:26.333683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:02:02.166274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334582+0000","last_change":"2024-05-04T00:31:21.408892+0000","last_active":"2024-05-04T00:31:26.334582+0000","last_peered":"2024-05-04T00:31:26.334582+0000","last_clean":"2024-05-04T00:31:26.334582+0000","last_became_active":"2024-05-04T00:31:21.402554+0000","last_became_peered":"2024-05-04T00:31:21.402554+0000","last_unstale":"2024-05-04T00:31:26.334582+0000","last_undegraded":"2024-05-04T00:31:26.334582+0000","last_fullsized":"2024-05-04T00:31:26.334582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:07.135906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333117+0000","last_change":"2024-05-04T00:31:21.442773+0000","last_active":"2024-05-04T00:31:26.333117+0000","last_peered":"2024-05-04T00:31:26.333117+0000","last_clean":"2024-05-04T00:31:26.333117+0000","last_became_active":"2024-05-04T00:31:21.441082+0000","last_became_peered":"2024-05-04T00:31:21.441082+0000","last_unstale":"2024-05-04T00:31:26.333117+0000","last_undegraded":"2024-05-04T00:31:26.333117+0000","last_fullsized":"2024-05-04T00:31:26.333117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:54.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333801+0000","last_change":"2024-05-04T00:31:21.441617+0000","last_active":"2024-05-04T00:31:26.333801+0000","last_peered":"2024-05-04T00:31:26.333801+0000","last_clean":"2024-05-04T00:31:26.333801+0000","last_became_active":"2024-05-04T00:31:21.440766+0000","last_became_peered":"2024-05-04T00:31:21.440766+0000","last_unstale":"2024-05-04T00:31:26.333801+0000","last_undegraded":"2024-05-04T00:31:26.333801+0000","last_fullsized":"2024-05-04T00:31:26.333801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:28:07.779536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335122+0000","last_change":"2024-05-04T00:31:21.408515+0000","last_active":"2024-05-04T00:31:26.335122+0000","last_peered":"2024-05-04T00:31:26.335122+0000","last_clean":"2024-05-04T00:31:26.335122+0000","last_became_active":"2024-05-04T00:31:21.407785+0000","last_became_peered":"2024-05-04T00:31:21.407785+0000","last_unstale":"2024-05-04T00:31:26.335122+0000","last_undegraded":"2024-05-04T00:31:26.335122+0000","last_fullsized":"2024-05-04T00:31:26.335122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:42.617159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333247+0000","last_change":"2024-05-04T00:31:21.400836+0000","last_active":"2024-05-04T00:31:26.333247+0000","last_peered":"2024-05-04T00:31:26.333247+0000","last_clean":"2024-05-04T00:31:26.333247+0000","last_became_active":"2024-05-04T00:31:21.400001+0000","last_became_peered":"2024-05-04T00:31:21.400001+0000","last_unstale":"2024-05-04T00:31:26.333247+0000","last_undegraded":"2024-05-04T00:31:26.333247+0000","last_fullsized":"2024-05-04T00:31:26.333247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:56.687510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334788+0000","last_change":"2024-05-04T00:31:21.391806+0000","last_active":"2024-05-04T00:31:26.334788+0000","last_peered":"2024-05-04T00:31:26.334788+0000","last_clean":"2024-05-04T00:31:26.334788+0000","last_became_active":"2024-05-04T00:31:21.389347+0000","last_became_peered":"2024-05-04T00:31:21.389347+0000","last_unstale":"2024-05-04T00:31:26.334788+0000","last_undegraded":"2024-05-04T00:31:26.334788+0000","last_fullsized":"2024-05-04T00:31:26.334788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:40:12.379274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334569+0000","last_change":"2024-05-04T00:31:21.396045+0000","last_active":"2024-05-04T00:31:26.334569+0000","last_peered":"2024-05-04T00:31:26.334569+0000","last_clean":"2024-05-04T00:31:26.334569+0000","last_became_active":"2024-05-04T00:31:21.385949+0000","last_became_peered":"2024-05-04T00:31:21.385949+0000","last_unstale":"2024-05-04T00:31:26.334569+0000","last_undegraded":"2024-05-04T00:31:26.334569+0000","last_fullsized":"2024-05-04T00:31:26.334569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:33.187636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334211+0000","last_change":"2024-05-04T00:31:21.407987+0000","last_active":"2024-05-04T00:31:26.334211+0000","last_peered":"2024-05-04T00:31:26.334211+0000","last_clean":"2024-05-04T00:31:26.334211+0000","last_became_active":"2024-05-04T00:31:21.404557+0000","last_became_peered":"2024-05-04T00:31:21.404557+0000","last_unstale":"2024-05-04T00:31:26.334211+0000","last_undegraded":"2024-05-04T00:31:26.334211+0000","last_fullsized":"2024-05-04T00:31:26.334211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:00:51.313452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049847+0000","last_change":"2024-05-04T00:31:21.389251+0000","last_active":"2024-05-04T00:31:26.049847+0000","last_peered":"2024-05-04T00:31:26.049847+0000","last_clean":"2024-05-04T00:31:26.049847+0000","last_became_active":"2024-05-04T00:31:21.387958+0000","last_became_peered":"2024-05-04T00:31:21.387958+0000","last_unstale":"2024-05-04T00:31:26.049847+0000","last_undegraded":"2024-05-04T00:31:26.049847+0000","last_fullsized":"2024-05-04T00:31:26.049847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:31.926158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049567+0000","last_change":"2024-05-04T00:31:21.402284+0000","last_active":"2024-05-04T00:31:26.049567+0000","last_peered":"2024-05-04T00:31:26.049567+0000","last_clean":"2024-05-04T00:31:26.049567+0000","last_became_active":"2024-05-04T00:31:21.401495+0000","last_became_peered":"2024-05-04T00:31:21.401495+0000","last_unstale":"2024-05-04T00:31:26.049567+0000","last_undegraded":"2024-05-04T00:31:26.049567+0000","last_fullsized":"2024-05-04T00:31:26.049567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:09.622538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335160+0000","last_change":"2024-05-04T00:31:21.410958+0000","last_active":"2024-05-04T00:31:26.335160+0000","last_peered":"2024-05-04T00:31:26.335160+0000","last_clean":"2024-05-04T00:31:26.335160+0000","last_became_active":"2024-05-04T00:31:21.410489+0000","last_became_peered":"2024-05-04T00:31:21.410489+0000","last_unstale":"2024-05-04T00:31:26.335160+0000","last_undegraded":"2024-05-04T00:31:26.335160+0000","last_fullsized":"2024-05-04T00:31:26.335160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:05:47.448392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977378+0000","last_change":"2024-05-04T00:31:21.187055+0000","last_active":"2024-05-04T00:31:25.977378+0000","last_peered":"2024-05-04T00:31:25.977378+0000","last_clean":"2024-05-04T00:31:25.977378+0000","last_became_active":"2024-05-04T00:31:21.186141+0000","last_became_peered":"2024-05-04T00:31:21.186141+0000","last_unstale":"2024-05-04T00:31:25.977378+0000","last_undegraded":"2024-05-04T00:31:25.977378+0000","last_fullsized":"2024-05-04T00:31:25.977378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:53:13.451818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978989+0000","last_change":"2024-05-04T00:31:21.406402+0000","last_active":"2024-05-04T00:31:25.978989+0000","last_peered":"2024-05-04T00:31:25.978989+0000","last_clean":"2024-05-04T00:31:25.978989+0000","last_became_active":"2024-05-04T00:31:21.389108+0000","last_became_peered":"2024-05-04T00:31:21.389108+0000","last_unstale":"2024-05-04T00:31:25.978989+0000","last_undegraded":"2024-05-04T00:31:25.978989+0000","last_fullsized":"2024-05-04T00:31:25.978989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:11:03.598993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334910+0000","last_change":"2024-05-04T00:31:21.418601+0000","last_active":"2024-05-04T00:31:26.334910+0000","last_peered":"2024-05-04T00:31:26.334910+0000","last_clean":"2024-05-04T00:31:26.334910+0000","last_became_active":"2024-05-04T00:31:21.417914+0000","last_became_peered":"2024-05-04T00:31:21.417914+0000","last_unstale":"2024-05-04T00:31:26.334910+0000","last_undegraded":"2024-05-04T00:31:26.334910+0000","last_fullsized":"2024-05-04T00:31:26.334910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:23:35.270037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978633+0000","last_change":"2024-05-04T00:31:21.441868+0000","last_active":"2024-05-04T00:31:25.978633+0000","last_peered":"2024-05-04T00:31:25.978633+0000","last_clean":"2024-05-04T00:31:25.978633+0000","last_became_active":"2024-05-04T00:31:21.440945+0000","last_became_peered":"2024-05-04T00:31:21.440945+0000","last_unstale":"2024-05-04T00:31:25.978633+0000","last_undegraded":"2024-05-04T00:31:25.978633+0000","last_fullsized":"2024-05-04T00:31:25.978633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:47:43.629512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334519+0000","last_change":"2024-05-04T00:31:21.395356+0000","last_active":"2024-05-04T00:31:26.334519+0000","last_peered":"2024-05-04T00:31:26.334519+0000","last_clean":"2024-05-04T00:31:26.334519+0000","last_became_active":"2024-05-04T00:31:21.394461+0000","last_became_peered":"2024-05-04T00:31:21.394461+0000","last_unstale":"2024-05-04T00:31:26.334519+0000","last_undegraded":"2024-05-04T00:31:26.334519+0000","last_fullsized":"2024-05-04T00:31:26.334519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:42:31.303120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088316+0000","last_change":"2024-05-04T00:31:21.446878+0000","last_active":"2024-05-04T00:31:26.088316+0000","last_peered":"2024-05-04T00:31:26.088316+0000","last_clean":"2024-05-04T00:31:26.088316+0000","last_became_active":"2024-05-04T00:31:21.446250+0000","last_became_peered":"2024-05-04T00:31:21.446250+0000","last_unstale":"2024-05-04T00:31:26.088316+0000","last_undegraded":"2024-05-04T00:31:26.088316+0000","last_fullsized":"2024-05-04T00:31:26.088316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:42.617159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333229+0000","last_change":"2024-05-04T00:31:21.414182+0000","last_active":"2024-05-04T00:31:26.333229+0000","last_peered":"2024-05-04T00:31:26.333229+0000","last_clean":"2024-05-04T00:31:26.333229+0000","last_became_active":"2024-05-04T00:31:21.413073+0000","last_became_peered":"2024-05-04T00:31:21.413073+0000","last_unstale":"2024-05-04T00:31:26.333229+0000","last_undegraded":"2024-05-04T00:31:26.333229+0000","last_fullsized":"2024-05-04T00:31:26.333229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:23.471892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335510+0000","last_change":"2024-05-04T00:31:21.403827+0000","last_active":"2024-05-04T00:31:26.335510+0000","last_peered":"2024-05-04T00:31:26.335510+0000","last_clean":"2024-05-04T00:31:26.335510+0000","last_became_active":"2024-05-04T00:31:21.402985+0000","last_became_peered":"2024-05-04T00:31:21.402985+0000","last_unstale":"2024-05-04T00:31:26.335510+0000","last_undegraded":"2024-05-04T00:31:26.335510+0000","last_fullsized":"2024-05-04T00:31:26.335510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:43:15.203235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977429+0000","last_change":"2024-05-04T00:31:21.393270+0000","last_active":"2024-05-04T00:31:25.977429+0000","last_peered":"2024-05-04T00:31:25.977429+0000","last_clean":"2024-05-04T00:31:25.977429+0000","last_became_active":"2024-05-04T00:31:21.392368+0000","last_became_peered":"2024-05-04T00:31:21.392368+0000","last_unstale":"2024-05-04T00:31:25.977429+0000","last_undegraded":"2024-05-04T00:31:25.977429+0000","last_fullsized":"2024-05-04T00:31:25.977429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:49:22.354637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336437+0000","last_change":"2024-05-04T00:31:21.416800+0000","last_active":"2024-05-04T00:31:26.336437+0000","last_peered":"2024-05-04T00:31:26.336437+0000","last_clean":"2024-05-04T00:31:26.336437+0000","last_became_active":"2024-05-04T00:31:21.415540+0000","last_became_peered":"2024-05-04T00:31:21.415540+0000","last_unstale":"2024-05-04T00:31:26.336437+0000","last_undegraded":"2024-05-04T00:31:26.336437+0000","last_fullsized":"2024-05-04T00:31:26.336437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:00:51.313452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335047+0000","last_change":"2024-05-04T00:31:21.188504+0000","last_active":"2024-05-04T00:31:26.335047+0000","last_peered":"2024-05-04T00:31:26.335047+0000","last_clean":"2024-05-04T00:31:26.335047+0000","last_became_active":"2024-05-04T00:31:21.187877+0000","last_became_peered":"2024-05-04T00:31:21.187877+0000","last_unstale":"2024-05-04T00:31:26.335047+0000","last_undegraded":"2024-05-04T00:31:26.335047+0000","last_fullsized":"2024-05-04T00:31:26.335047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:48:39.671984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.050292+0000","last_change":"2024-05-04T00:31:21.393500+0000","last_active":"2024-05-04T00:31:26.050292+0000","last_peered":"2024-05-04T00:31:26.050292+0000","last_clean":"2024-05-04T00:31:26.050292+0000","last_became_active":"2024-05-04T00:31:21.392579+0000","last_became_peered":"2024-05-04T00:31:21.392579+0000","last_unstale":"2024-05-04T00:31:26.050292+0000","last_undegraded":"2024-05-04T00:31:26.050292+0000","last_fullsized":"2024-05-04T00:31:26.050292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:16.804136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049793+0000","last_change":"2024-05-04T00:31:21.395778+0000","last_active":"2024-05-04T00:31:26.049793+0000","last_peered":"2024-05-04T00:31:26.049793+0000","last_clean":"2024-05-04T00:31:26.049793+0000","last_became_active":"2024-05-04T00:31:21.394966+0000","last_became_peered":"2024-05-04T00:31:21.394966+0000","last_unstale":"2024-05-04T00:31:26.049793+0000","last_undegraded":"2024-05-04T00:31:26.049793+0000","last_fullsized":"2024-05-04T00:31:26.049793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:53:28.166224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335626+0000","last_change":"2024-05-04T00:31:21.405250+0000","last_active":"2024-05-04T00:31:26.335626+0000","last_peered":"2024-05-04T00:31:26.335626+0000","last_clean":"2024-05-04T00:31:26.335626+0000","last_became_active":"2024-05-04T00:31:21.403779+0000","last_became_peered":"2024-05-04T00:31:21.403779+0000","last_unstale":"2024-05-04T00:31:26.335626+0000","last_undegraded":"2024-05-04T00:31:26.335626+0000","last_fullsized":"2024-05-04T00:31:26.335626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:33.187636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977754+0000","last_change":"2024-05-04T00:31:21.399896+0000","last_active":"2024-05-04T00:31:25.977754+0000","last_peered":"2024-05-04T00:31:25.977754+0000","last_clean":"2024-05-04T00:31:25.977754+0000","last_became_active":"2024-05-04T00:31:21.398994+0000","last_became_peered":"2024-05-04T00:31:21.398994+0000","last_unstale":"2024-05-04T00:31:25.977754+0000","last_undegraded":"2024-05-04T00:31:25.977754+0000","last_fullsized":"2024-05-04T00:31:25.977754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:32:42.591423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334354+0000","last_change":"2024-05-04T00:31:21.416130+0000","last_active":"2024-05-04T00:31:26.334354+0000","last_peered":"2024-05-04T00:31:26.334354+0000","last_clean":"2024-05-04T00:31:26.334354+0000","last_became_active":"2024-05-04T00:31:21.415395+0000","last_became_peered":"2024-05-04T00:31:21.415395+0000","last_unstale":"2024-05-04T00:31:26.334354+0000","last_undegraded":"2024-05-04T00:31:26.334354+0000","last_fullsized":"2024-05-04T00:31:26.334354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:33:22.819977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.332079+0000","last_change":"2024-05-04T00:31:21.342105+0000","last_active":"2024-05-04T00:31:26.332079+0000","last_peered":"2024-05-04T00:31:26.332079+0000","last_clean":"2024-05-04T00:31:26.332079+0000","last_became_active":"2024-05-04T00:31:21.341333+0000","last_became_peered":"2024-05-04T00:31:21.341333+0000","last_unstale":"2024-05-04T00:31:26.332079+0000","last_undegraded":"2024-05-04T00:31:26.332079+0000","last_fullsized":"2024-05-04T00:31:26.332079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:23.471892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333474+0000","last_change":"2024-05-04T00:31:21.405647+0000","last_active":"2024-05-04T00:31:26.333474+0000","last_peered":"2024-05-04T00:31:26.333474+0000","last_clean":"2024-05-04T00:31:26.333474+0000","last_became_active":"2024-05-04T00:31:21.403998+0000","last_became_peered":"2024-05-04T00:31:21.403998+0000","last_unstale":"2024-05-04T00:31:26.333474+0000","last_undegraded":"2024-05-04T00:31:26.333474+0000","last_fullsized":"2024-05-04T00:31:26.333474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:54.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.681469+0000","last_change":"2024-05-04T00:31:19.185018+0000","last_active":"2024-05-04T00:31:31.681469+0000","last_peered":"2024-05-04T00:31:31.681469+0000","last_clean":"2024-05-04T00:31:31.681469+0000","last_became_active":"2024-05-04T00:31:19.181107+0000","last_became_peered":"2024-05-04T00:31:19.181107+0000","last_unstale":"2024-05-04T00:31:31.681469+0000","last_undegraded":"2024-05-04T00:31:31.681469+0000","last_fullsized":"2024-05-04T00:31:31.681469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:14.453153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088596+0000","last_change":"2024-05-04T00:31:21.446209+0000","last_active":"2024-05-04T00:31:26.088596+0000","last_peered":"2024-05-04T00:31:26.088596+0000","last_clean":"2024-05-04T00:31:26.088596+0000","last_became_active":"2024-05-04T00:31:21.445793+0000","last_became_peered":"2024-05-04T00:31:21.445793+0000","last_unstale":"2024-05-04T00:31:26.088596+0000","last_undegraded":"2024-05-04T00:31:26.088596+0000","last_fullsized":"2024-05-04T00:31:26.088596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:54:48.084884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.417524+0000","last_change":"2024-05-04T00:31:19.185102+0000","last_active":"2024-05-04T00:31:35.417524+0000","last_peered":"2024-05-04T00:31:35.417524+0000","last_clean":"2024-05-04T00:31:35.417524+0000","last_became_active":"2024-05-04T00:31:19.183394+0000","last_became_peered":"2024-05-04T00:31:19.183394+0000","last_unstale":"2024-05-04T00:31:35.417524+0000","last_undegraded":"2024-05-04T00:31:35.417524+0000","last_fullsized":"2024-05-04T00:31:35.417524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:36:38.420366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049527+0000","last_change":"2024-05-04T00:31:19.158945+0000","last_active":"2024-05-04T00:31:26.049527+0000","last_peered":"2024-05-04T00:31:26.049527+0000","last_clean":"2024-05-04T00:31:26.049527+0000","last_became_active":"2024-05-04T00:31:19.158152+0000","last_became_peered":"2024-05-04T00:31:19.158152+0000","last_unstale":"2024-05-04T00:31:26.049527+0000","last_undegraded":"2024-05-04T00:31:26.049527+0000","last_fullsized":"2024-05-04T00:31:26.049527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:52.040804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335758+0000","last_change":"2024-05-04T00:31:21.397183+0000","last_active":"2024-05-04T00:31:26.335758+0000","last_peered":"2024-05-04T00:31:26.335758+0000","last_clean":"2024-05-04T00:31:26.335758+0000","last_became_active":"2024-05-04T00:31:21.393014+0000","last_became_peered":"2024-05-04T00:31:21.393014+0000","last_unstale":"2024-05-04T00:31:26.335758+0000","last_undegraded":"2024-05-04T00:31:26.335758+0000","last_fullsized":"2024-05-04T00:31:26.335758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:40:12.379274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977589+0000","last_change":"2024-05-04T00:31:19.186007+0000","last_active":"2024-05-04T00:31:25.977589+0000","last_peered":"2024-05-04T00:31:25.977589+0000","last_clean":"2024-05-04T00:31:25.977589+0000","last_became_active":"2024-05-04T00:31:19.184526+0000","last_became_peered":"2024-05-04T00:31:19.184526+0000","last_unstale":"2024-05-04T00:31:25.977589+0000","last_undegraded":"2024-05-04T00:31:25.977589+0000","last_fullsized":"2024-05-04T00:31:25.977589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:01:33.042606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088155+0000","last_change":"2024-05-04T00:31:21.447258+0000","last_active":"2024-05-04T00:31:26.088155+0000","last_peered":"2024-05-04T00:31:26.088155+0000","last_clean":"2024-05-04T00:31:26.088155+0000","last_became_active":"2024-05-04T00:31:21.446842+0000","last_became_peered":"2024-05-04T00:31:21.446842+0000","last_unstale":"2024-05-04T00:31:26.088155+0000","last_undegraded":"2024-05-04T00:31:26.088155+0000","last_fullsized":"2024-05-04T00:31:26.088155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:10:57.675700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.719730+0000","last_change":"2024-05-04T00:31:19.190422+0000","last_active":"2024-05-04T00:31:31.719730+0000","last_peered":"2024-05-04T00:31:31.719730+0000","last_clean":"2024-05-04T00:31:31.719730+0000","last_became_active":"2024-05-04T00:31:19.189517+0000","last_became_peered":"2024-05-04T00:31:19.189517+0000","last_unstale":"2024-05-04T00:31:31.719730+0000","last_undegraded":"2024-05-04T00:31:31.719730+0000","last_fullsized":"2024-05-04T00:31:31.719730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:16:41.367677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334482+0000","last_change":"2024-05-04T00:31:21.184586+0000","last_active":"2024-05-04T00:31:26.334482+0000","last_peered":"2024-05-04T00:31:26.334482+0000","last_clean":"2024-05-04T00:31:26.334482+0000","last_became_active":"2024-05-04T00:31:21.183698+0000","last_became_peered":"2024-05-04T00:31:21.183698+0000","last_unstale":"2024-05-04T00:31:26.334482+0000","last_undegraded":"2024-05-04T00:31:26.334482+0000","last_fullsized":"2024-05-04T00:31:26.334482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:47:25.699731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.679301+0000","last_change":"2024-05-04T00:31:19.186623+0000","last_active":"2024-05-04T00:31:31.679301+0000","last_peered":"2024-05-04T00:31:31.679301+0000","last_clean":"2024-05-04T00:31:31.679301+0000","last_became_active":"2024-05-04T00:31:19.185633+0000","last_became_peered":"2024-05-04T00:31:19.185633+0000","last_unstale":"2024-05-04T00:31:31.679301+0000","last_undegraded":"2024-05-04T00:31:31.679301+0000","last_fullsized":"2024-05-04T00:31:31.679301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:10:55.324717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336711+0000","last_change":"2024-05-04T00:31:21.410329+0000","last_active":"2024-05-04T00:31:26.336711+0000","last_peered":"2024-05-04T00:31:26.336711+0000","last_clean":"2024-05-04T00:31:26.336711+0000","last_became_active":"2024-05-04T00:31:21.409655+0000","last_became_peered":"2024-05-04T00:31:21.409655+0000","last_unstale":"2024-05-04T00:31:26.336711+0000","last_undegraded":"2024-05-04T00:31:26.336711+0000","last_fullsized":"2024-05-04T00:31:26.336711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:09:40.562107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334997+0000","last_change":"2024-05-04T00:31:19.178130+0000","last_active":"2024-05-04T00:31:26.334997+0000","last_peered":"2024-05-04T00:31:26.334997+0000","last_clean":"2024-05-04T00:31:26.334997+0000","last_became_active":"2024-05-04T00:31:19.177283+0000","last_became_peered":"2024-05-04T00:31:19.177283+0000","last_unstale":"2024-05-04T00:31:26.334997+0000","last_undegraded":"2024-05-04T00:31:26.334997+0000","last_fullsized":"2024-05-04T00:31:26.334997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:42:41.790988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978336+0000","last_change":"2024-05-04T00:31:21.187102+0000","last_active":"2024-05-04T00:31:25.978336+0000","last_peered":"2024-05-04T00:31:25.978336+0000","last_clean":"2024-05-04T00:31:25.978336+0000","last_became_active":"2024-05-04T00:31:21.186167+0000","last_became_peered":"2024-05-04T00:31:21.186167+0000","last_unstale":"2024-05-04T00:31:25.978336+0000","last_undegraded":"2024-05-04T00:31:25.978336+0000","last_fullsized":"2024-05-04T00:31:25.978336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:05:04.013367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"26'8","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.701064+0000","last_change":"2024-05-04T00:31:19.251247+0000","last_active":"2024-05-04T00:31:31.701064+0000","last_peered":"2024-05-04T00:31:31.701064+0000","last_clean":"2024-05-04T00:31:31.701064+0000","last_became_active":"2024-05-04T00:31:19.250003+0000","last_became_peered":"2024-05-04T00:31:19.250003+0000","last_unstale":"2024-05-04T00:31:31.701064+0000","last_undegraded":"2024-05-04T00:31:31.701064+0000","last_fullsized":"2024-05-04T00:31:31.701064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:40:06.774090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334818+0000","last_change":"2024-05-04T00:31:21.401432+0000","last_active":"2024-05-04T00:31:26.334818+0000","last_peered":"2024-05-04T00:31:26.334818+0000","last_clean":"2024-05-04T00:31:26.334818+0000","last_became_active":"2024-05-04T00:31:21.397220+0000","last_became_peered":"2024-05-04T00:31:21.397220+0000","last_unstale":"2024-05-04T00:31:26.334818+0000","last_undegraded":"2024-05-04T00:31:26.334818+0000","last_fullsized":"2024-05-04T00:31:26.334818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:07.460897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.308011+0000","last_change":"2024-05-04T00:31:19.183674+0000","last_active":"2024-05-04T00:31:35.308011+0000","last_peered":"2024-05-04T00:31:35.308011+0000","last_clean":"2024-05-04T00:31:35.308011+0000","last_became_active":"2024-05-04T00:31:19.183331+0000","last_became_peered":"2024-05-04T00:31:19.183331+0000","last_unstale":"2024-05-04T00:31:35.308011+0000","last_undegraded":"2024-05-04T00:31:35.308011+0000","last_fullsized":"2024-05-04T00:31:35.308011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:13:52.447627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049560+0000","last_change":"2024-05-04T00:31:21.342578+0000","last_active":"2024-05-04T00:31:26.049560+0000","last_peered":"2024-05-04T00:31:26.049560+0000","last_clean":"2024-05-04T00:31:26.049560+0000","last_became_active":"2024-05-04T00:31:21.342064+0000","last_became_peered":"2024-05-04T00:31:21.342064+0000","last_unstale":"2024-05-04T00:31:26.049560+0000","last_undegraded":"2024-05-04T00:31:26.049560+0000","last_fullsized":"2024-05-04T00:31:26.049560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:35.377002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.655969+0000","last_change":"2024-05-04T00:31:19.184166+0000","last_active":"2024-05-04T00:31:31.655969+0000","last_peered":"2024-05-04T00:31:31.655969+0000","last_clean":"2024-05-04T00:31:31.655969+0000","last_became_active":"2024-05-04T00:31:19.181304+0000","last_became_peered":"2024-05-04T00:31:19.181304+0000","last_unstale":"2024-05-04T00:31:31.655969+0000","last_undegraded":"2024-05-04T00:31:31.655969+0000","last_fullsized":"2024-05-04T00:31:31.655969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:49:04.376111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978217+0000","last_change":"2024-05-04T00:31:21.390252+0000","last_active":"2024-05-04T00:31:25.978217+0000","last_peered":"2024-05-04T00:31:25.978217+0000","last_clean":"2024-05-04T00:31:25.978217+0000","last_became_active":"2024-05-04T00:31:21.389360+0000","last_became_peered":"2024-05-04T00:31:21.389360+0000","last_unstale":"2024-05-04T00:31:25.978217+0000","last_undegraded":"2024-05-04T00:31:25.978217+0000","last_fullsized":"2024-05-04T00:31:25.978217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:45:23.177550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333936+0000","last_change":"2024-05-04T00:31:19.176756+0000","last_active":"2024-05-04T00:31:26.333936+0000","last_peered":"2024-05-04T00:31:26.333936+0000","last_clean":"2024-05-04T00:31:26.333936+0000","last_became_active":"2024-05-04T00:31:19.175779+0000","last_became_peered":"2024-05-04T00:31:19.175779+0000","last_unstale":"2024-05-04T00:31:26.333936+0000","last_undegraded":"2024-05-04T00:31:26.333936+0000","last_fullsized":"2024-05-04T00:31:26.333936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:14.453153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.332161+0000","last_change":"2024-05-04T00:31:21.397306+0000","last_active":"2024-05-04T00:31:26.332161+0000","last_peered":"2024-05-04T00:31:26.332161+0000","last_clean":"2024-05-04T00:31:26.332161+0000","last_became_active":"2024-05-04T00:31:21.394863+0000","last_became_peered":"2024-05-04T00:31:21.394863+0000","last_unstale":"2024-05-04T00:31:26.332161+0000","last_undegraded":"2024-05-04T00:31:26.332161+0000","last_fullsized":"2024-05-04T00:31:26.332161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:46:38.463068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"26'10","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.489703+0000","last_change":"2024-05-04T00:31:19.177402+0000","last_active":"2024-05-04T00:31:31.489703+0000","last_peered":"2024-05-04T00:31:31.489703+0000","last_clean":"2024-05-04T00:31:31.489703+0000","last_became_active":"2024-05-04T00:31:19.176805+0000","last_became_peered":"2024-05-04T00:31:19.176805+0000","last_unstale":"2024-05-04T00:31:31.489703+0000","last_undegraded":"2024-05-04T00:31:31.489703+0000","last_fullsized":"2024-05-04T00:31:31.489703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:31.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977565+0000","last_change":"2024-05-04T00:31:21.188457+0000","last_active":"2024-05-04T00:31:25.977565+0000","last_peered":"2024-05-04T00:31:25.977565+0000","last_clean":"2024-05-04T00:31:25.977565+0000","last_became_active":"2024-05-04T00:31:21.187554+0000","last_became_peered":"2024-05-04T00:31:21.187554+0000","last_unstale":"2024-05-04T00:31:25.977565+0000","last_undegraded":"2024-05-04T00:31:25.977565+0000","last_fullsized":"2024-05-04T00:31:25.977565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:31:55.671261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335265+0000","last_change":"2024-05-04T00:31:19.176641+0000","last_active":"2024-05-04T00:31:26.335265+0000","last_peered":"2024-05-04T00:31:26.335265+0000","last_clean":"2024-05-04T00:31:26.335265+0000","last_became_active":"2024-05-04T00:31:19.175715+0000","last_became_peered":"2024-05-04T00:31:19.175715+0000","last_unstale":"2024-05-04T00:31:26.335265+0000","last_undegraded":"2024-05-04T00:31:26.335265+0000","last_fullsized":"2024-05-04T00:31:26.335265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:05:45.097410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334791+0000","last_change":"2024-05-04T00:31:21.407554+0000","last_active":"2024-05-04T00:31:26.334791+0000","last_peered":"2024-05-04T00:31:26.334791+0000","last_clean":"2024-05-04T00:31:26.334791+0000","last_became_active":"2024-05-04T00:31:21.403004+0000","last_became_peered":"2024-05-04T00:31:21.403004+0000","last_unstale":"2024-05-04T00:31:26.334791+0000","last_undegraded":"2024-05-04T00:31:26.334791+0000","last_fullsized":"2024-05-04T00:31:26.334791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:33.938895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088847+0000","last_change":"2024-05-04T00:31:19.187116+0000","last_active":"2024-05-04T00:31:26.088847+0000","last_peered":"2024-05-04T00:31:26.088847+0000","last_clean":"2024-05-04T00:31:26.088847+0000","last_became_active":"2024-05-04T00:31:19.186540+0000","last_became_peered":"2024-05-04T00:31:19.186540+0000","last_unstale":"2024-05-04T00:31:26.088847+0000","last_undegraded":"2024-05-04T00:31:26.088847+0000","last_fullsized":"2024-05-04T00:31:26.088847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:08.420067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334905+0000","last_change":"2024-05-04T00:31:21.407986+0000","last_active":"2024-05-04T00:31:26.334905+0000","last_peered":"2024-05-04T00:31:26.334905+0000","last_clean":"2024-05-04T00:31:26.334905+0000","last_became_active":"2024-05-04T00:31:21.404350+0000","last_became_peered":"2024-05-04T00:31:21.404350+0000","last_unstale":"2024-05-04T00:31:26.334905+0000","last_undegraded":"2024-05-04T00:31:26.334905+0000","last_fullsized":"2024-05-04T00:31:26.334905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:12:34.898595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336199+0000","last_change":"2024-05-04T00:31:19.190045+0000","last_active":"2024-05-04T00:31:26.336199+0000","last_peered":"2024-05-04T00:31:26.336199+0000","last_clean":"2024-05-04T00:31:26.336199+0000","last_became_active":"2024-05-04T00:31:19.189166+0000","last_became_peered":"2024-05-04T00:31:19.189166+0000","last_unstale":"2024-05-04T00:31:26.336199+0000","last_undegraded":"2024-05-04T00:31:26.336199+0000","last_fullsized":"2024-05-04T00:31:26.336199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:31.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334803+0000","last_change":"2024-05-04T00:31:21.402171+0000","last_active":"2024-05-04T00:31:26.334803+0000","last_peered":"2024-05-04T00:31:26.334803+0000","last_clean":"2024-05-04T00:31:26.334803+0000","last_became_active":"2024-05-04T00:31:21.401467+0000","last_became_peered":"2024-05-04T00:31:21.401467+0000","last_unstale":"2024-05-04T00:31:26.334803+0000","last_undegraded":"2024-05-04T00:31:26.334803+0000","last_fullsized":"2024-05-04T00:31:26.334803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:34:25.722557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.050396+0000","last_change":"2024-05-04T00:31:19.155210+0000","last_active":"2024-05-04T00:31:26.050396+0000","last_peered":"2024-05-04T00:31:26.050396+0000","last_clean":"2024-05-04T00:31:26.050396+0000","last_became_active":"2024-05-04T00:31:19.154504+0000","last_became_peered":"2024-05-04T00:31:19.154504+0000","last_unstale":"2024-05-04T00:31:26.050396+0000","last_undegraded":"2024-05-04T00:31:26.050396+0000","last_fullsized":"2024-05-04T00:31:26.050396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:47:23.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978511+0000","last_change":"2024-05-04T00:31:21.406273+0000","last_active":"2024-05-04T00:31:25.978511+0000","last_peered":"2024-05-04T00:31:25.978511+0000","last_clean":"2024-05-04T00:31:25.978511+0000","last_became_active":"2024-05-04T00:31:21.405283+0000","last_became_peered":"2024-05-04T00:31:21.405283+0000","last_unstale":"2024-05-04T00:31:25.978511+0000","last_undegraded":"2024-05-04T00:31:25.978511+0000","last_fullsized":"2024-05-04T00:31:25.978511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:20:31.795673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":117,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.332489+0000","last_change":"2024-05-04T00:30:40.841283+0000","last_active":"2024-05-04T00:31:26.332489+0000","last_peered":"2024-05-04T00:31:26.332489+0000","last_clean":"2024-05-04T00:31:26.332489+0000","last_became_active":"2024-05-04T00:30:40.838353+0000","last_became_peered":"2024-05-04T00:30:40.838353+0000","last_unstale":"2024-05-04T00:31:26.332489+0000","last_undegraded":"2024-05-04T00:31:26.332489+0000","last_fullsized":"2024-05-04T00:31:26.332489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:30:37.159356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:30:37.159356+0000","last_clean_scrub_stamp":"2024-05-04T00:30:37.159356+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:30:10.374994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.656668+0000","last_change":"2024-05-04T00:31:19.248691+0000","last_active":"2024-05-04T00:31:31.656668+0000","last_peered":"2024-05-04T00:31:31.656668+0000","last_clean":"2024-05-04T00:31:31.656668+0000","last_became_active":"2024-05-04T00:31:19.247815+0000","last_became_peered":"2024-05-04T00:31:19.247815+0000","last_unstale":"2024-05-04T00:31:31.656668+0000","last_undegraded":"2024-05-04T00:31:31.656668+0000","last_fullsized":"2024-05-04T00:31:31.656668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:46:05.720208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088363+0000","last_change":"2024-05-04T00:31:21.446500+0000","last_active":"2024-05-04T00:31:26.088363+0000","last_peered":"2024-05-04T00:31:26.088363+0000","last_clean":"2024-05-04T00:31:26.088363+0000","last_became_active":"2024-05-04T00:31:21.446100+0000","last_became_peered":"2024-05-04T00:31:21.446100+0000","last_unstale":"2024-05-04T00:31:26.088363+0000","last_undegraded":"2024-05-04T00:31:26.088363+0000","last_fullsized":"2024-05-04T00:31:26.088363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:06.542614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.418363+0000","last_change":"2024-05-04T00:31:19.184044+0000","last_active":"2024-05-04T00:31:35.418363+0000","last_peered":"2024-05-04T00:31:35.418363+0000","last_clean":"2024-05-04T00:31:35.418363+0000","last_became_active":"2024-05-04T00:31:19.181956+0000","last_became_peered":"2024-05-04T00:31:19.181956+0000","last_unstale":"2024-05-04T00:31:35.418363+0000","last_undegraded":"2024-05-04T00:31:35.418363+0000","last_fullsized":"2024-05-04T00:31:35.418363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:09:33.607433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049528+0000","last_change":"2024-05-04T00:31:21.343953+0000","last_active":"2024-05-04T00:31:26.049528+0000","last_peered":"2024-05-04T00:31:26.049528+0000","last_clean":"2024-05-04T00:31:26.049528+0000","last_became_active":"2024-05-04T00:31:21.343499+0000","last_became_peered":"2024-05-04T00:31:21.343499+0000","last_unstale":"2024-05-04T00:31:26.049528+0000","last_undegraded":"2024-05-04T00:31:26.049528+0000","last_fullsized":"2024-05-04T00:31:26.049528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:33.938895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.311044+0000","last_change":"2024-05-04T00:31:19.184947+0000","last_active":"2024-05-04T00:31:35.311044+0000","last_peered":"2024-05-04T00:31:35.311044+0000","last_clean":"2024-05-04T00:31:35.311044+0000","last_became_active":"2024-05-04T00:31:19.184606+0000","last_became_peered":"2024-05-04T00:31:19.184606+0000","last_unstale":"2024-05-04T00:31:35.311044+0000","last_undegraded":"2024-05-04T00:31:35.311044+0000","last_fullsized":"2024-05-04T00:31:35.311044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:07:49.638230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335413+0000","last_change":"2024-05-04T00:31:21.402799+0000","last_active":"2024-05-04T00:31:26.335413+0000","last_peered":"2024-05-04T00:31:26.335413+0000","last_clean":"2024-05-04T00:31:26.335413+0000","last_became_active":"2024-05-04T00:31:21.401591+0000","last_became_peered":"2024-05-04T00:31:21.401591+0000","last_unstale":"2024-05-04T00:31:26.335413+0000","last_undegraded":"2024-05-04T00:31:26.335413+0000","last_fullsized":"2024-05-04T00:31:26.335413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:28:07.779536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978310+0000","last_change":"2024-05-04T00:31:19.182214+0000","last_active":"2024-05-04T00:31:25.978310+0000","last_peered":"2024-05-04T00:31:25.978310+0000","last_clean":"2024-05-04T00:31:25.978310+0000","last_became_active":"2024-05-04T00:31:19.180317+0000","last_became_peered":"2024-05-04T00:31:19.180317+0000","last_unstale":"2024-05-04T00:31:25.978310+0000","last_undegraded":"2024-05-04T00:31:25.978310+0000","last_fullsized":"2024-05-04T00:31:25.978310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:44.678316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334340+0000","last_change":"2024-05-04T00:31:21.401965+0000","last_active":"2024-05-04T00:31:26.334340+0000","last_peered":"2024-05-04T00:31:26.334340+0000","last_clean":"2024-05-04T00:31:26.334340+0000","last_became_active":"2024-05-04T00:31:21.389808+0000","last_became_peered":"2024-05-04T00:31:21.389808+0000","last_unstale":"2024-05-04T00:31:26.334340+0000","last_undegraded":"2024-05-04T00:31:26.334340+0000","last_fullsized":"2024-05-04T00:31:26.334340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:52:48.345813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336089+0000","last_change":"2024-05-04T00:31:19.183991+0000","last_active":"2024-05-04T00:31:26.336089+0000","last_peered":"2024-05-04T00:31:26.336089+0000","last_clean":"2024-05-04T00:31:26.336089+0000","last_became_active":"2024-05-04T00:31:19.179785+0000","last_became_peered":"2024-05-04T00:31:19.179785+0000","last_unstale":"2024-05-04T00:31:26.336089+0000","last_undegraded":"2024-05-04T00:31:26.336089+0000","last_fullsized":"2024-05-04T00:31:26.336089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:29.575176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333549+0000","last_change":"2024-05-04T00:31:21.342687+0000","last_active":"2024-05-04T00:31:26.333549+0000","last_peered":"2024-05-04T00:31:26.333549+0000","last_clean":"2024-05-04T00:31:26.333549+0000","last_became_active":"2024-05-04T00:31:21.341702+0000","last_became_peered":"2024-05-04T00:31:21.341702+0000","last_unstale":"2024-05-04T00:31:26.333549+0000","last_undegraded":"2024-05-04T00:31:26.333549+0000","last_fullsized":"2024-05-04T00:31:26.333549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:56.687510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978903+0000","last_change":"2024-05-04T00:31:19.176663+0000","last_active":"2024-05-04T00:31:25.978903+0000","last_peered":"2024-05-04T00:31:25.978903+0000","last_clean":"2024-05-04T00:31:25.978903+0000","last_became_active":"2024-05-04T00:31:19.175616+0000","last_became_peered":"2024-05-04T00:31:19.175616+0000","last_unstale":"2024-05-04T00:31:25.978903+0000","last_undegraded":"2024-05-04T00:31:25.978903+0000","last_fullsized":"2024-05-04T00:31:25.978903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:24:47.124717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.050096+0000","last_change":"2024-05-04T00:31:21.403129+0000","last_active":"2024-05-04T00:31:26.050096+0000","last_peered":"2024-05-04T00:31:26.050096+0000","last_clean":"2024-05-04T00:31:26.050096+0000","last_became_active":"2024-05-04T00:31:21.402248+0000","last_became_peered":"2024-05-04T00:31:21.402248+0000","last_unstale":"2024-05-04T00:31:26.050096+0000","last_undegraded":"2024-05-04T00:31:26.050096+0000","last_fullsized":"2024-05-04T00:31:26.050096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:10.771050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.089094+0000","last_change":"2024-05-04T00:31:19.155903+0000","last_active":"2024-05-04T00:31:26.089094+0000","last_peered":"2024-05-04T00:31:26.089094+0000","last_clean":"2024-05-04T00:31:26.089094+0000","last_became_active":"2024-05-04T00:31:19.154909+0000","last_became_peered":"2024-05-04T00:31:19.154909+0000","last_unstale":"2024-05-04T00:31:26.089094+0000","last_undegraded":"2024-05-04T00:31:26.089094+0000","last_fullsized":"2024-05-04T00:31:26.089094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:53:25.815241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088979+0000","last_change":"2024-05-04T00:31:21.445396+0000","last_active":"2024-05-04T00:31:26.088979+0000","last_peered":"2024-05-04T00:31:26.088979+0000","last_clean":"2024-05-04T00:31:26.088979+0000","last_became_active":"2024-05-04T00:31:21.444934+0000","last_became_peered":"2024-05-04T00:31:21.444934+0000","last_unstale":"2024-05-04T00:31:26.088979+0000","last_undegraded":"2024-05-04T00:31:26.088979+0000","last_fullsized":"2024-05-04T00:31:26.088979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:23:02.407000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.645726+0000","last_change":"2024-05-04T00:31:19.182946+0000","last_active":"2024-05-04T00:31:31.645726+0000","last_peered":"2024-05-04T00:31:31.645726+0000","last_clean":"2024-05-04T00:31:31.645726+0000","last_became_active":"2024-05-04T00:31:19.182050+0000","last_became_peered":"2024-05-04T00:31:19.182050+0000","last_unstale":"2024-05-04T00:31:31.645726+0000","last_undegraded":"2024-05-04T00:31:31.645726+0000","last_fullsized":"2024-05-04T00:31:31.645726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:55:12.448558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088626+0000","last_change":"2024-05-04T00:31:21.443100+0000","last_active":"2024-05-04T00:31:26.088626+0000","last_peered":"2024-05-04T00:31:26.088626+0000","last_clean":"2024-05-04T00:31:26.088626+0000","last_became_active":"2024-05-04T00:31:21.442602+0000","last_became_peered":"2024-05-04T00:31:21.442602+0000","last_unstale":"2024-05-04T00:31:26.088626+0000","last_undegraded":"2024-05-04T00:31:26.088626+0000","last_fullsized":"2024-05-04T00:31:26.088626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:16:45.807230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.680264+0000","last_change":"2024-05-04T00:31:19.248358+0000","last_active":"2024-05-04T00:31:31.680264+0000","last_peered":"2024-05-04T00:31:31.680264+0000","last_clean":"2024-05-04T00:31:31.680264+0000","last_became_active":"2024-05-04T00:31:19.247822+0000","last_became_peered":"2024-05-04T00:31:19.247822+0000","last_unstale":"2024-05-04T00:31:31.680264+0000","last_undegraded":"2024-05-04T00:31:31.680264+0000","last_fullsized":"2024-05-04T00:31:31.680264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:04.191631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977590+0000","last_change":"2024-05-04T00:31:21.441959+0000","last_active":"2024-05-04T00:31:25.977590+0000","last_peered":"2024-05-04T00:31:25.977590+0000","last_clean":"2024-05-04T00:31:25.977590+0000","last_became_active":"2024-05-04T00:31:21.441015+0000","last_became_peered":"2024-05-04T00:31:21.441015+0000","last_unstale":"2024-05-04T00:31:25.977590+0000","last_undegraded":"2024-05-04T00:31:25.977590+0000","last_fullsized":"2024-05-04T00:31:25.977590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:54:30.187813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.492350+0000","last_change":"2024-05-04T00:31:19.159146+0000","last_active":"2024-05-04T00:31:31.492350+0000","last_peered":"2024-05-04T00:31:31.492350+0000","last_clean":"2024-05-04T00:31:31.492350+0000","last_became_active":"2024-05-04T00:31:19.158366+0000","last_became_peered":"2024-05-04T00:31:19.158366+0000","last_unstale":"2024-05-04T00:31:31.492350+0000","last_undegraded":"2024-05-04T00:31:31.492350+0000","last_fullsized":"2024-05-04T00:31:31.492350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:07.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088049+0000","last_change":"2024-05-04T00:31:21.441521+0000","last_active":"2024-05-04T00:31:26.088049+0000","last_peered":"2024-05-04T00:31:26.088049+0000","last_clean":"2024-05-04T00:31:26.088049+0000","last_became_active":"2024-05-04T00:31:21.441074+0000","last_became_peered":"2024-05-04T00:31:21.441074+0000","last_unstale":"2024-05-04T00:31:26.088049+0000","last_undegraded":"2024-05-04T00:31:26.088049+0000","last_fullsized":"2024-05-04T00:31:26.088049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:31.926158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.050041+0000","last_change":"2024-05-04T00:31:19.174493+0000","last_active":"2024-05-04T00:31:26.050041+0000","last_peered":"2024-05-04T00:31:26.050041+0000","last_clean":"2024-05-04T00:31:26.050041+0000","last_became_active":"2024-05-04T00:31:19.174113+0000","last_became_peered":"2024-05-04T00:31:19.174113+0000","last_unstale":"2024-05-04T00:31:26.050041+0000","last_undegraded":"2024-05-04T00:31:26.050041+0000","last_fullsized":"2024-05-04T00:31:26.050041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:54.336528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334858+0000","last_change":"2024-05-04T00:31:21.406782+0000","last_active":"2024-05-04T00:31:26.334858+0000","last_peered":"2024-05-04T00:31:26.334858+0000","last_clean":"2024-05-04T00:31:26.334858+0000","last_became_active":"2024-05-04T00:31:21.406008+0000","last_became_peered":"2024-05-04T00:31:21.406008+0000","last_unstale":"2024-05-04T00:31:26.334858+0000","last_undegraded":"2024-05-04T00:31:26.334858+0000","last_fullsized":"2024-05-04T00:31:26.334858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:24:01.565048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.645923+0000","last_change":"2024-05-04T00:31:19.248682+0000","last_active":"2024-05-04T00:31:31.645923+0000","last_peered":"2024-05-04T00:31:31.645923+0000","last_clean":"2024-05-04T00:31:31.645923+0000","last_became_active":"2024-05-04T00:31:19.247736+0000","last_became_peered":"2024-05-04T00:31:19.247736+0000","last_unstale":"2024-05-04T00:31:31.645923+0000","last_undegraded":"2024-05-04T00:31:31.645923+0000","last_fullsized":"2024-05-04T00:31:31.645923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:42:59.459764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977927+0000","last_change":"2024-05-04T00:31:21.401858+0000","last_active":"2024-05-04T00:31:25.977927+0000","last_peered":"2024-05-04T00:31:25.977927+0000","last_clean":"2024-05-04T00:31:25.977927+0000","last_became_active":"2024-05-04T00:31:21.400935+0000","last_became_peered":"2024-05-04T00:31:21.400935+0000","last_unstale":"2024-05-04T00:31:25.977927+0000","last_undegraded":"2024-05-04T00:31:25.977927+0000","last_fullsized":"2024-05-04T00:31:25.977927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:50:11.762845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978424+0000","last_change":"2024-05-04T00:31:21.392918+0000","last_active":"2024-05-04T00:31:25.978424+0000","last_peered":"2024-05-04T00:31:25.978424+0000","last_clean":"2024-05-04T00:31:25.978424+0000","last_became_active":"2024-05-04T00:31:21.392020+0000","last_became_peered":"2024-05-04T00:31:21.392020+0000","last_unstale":"2024-05-04T00:31:25.978424+0000","last_undegraded":"2024-05-04T00:31:25.978424+0000","last_fullsized":"2024-05-04T00:31:25.978424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:19:30.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334811+0000","last_change":"2024-05-04T00:31:19.187930+0000","last_active":"2024-05-04T00:31:26.334811+0000","last_peered":"2024-05-04T00:31:26.334811+0000","last_clean":"2024-05-04T00:31:26.334811+0000","last_became_active":"2024-05-04T00:31:19.185156+0000","last_became_peered":"2024-05-04T00:31:19.185156+0000","last_unstale":"2024-05-04T00:31:26.334811+0000","last_undegraded":"2024-05-04T00:31:26.334811+0000","last_fullsized":"2024-05-04T00:31:26.334811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:40.266177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.332539+0000","last_change":"2024-05-04T00:31:21.397596+0000","last_active":"2024-05-04T00:31:26.332539+0000","last_peered":"2024-05-04T00:31:26.332539+0000","last_clean":"2024-05-04T00:31:26.332539+0000","last_became_active":"2024-05-04T00:31:21.396023+0000","last_became_peered":"2024-05-04T00:31:21.396023+0000","last_unstale":"2024-05-04T00:31:26.332539+0000","last_undegraded":"2024-05-04T00:31:26.332539+0000","last_fullsized":"2024-05-04T00:31:26.332539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:02:02.166274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335177+0000","last_change":"2024-05-04T00:31:19.189413+0000","last_active":"2024-05-04T00:31:26.335177+0000","last_peered":"2024-05-04T00:31:26.335177+0000","last_clean":"2024-05-04T00:31:26.335177+0000","last_became_active":"2024-05-04T00:31:19.188359+0000","last_became_peered":"2024-05-04T00:31:19.188359+0000","last_unstale":"2024-05-04T00:31:26.335177+0000","last_undegraded":"2024-05-04T00:31:26.335177+0000","last_fullsized":"2024-05-04T00:31:26.335177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:16:43.456248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336512+0000","last_change":"2024-05-04T00:31:21.417364+0000","last_active":"2024-05-04T00:31:26.336512+0000","last_peered":"2024-05-04T00:31:26.336512+0000","last_clean":"2024-05-04T00:31:26.336512+0000","last_became_active":"2024-05-04T00:31:21.416267+0000","last_became_peered":"2024-05-04T00:31:21.416267+0000","last_unstale":"2024-05-04T00:31:26.336512+0000","last_undegraded":"2024-05-04T00:31:26.336512+0000","last_fullsized":"2024-05-04T00:31:26.336512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:42:31.303120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336663+0000","last_change":"2024-05-04T00:31:19.187081+0000","last_active":"2024-05-04T00:31:26.336663+0000","last_peered":"2024-05-04T00:31:26.336663+0000","last_clean":"2024-05-04T00:31:26.336663+0000","last_became_active":"2024-05-04T00:31:19.186483+0000","last_became_peered":"2024-05-04T00:31:19.186483+0000","last_unstale":"2024-05-04T00:31:26.336663+0000","last_undegraded":"2024-05-04T00:31:26.336663+0000","last_fullsized":"2024-05-04T00:31:26.336663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:07.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336315+0000","last_change":"2024-05-04T00:31:21.414034+0000","last_active":"2024-05-04T00:31:26.336315+0000","last_peered":"2024-05-04T00:31:26.336315+0000","last_clean":"2024-05-04T00:31:26.336315+0000","last_became_active":"2024-05-04T00:31:21.413330+0000","last_became_peered":"2024-05-04T00:31:21.413330+0000","last_unstale":"2024-05-04T00:31:26.336315+0000","last_undegraded":"2024-05-04T00:31:26.336315+0000","last_fullsized":"2024-05-04T00:31:26.336315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:07.135906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.089033+0000","last_change":"2024-05-04T00:31:19.175936+0000","last_active":"2024-05-04T00:31:26.089033+0000","last_peered":"2024-05-04T00:31:26.089033+0000","last_clean":"2024-05-04T00:31:26.089033+0000","last_became_active":"2024-05-04T00:31:19.175356+0000","last_became_peered":"2024-05-04T00:31:19.175356+0000","last_unstale":"2024-05-04T00:31:26.089033+0000","last_undegraded":"2024-05-04T00:31:26.089033+0000","last_fullsized":"2024-05-04T00:31:26.089033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:33.026019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3940,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":7958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":100305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":102751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":101295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":868352,"data_stored":690121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":99829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":100389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":880640,"data_stored":690765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":100287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T00:31:36.245 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T00:31:36.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.421+0000 7f4fbc9aa640 1 Processor -- start 2024-05-04T00:31:36.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.421+0000 7f4fbc9aa640 1 -- start start 2024-05-04T00:31:36.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.421+0000 7f4fbc9aa640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4fb80c8e10 0x7f4fb815d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:36.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.421+0000 7f4fbc9aa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fb8142cd0 0x7f4fb81430e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:36.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.421+0000 7f4fbc9aa640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fb8154610 con 0x7f4fb80c7b20 2024-05-04T00:31:36.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.421+0000 7f4fbc9aa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f4fb8159f30 con 0x7f4fb8142cd0 2024-05-04T00:31:36.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.421+0000 7f4fbc9aa640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f4fb80c9570 con 0x7f4fb80c8e10 2024-05-04T00:31:36.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.421+0000 7f4fb5d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fb8142cd0 0x7f4fb81430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:36.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.421+0000 7f4fb5d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fb8142cd0 0x7f4fb81430e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40574/0 (socket says 172.21.15.6:40574) 2024-05-04T00:31:36.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.421+0000 7f4fb5d9b640 1 -- 172.21.15.6:0/2581806869 learned_addr learned my addr 172.21.15.6:0/2581806869 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:36.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.425+0000 7f4fb659c640 1 --2- 172.21.15.6:0/2581806869 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4fb80c8e10 0x7f4fb815d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:36.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.425+0000 7f4fb5d9b640 1 -- 172.21.15.6:0/2581806869 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4fb80c8e10 msgr2=0x7f4fb815d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:36.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.425+0000 7f4fb5d9b640 1 --2- 172.21.15.6:0/2581806869 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4fb80c8e10 0x7f4fb815d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:36.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.425+0000 7f4fb5d9b640 1 -- 172.21.15.6:0/2581806869 >> v1:172.21.15.163:6789/0 conn(0x7f4fb80c7b20 legacy=0x7f4fb80631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:36.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.425+0000 7f4fb5d9b640 1 -- 172.21.15.6:0/2581806869 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb80c9850 con 0x7f4fb8142cd0 2024-05-04T00:31:36.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.429+0000 7f4fb5d9b640 1 --2- 172.21.15.6:0/2581806869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb8142cd0 0x7f4fb81430e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8009870 tx=0x7f4fa801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ce7c8c7f6e3f03 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:36.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.433+0000 7f4fb559a640 1 -- 172.21.15.6:0/2581806869 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa80b5070 con 0x7f4fb8142cd0 2024-05-04T00:31:36.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.433+0000 7f4fb559a640 1 -- 172.21.15.6:0/2581806869 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa80a8a50 con 0x7f4fb8142cd0 2024-05-04T00:31:36.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.433+0000 7f4fb559a640 1 -- 172.21.15.6:0/2581806869 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa80a8e20 con 0x7f4fb8142cd0 2024-05-04T00:31:36.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.433+0000 7f4fbc9aa640 1 -- 172.21.15.6:0/2581806869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb8142cd0 msgr2=0x7f4fb81430e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:36.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.433+0000 7f4fbc9aa640 1 --2- 172.21.15.6:0/2581806869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb8142cd0 0x7f4fb81430e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8009870 tx=0x7f4fa801ed50 comp rx=0 tx=0).stop 2024-05-04T00:31:36.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.433+0000 7f4fbc9aa640 1 -- 172.21.15.6:0/2581806869 shutdown_connections 2024-05-04T00:31:36.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.433+0000 7f4fbc9aa640 1 --2- 172.21.15.6:0/2581806869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb8142cd0 0x7f4fb81430e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:36.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.433+0000 7f4fbc9aa640 1 --2- 172.21.15.6:0/2581806869 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4fb80c8e10 0x7f4fb815d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:36.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.433+0000 7f4fbc9aa640 1 -- 172.21.15.6:0/2581806869 >> 172.21.15.6:0/2581806869 conn(0x7f4fb80cb310 msgr2=0x7f4fb80cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:36.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.433+0000 7f4fbc9aa640 1 -- 172.21.15.6:0/2581806869 shutdown_connections 2024-05-04T00:31:36.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.433+0000 7f4fbc9aa640 1 -- 172.21.15.6:0/2581806869 wait complete. 2024-05-04T00:31:36.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.437+0000 7f4fbc9aa640 1 Processor -- start 2024-05-04T00:31:36.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.437+0000 7f4fbc9aa640 1 -- start start 2024-05-04T00:31:36.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.437+0000 7f4fbc9aa640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4fb80c7b20 0x7f4fb813fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:36.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.437+0000 7f4fbc9aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb80c8e10 0x7f4fb81f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:36.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.437+0000 7f4fbc9aa640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fb8142cd0 0x7f4fb813c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:36.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.437+0000 7f4fbc9aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb815a7b0 con 0x7f4fb80c8e10 2024-05-04T00:31:36.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.437+0000 7f4fbc9aa640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb815a4d0 con 0x7f4fb8142cd0 2024-05-04T00:31:36.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.437+0000 7f4fbc9aa640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f4fb80c9220 con 0x7f4fb80c7b20 2024-05-04T00:31:36.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.437+0000 7f4fb5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb80c8e10 0x7f4fb81f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:36.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.437+0000 7f4fb5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb80c8e10 0x7f4fb81f4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40580/0 (socket says 172.21.15.6:40580) 2024-05-04T00:31:36.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.437+0000 7f4fb5d9b640 1 -- 172.21.15.6:0/1207880131 learned_addr learned my addr 172.21.15.6:0/1207880131 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:36.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.437+0000 7f4fb6d9d640 1 --2- 172.21.15.6:0/1207880131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fb8142cd0 0x7f4fb813c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:36.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.437+0000 7f4fb659c640 1 --2- 172.21.15.6:0/1207880131 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4fb80c7b20 0x7f4fb813fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:36.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.441+0000 7f4fb5d9b640 1 -- 172.21.15.6:0/1207880131 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4fb80c7b20 msgr2=0x7f4fb813fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:36.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.441+0000 7f4fb5d9b640 1 --2- 172.21.15.6:0/1207880131 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4fb80c7b20 0x7f4fb813fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:36.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.441+0000 7f4fb5d9b640 1 -- 172.21.15.6:0/1207880131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fb8142cd0 msgr2=0x7f4fb813c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:36.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.441+0000 7f4fb5d9b640 1 --2- 172.21.15.6:0/1207880131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fb8142cd0 0x7f4fb813c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:36.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.441+0000 7f4fb5d9b640 1 -- 172.21.15.6:0/1207880131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb81f4650 con 0x7f4fb80c8e10 2024-05-04T00:31:36.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.445+0000 7f4fb5d9b640 1 --2- 172.21.15.6:0/1207880131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb80c8e10 0x7f4fb81f4110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80b3040 tx=0x7f4fa801baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:36.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.449+0000 7f4fa6ffd640 1 -- 172.21.15.6:0/1207880131 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa80c0070 con 0x7f4fb80c8e10 2024-05-04T00:31:36.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.449+0000 7f4fa6ffd640 1 -- 172.21.15.6:0/1207880131 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa80ae550 con 0x7f4fb80c8e10 2024-05-04T00:31:36.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.449+0000 7f4fbc9aa640 1 -- 172.21.15.6:0/1207880131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb81e3360 con 0x7f4fb80c8e10 2024-05-04T00:31:36.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.449+0000 7f4fa6ffd640 1 -- 172.21.15.6:0/1207880131 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa80b5070 con 0x7f4fb80c8e10 2024-05-04T00:31:36.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.449+0000 7f4fbc9aa640 1 -- 172.21.15.6:0/1207880131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fb81f3910 con 0x7f4fb80c8e10 2024-05-04T00:31:36.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.449+0000 7f4fbc9aa640 1 -- 172.21.15.6:0/1207880131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fb8069a50 con 0x7f4fb80c8e10 2024-05-04T00:31:36.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.765+0000 7f4fa6ffd640 1 -- 172.21.15.6:0/1207880131 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4fa80c3070 con 0x7f4fb80c8e10 2024-05-04T00:31:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.769+0000 7f4fa6ffd640 1 --2- 172.21.15.6:0/1207880131 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f4f9806f480 0x7f4f98071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.769+0000 7f4fb659c640 1 --2- 172.21.15.6:0/1207880131 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f4f9806f480 0x7f4f98071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:36.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.769+0000 7f4fb659c640 1 --2- 172.21.15.6:0/1207880131 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f4f9806f480 0x7f4f98071990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0079c0 tx=0x7f4fac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:36.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.809+0000 7f4fa6ffd640 1 -- 172.21.15.6:0/1207880131 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f4fa80f5a00 con 0x7f4fb80c8e10 2024-05-04T00:31:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.813+0000 7f4fa6ffd640 1 -- 172.21.15.6:0/1207880131 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4fa80ca080 con 0x7f4fb80c8e10 2024-05-04T00:31:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:36.985+0000 7f4fbc9aa640 1 -- 172.21.15.6:0/1207880131 --> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4fb81e3880 con 0x7f4f9806f480 2024-05-04T00:31:37.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.009+0000 7f4fa6ffd640 1 -- 172.21.15.6:0/1207880131 <== mgr.4103 v2:172.21.15.163:6800/2152694980 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7f4fb81e3880 con 0x7f4f9806f480 2024-05-04T00:31:37.016 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:31:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-04T00:31:37.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.013+0000 7f4fbc9aa640 1 -- 172.21.15.6:0/1207880131 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f4f9806f480 msgr2=0x7f4f98071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:37.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.013+0000 7f4fbc9aa640 1 --2- 172.21.15.6:0/1207880131 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f4f9806f480 0x7f4f98071990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0079c0 tx=0x7f4fac008040 comp rx=0 tx=0).stop 2024-05-04T00:31:37.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.013+0000 7f4fbc9aa640 1 -- 172.21.15.6:0/1207880131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb80c8e10 msgr2=0x7f4fb81f4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:37.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.013+0000 7f4fbc9aa640 1 --2- 172.21.15.6:0/1207880131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb80c8e10 0x7f4fb81f4110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80b3040 tx=0x7f4fa801baf0 comp rx=0 tx=0).stop 2024-05-04T00:31:37.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.013+0000 7f4fbc9aa640 1 -- 172.21.15.6:0/1207880131 shutdown_connections 2024-05-04T00:31:37.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.013+0000 7f4fbc9aa640 1 --2- 172.21.15.6:0/1207880131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fb8142cd0 0x7f4fb813c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:37.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.013+0000 7f4fbc9aa640 1 --2- 172.21.15.6:0/1207880131 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f4f9806f480 0x7f4f98071990 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:37.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.013+0000 7f4fbc9aa640 1 --2- 172.21.15.6:0/1207880131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb80c8e10 0x7f4fb81f4110 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:37.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.013+0000 7f4fbc9aa640 1 --2- 172.21.15.6:0/1207880131 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4fb80c7b20 0x7f4fb813fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:37.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.013+0000 7f4fbc9aa640 1 -- 172.21.15.6:0/1207880131 >> 172.21.15.6:0/1207880131 conn(0x7f4fb80cb310 msgr2=0x7f4fb813e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:37.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.013+0000 7f4fbc9aa640 1 -- 172.21.15.6:0/1207880131 shutdown_connections 2024-05-04T00:31:37.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.013+0000 7f4fbc9aa640 1 -- 172.21.15.6:0/1207880131 wait complete. 2024-05-04T00:31:37.037 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-05-04T00:31:35.562487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594308,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":199,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219516,"kb_used_data":3380,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755204,"statfs":{"total":773094113280,"available":772869328896,"internally_reserved":0,"allocated":3461120,"data_stored":1985742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3746,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.004414"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334539+0000","last_change":"2024-05-04T00:31:21.410516+0000","last_active":"2024-05-04T00:31:26.334539+0000","last_peered":"2024-05-04T00:31:26.334539+0000","last_clean":"2024-05-04T00:31:26.334539+0000","last_became_active":"2024-05-04T00:31:21.409386+0000","last_became_peered":"2024-05-04T00:31:21.409386+0000","last_unstale":"2024-05-04T00:31:26.334539+0000","last_undegraded":"2024-05-04T00:31:26.334539+0000","last_fullsized":"2024-05-04T00:31:26.334539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:09:40.562107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336298+0000","last_change":"2024-05-04T00:31:21.397440+0000","last_active":"2024-05-04T00:31:26.336298+0000","last_peered":"2024-05-04T00:31:26.336298+0000","last_clean":"2024-05-04T00:31:26.336298+0000","last_became_active":"2024-05-04T00:31:21.396255+0000","last_became_peered":"2024-05-04T00:31:21.396255+0000","last_unstale":"2024-05-04T00:31:26.336298+0000","last_undegraded":"2024-05-04T00:31:26.336298+0000","last_fullsized":"2024-05-04T00:31:26.336298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:07.460897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336101+0000","last_change":"2024-05-04T00:31:21.442932+0000","last_active":"2024-05-04T00:31:26.336101+0000","last_peered":"2024-05-04T00:31:26.336101+0000","last_clean":"2024-05-04T00:31:26.336101+0000","last_became_active":"2024-05-04T00:31:21.442507+0000","last_became_peered":"2024-05-04T00:31:21.442507+0000","last_unstale":"2024-05-04T00:31:26.336101+0000","last_undegraded":"2024-05-04T00:31:26.336101+0000","last_fullsized":"2024-05-04T00:31:26.336101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:52:48.345813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333683+0000","last_change":"2024-05-04T00:31:21.442087+0000","last_active":"2024-05-04T00:31:26.333683+0000","last_peered":"2024-05-04T00:31:26.333683+0000","last_clean":"2024-05-04T00:31:26.333683+0000","last_became_active":"2024-05-04T00:31:21.440935+0000","last_became_peered":"2024-05-04T00:31:21.440935+0000","last_unstale":"2024-05-04T00:31:26.333683+0000","last_undegraded":"2024-05-04T00:31:26.333683+0000","last_fullsized":"2024-05-04T00:31:26.333683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:02:02.166274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334582+0000","last_change":"2024-05-04T00:31:21.408892+0000","last_active":"2024-05-04T00:31:26.334582+0000","last_peered":"2024-05-04T00:31:26.334582+0000","last_clean":"2024-05-04T00:31:26.334582+0000","last_became_active":"2024-05-04T00:31:21.402554+0000","last_became_peered":"2024-05-04T00:31:21.402554+0000","last_unstale":"2024-05-04T00:31:26.334582+0000","last_undegraded":"2024-05-04T00:31:26.334582+0000","last_fullsized":"2024-05-04T00:31:26.334582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:07.135906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333117+0000","last_change":"2024-05-04T00:31:21.442773+0000","last_active":"2024-05-04T00:31:26.333117+0000","last_peered":"2024-05-04T00:31:26.333117+0000","last_clean":"2024-05-04T00:31:26.333117+0000","last_became_active":"2024-05-04T00:31:21.441082+0000","last_became_peered":"2024-05-04T00:31:21.441082+0000","last_unstale":"2024-05-04T00:31:26.333117+0000","last_undegraded":"2024-05-04T00:31:26.333117+0000","last_fullsized":"2024-05-04T00:31:26.333117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:54.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333801+0000","last_change":"2024-05-04T00:31:21.441617+0000","last_active":"2024-05-04T00:31:26.333801+0000","last_peered":"2024-05-04T00:31:26.333801+0000","last_clean":"2024-05-04T00:31:26.333801+0000","last_became_active":"2024-05-04T00:31:21.440766+0000","last_became_peered":"2024-05-04T00:31:21.440766+0000","last_unstale":"2024-05-04T00:31:26.333801+0000","last_undegraded":"2024-05-04T00:31:26.333801+0000","last_fullsized":"2024-05-04T00:31:26.333801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:28:07.779536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335122+0000","last_change":"2024-05-04T00:31:21.408515+0000","last_active":"2024-05-04T00:31:26.335122+0000","last_peered":"2024-05-04T00:31:26.335122+0000","last_clean":"2024-05-04T00:31:26.335122+0000","last_became_active":"2024-05-04T00:31:21.407785+0000","last_became_peered":"2024-05-04T00:31:21.407785+0000","last_unstale":"2024-05-04T00:31:26.335122+0000","last_undegraded":"2024-05-04T00:31:26.335122+0000","last_fullsized":"2024-05-04T00:31:26.335122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:42.617159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333247+0000","last_change":"2024-05-04T00:31:21.400836+0000","last_active":"2024-05-04T00:31:26.333247+0000","last_peered":"2024-05-04T00:31:26.333247+0000","last_clean":"2024-05-04T00:31:26.333247+0000","last_became_active":"2024-05-04T00:31:21.400001+0000","last_became_peered":"2024-05-04T00:31:21.400001+0000","last_unstale":"2024-05-04T00:31:26.333247+0000","last_undegraded":"2024-05-04T00:31:26.333247+0000","last_fullsized":"2024-05-04T00:31:26.333247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:56.687510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334788+0000","last_change":"2024-05-04T00:31:21.391806+0000","last_active":"2024-05-04T00:31:26.334788+0000","last_peered":"2024-05-04T00:31:26.334788+0000","last_clean":"2024-05-04T00:31:26.334788+0000","last_became_active":"2024-05-04T00:31:21.389347+0000","last_became_peered":"2024-05-04T00:31:21.389347+0000","last_unstale":"2024-05-04T00:31:26.334788+0000","last_undegraded":"2024-05-04T00:31:26.334788+0000","last_fullsized":"2024-05-04T00:31:26.334788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:40:12.379274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334569+0000","last_change":"2024-05-04T00:31:21.396045+0000","last_active":"2024-05-04T00:31:26.334569+0000","last_peered":"2024-05-04T00:31:26.334569+0000","last_clean":"2024-05-04T00:31:26.334569+0000","last_became_active":"2024-05-04T00:31:21.385949+0000","last_became_peered":"2024-05-04T00:31:21.385949+0000","last_unstale":"2024-05-04T00:31:26.334569+0000","last_undegraded":"2024-05-04T00:31:26.334569+0000","last_fullsized":"2024-05-04T00:31:26.334569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:33.187636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334211+0000","last_change":"2024-05-04T00:31:21.407987+0000","last_active":"2024-05-04T00:31:26.334211+0000","last_peered":"2024-05-04T00:31:26.334211+0000","last_clean":"2024-05-04T00:31:26.334211+0000","last_became_active":"2024-05-04T00:31:21.404557+0000","last_became_peered":"2024-05-04T00:31:21.404557+0000","last_unstale":"2024-05-04T00:31:26.334211+0000","last_undegraded":"2024-05-04T00:31:26.334211+0000","last_fullsized":"2024-05-04T00:31:26.334211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:00:51.313452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049847+0000","last_change":"2024-05-04T00:31:21.389251+0000","last_active":"2024-05-04T00:31:26.049847+0000","last_peered":"2024-05-04T00:31:26.049847+0000","last_clean":"2024-05-04T00:31:26.049847+0000","last_became_active":"2024-05-04T00:31:21.387958+0000","last_became_peered":"2024-05-04T00:31:21.387958+0000","last_unstale":"2024-05-04T00:31:26.049847+0000","last_undegraded":"2024-05-04T00:31:26.049847+0000","last_fullsized":"2024-05-04T00:31:26.049847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:31.926158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049567+0000","last_change":"2024-05-04T00:31:21.402284+0000","last_active":"2024-05-04T00:31:26.049567+0000","last_peered":"2024-05-04T00:31:26.049567+0000","last_clean":"2024-05-04T00:31:26.049567+0000","last_became_active":"2024-05-04T00:31:21.401495+0000","last_became_peered":"2024-05-04T00:31:21.401495+0000","last_unstale":"2024-05-04T00:31:26.049567+0000","last_undegraded":"2024-05-04T00:31:26.049567+0000","last_fullsized":"2024-05-04T00:31:26.049567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:09.622538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335160+0000","last_change":"2024-05-04T00:31:21.410958+0000","last_active":"2024-05-04T00:31:26.335160+0000","last_peered":"2024-05-04T00:31:26.335160+0000","last_clean":"2024-05-04T00:31:26.335160+0000","last_became_active":"2024-05-04T00:31:21.410489+0000","last_became_peered":"2024-05-04T00:31:21.410489+0000","last_unstale":"2024-05-04T00:31:26.335160+0000","last_undegraded":"2024-05-04T00:31:26.335160+0000","last_fullsized":"2024-05-04T00:31:26.335160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:05:47.448392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977378+0000","last_change":"2024-05-04T00:31:21.187055+0000","last_active":"2024-05-04T00:31:25.977378+0000","last_peered":"2024-05-04T00:31:25.977378+0000","last_clean":"2024-05-04T00:31:25.977378+0000","last_became_active":"2024-05-04T00:31:21.186141+0000","last_became_peered":"2024-05-04T00:31:21.186141+0000","last_unstale":"2024-05-04T00:31:25.977378+0000","last_undegraded":"2024-05-04T00:31:25.977378+0000","last_fullsized":"2024-05-04T00:31:25.977378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:53:13.451818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978989+0000","last_change":"2024-05-04T00:31:21.406402+0000","last_active":"2024-05-04T00:31:25.978989+0000","last_peered":"2024-05-04T00:31:25.978989+0000","last_clean":"2024-05-04T00:31:25.978989+0000","last_became_active":"2024-05-04T00:31:21.389108+0000","last_became_peered":"2024-05-04T00:31:21.389108+0000","last_unstale":"2024-05-04T00:31:25.978989+0000","last_undegraded":"2024-05-04T00:31:25.978989+0000","last_fullsized":"2024-05-04T00:31:25.978989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:11:03.598993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334910+0000","last_change":"2024-05-04T00:31:21.418601+0000","last_active":"2024-05-04T00:31:26.334910+0000","last_peered":"2024-05-04T00:31:26.334910+0000","last_clean":"2024-05-04T00:31:26.334910+0000","last_became_active":"2024-05-04T00:31:21.417914+0000","last_became_peered":"2024-05-04T00:31:21.417914+0000","last_unstale":"2024-05-04T00:31:26.334910+0000","last_undegraded":"2024-05-04T00:31:26.334910+0000","last_fullsized":"2024-05-04T00:31:26.334910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:23:35.270037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978633+0000","last_change":"2024-05-04T00:31:21.441868+0000","last_active":"2024-05-04T00:31:25.978633+0000","last_peered":"2024-05-04T00:31:25.978633+0000","last_clean":"2024-05-04T00:31:25.978633+0000","last_became_active":"2024-05-04T00:31:21.440945+0000","last_became_peered":"2024-05-04T00:31:21.440945+0000","last_unstale":"2024-05-04T00:31:25.978633+0000","last_undegraded":"2024-05-04T00:31:25.978633+0000","last_fullsized":"2024-05-04T00:31:25.978633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:47:43.629512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334519+0000","last_change":"2024-05-04T00:31:21.395356+0000","last_active":"2024-05-04T00:31:26.334519+0000","last_peered":"2024-05-04T00:31:26.334519+0000","last_clean":"2024-05-04T00:31:26.334519+0000","last_became_active":"2024-05-04T00:31:21.394461+0000","last_became_peered":"2024-05-04T00:31:21.394461+0000","last_unstale":"2024-05-04T00:31:26.334519+0000","last_undegraded":"2024-05-04T00:31:26.334519+0000","last_fullsized":"2024-05-04T00:31:26.334519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:42:31.303120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088316+0000","last_change":"2024-05-04T00:31:21.446878+0000","last_active":"2024-05-04T00:31:26.088316+0000","last_peered":"2024-05-04T00:31:26.088316+0000","last_clean":"2024-05-04T00:31:26.088316+0000","last_became_active":"2024-05-04T00:31:21.446250+0000","last_became_peered":"2024-05-04T00:31:21.446250+0000","last_unstale":"2024-05-04T00:31:26.088316+0000","last_undegraded":"2024-05-04T00:31:26.088316+0000","last_fullsized":"2024-05-04T00:31:26.088316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:42.617159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333229+0000","last_change":"2024-05-04T00:31:21.414182+0000","last_active":"2024-05-04T00:31:26.333229+0000","last_peered":"2024-05-04T00:31:26.333229+0000","last_clean":"2024-05-04T00:31:26.333229+0000","last_became_active":"2024-05-04T00:31:21.413073+0000","last_became_peered":"2024-05-04T00:31:21.413073+0000","last_unstale":"2024-05-04T00:31:26.333229+0000","last_undegraded":"2024-05-04T00:31:26.333229+0000","last_fullsized":"2024-05-04T00:31:26.333229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:23.471892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335510+0000","last_change":"2024-05-04T00:31:21.403827+0000","last_active":"2024-05-04T00:31:26.335510+0000","last_peered":"2024-05-04T00:31:26.335510+0000","last_clean":"2024-05-04T00:31:26.335510+0000","last_became_active":"2024-05-04T00:31:21.402985+0000","last_became_peered":"2024-05-04T00:31:21.402985+0000","last_unstale":"2024-05-04T00:31:26.335510+0000","last_undegraded":"2024-05-04T00:31:26.335510+0000","last_fullsized":"2024-05-04T00:31:26.335510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:43:15.203235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977429+0000","last_change":"2024-05-04T00:31:21.393270+0000","last_active":"2024-05-04T00:31:25.977429+0000","last_peered":"2024-05-04T00:31:25.977429+0000","last_clean":"2024-05-04T00:31:25.977429+0000","last_became_active":"2024-05-04T00:31:21.392368+0000","last_became_peered":"2024-05-04T00:31:21.392368+0000","last_unstale":"2024-05-04T00:31:25.977429+0000","last_undegraded":"2024-05-04T00:31:25.977429+0000","last_fullsized":"2024-05-04T00:31:25.977429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:49:22.354637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336437+0000","last_change":"2024-05-04T00:31:21.416800+0000","last_active":"2024-05-04T00:31:26.336437+0000","last_peered":"2024-05-04T00:31:26.336437+0000","last_clean":"2024-05-04T00:31:26.336437+0000","last_became_active":"2024-05-04T00:31:21.415540+0000","last_became_peered":"2024-05-04T00:31:21.415540+0000","last_unstale":"2024-05-04T00:31:26.336437+0000","last_undegraded":"2024-05-04T00:31:26.336437+0000","last_fullsized":"2024-05-04T00:31:26.336437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:00:51.313452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335047+0000","last_change":"2024-05-04T00:31:21.188504+0000","last_active":"2024-05-04T00:31:26.335047+0000","last_peered":"2024-05-04T00:31:26.335047+0000","last_clean":"2024-05-04T00:31:26.335047+0000","last_became_active":"2024-05-04T00:31:21.187877+0000","last_became_peered":"2024-05-04T00:31:21.187877+0000","last_unstale":"2024-05-04T00:31:26.335047+0000","last_undegraded":"2024-05-04T00:31:26.335047+0000","last_fullsized":"2024-05-04T00:31:26.335047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:48:39.671984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.050292+0000","last_change":"2024-05-04T00:31:21.393500+0000","last_active":"2024-05-04T00:31:26.050292+0000","last_peered":"2024-05-04T00:31:26.050292+0000","last_clean":"2024-05-04T00:31:26.050292+0000","last_became_active":"2024-05-04T00:31:21.392579+0000","last_became_peered":"2024-05-04T00:31:21.392579+0000","last_unstale":"2024-05-04T00:31:26.050292+0000","last_undegraded":"2024-05-04T00:31:26.050292+0000","last_fullsized":"2024-05-04T00:31:26.050292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:16.804136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049793+0000","last_change":"2024-05-04T00:31:21.395778+0000","last_active":"2024-05-04T00:31:26.049793+0000","last_peered":"2024-05-04T00:31:26.049793+0000","last_clean":"2024-05-04T00:31:26.049793+0000","last_became_active":"2024-05-04T00:31:21.394966+0000","last_became_peered":"2024-05-04T00:31:21.394966+0000","last_unstale":"2024-05-04T00:31:26.049793+0000","last_undegraded":"2024-05-04T00:31:26.049793+0000","last_fullsized":"2024-05-04T00:31:26.049793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:53:28.166224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335626+0000","last_change":"2024-05-04T00:31:21.405250+0000","last_active":"2024-05-04T00:31:26.335626+0000","last_peered":"2024-05-04T00:31:26.335626+0000","last_clean":"2024-05-04T00:31:26.335626+0000","last_became_active":"2024-05-04T00:31:21.403779+0000","last_became_peered":"2024-05-04T00:31:21.403779+0000","last_unstale":"2024-05-04T00:31:26.335626+0000","last_undegraded":"2024-05-04T00:31:26.335626+0000","last_fullsized":"2024-05-04T00:31:26.335626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:33.187636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977754+0000","last_change":"2024-05-04T00:31:21.399896+0000","last_active":"2024-05-04T00:31:25.977754+0000","last_peered":"2024-05-04T00:31:25.977754+0000","last_clean":"2024-05-04T00:31:25.977754+0000","last_became_active":"2024-05-04T00:31:21.398994+0000","last_became_peered":"2024-05-04T00:31:21.398994+0000","last_unstale":"2024-05-04T00:31:25.977754+0000","last_undegraded":"2024-05-04T00:31:25.977754+0000","last_fullsized":"2024-05-04T00:31:25.977754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:32:42.591423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334354+0000","last_change":"2024-05-04T00:31:21.416130+0000","last_active":"2024-05-04T00:31:26.334354+0000","last_peered":"2024-05-04T00:31:26.334354+0000","last_clean":"2024-05-04T00:31:26.334354+0000","last_became_active":"2024-05-04T00:31:21.415395+0000","last_became_peered":"2024-05-04T00:31:21.415395+0000","last_unstale":"2024-05-04T00:31:26.334354+0000","last_undegraded":"2024-05-04T00:31:26.334354+0000","last_fullsized":"2024-05-04T00:31:26.334354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:33:22.819977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.332079+0000","last_change":"2024-05-04T00:31:21.342105+0000","last_active":"2024-05-04T00:31:26.332079+0000","last_peered":"2024-05-04T00:31:26.332079+0000","last_clean":"2024-05-04T00:31:26.332079+0000","last_became_active":"2024-05-04T00:31:21.341333+0000","last_became_peered":"2024-05-04T00:31:21.341333+0000","last_unstale":"2024-05-04T00:31:26.332079+0000","last_undegraded":"2024-05-04T00:31:26.332079+0000","last_fullsized":"2024-05-04T00:31:26.332079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:23.471892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333474+0000","last_change":"2024-05-04T00:31:21.405647+0000","last_active":"2024-05-04T00:31:26.333474+0000","last_peered":"2024-05-04T00:31:26.333474+0000","last_clean":"2024-05-04T00:31:26.333474+0000","last_became_active":"2024-05-04T00:31:21.403998+0000","last_became_peered":"2024-05-04T00:31:21.403998+0000","last_unstale":"2024-05-04T00:31:26.333474+0000","last_undegraded":"2024-05-04T00:31:26.333474+0000","last_fullsized":"2024-05-04T00:31:26.333474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:54.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.681469+0000","last_change":"2024-05-04T00:31:19.185018+0000","last_active":"2024-05-04T00:31:31.681469+0000","last_peered":"2024-05-04T00:31:31.681469+0000","last_clean":"2024-05-04T00:31:31.681469+0000","last_became_active":"2024-05-04T00:31:19.181107+0000","last_became_peered":"2024-05-04T00:31:19.181107+0000","last_unstale":"2024-05-04T00:31:31.681469+0000","last_undegraded":"2024-05-04T00:31:31.681469+0000","last_fullsized":"2024-05-04T00:31:31.681469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:14.453153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088596+0000","last_change":"2024-05-04T00:31:21.446209+0000","last_active":"2024-05-04T00:31:26.088596+0000","last_peered":"2024-05-04T00:31:26.088596+0000","last_clean":"2024-05-04T00:31:26.088596+0000","last_became_active":"2024-05-04T00:31:21.445793+0000","last_became_peered":"2024-05-04T00:31:21.445793+0000","last_unstale":"2024-05-04T00:31:26.088596+0000","last_undegraded":"2024-05-04T00:31:26.088596+0000","last_fullsized":"2024-05-04T00:31:26.088596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:54:48.084884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.417524+0000","last_change":"2024-05-04T00:31:19.185102+0000","last_active":"2024-05-04T00:31:35.417524+0000","last_peered":"2024-05-04T00:31:35.417524+0000","last_clean":"2024-05-04T00:31:35.417524+0000","last_became_active":"2024-05-04T00:31:19.183394+0000","last_became_peered":"2024-05-04T00:31:19.183394+0000","last_unstale":"2024-05-04T00:31:35.417524+0000","last_undegraded":"2024-05-04T00:31:35.417524+0000","last_fullsized":"2024-05-04T00:31:35.417524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:36:38.420366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049527+0000","last_change":"2024-05-04T00:31:19.158945+0000","last_active":"2024-05-04T00:31:26.049527+0000","last_peered":"2024-05-04T00:31:26.049527+0000","last_clean":"2024-05-04T00:31:26.049527+0000","last_became_active":"2024-05-04T00:31:19.158152+0000","last_became_peered":"2024-05-04T00:31:19.158152+0000","last_unstale":"2024-05-04T00:31:26.049527+0000","last_undegraded":"2024-05-04T00:31:26.049527+0000","last_fullsized":"2024-05-04T00:31:26.049527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:52.040804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335758+0000","last_change":"2024-05-04T00:31:21.397183+0000","last_active":"2024-05-04T00:31:26.335758+0000","last_peered":"2024-05-04T00:31:26.335758+0000","last_clean":"2024-05-04T00:31:26.335758+0000","last_became_active":"2024-05-04T00:31:21.393014+0000","last_became_peered":"2024-05-04T00:31:21.393014+0000","last_unstale":"2024-05-04T00:31:26.335758+0000","last_undegraded":"2024-05-04T00:31:26.335758+0000","last_fullsized":"2024-05-04T00:31:26.335758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:40:12.379274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977589+0000","last_change":"2024-05-04T00:31:19.186007+0000","last_active":"2024-05-04T00:31:25.977589+0000","last_peered":"2024-05-04T00:31:25.977589+0000","last_clean":"2024-05-04T00:31:25.977589+0000","last_became_active":"2024-05-04T00:31:19.184526+0000","last_became_peered":"2024-05-04T00:31:19.184526+0000","last_unstale":"2024-05-04T00:31:25.977589+0000","last_undegraded":"2024-05-04T00:31:25.977589+0000","last_fullsized":"2024-05-04T00:31:25.977589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:01:33.042606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088155+0000","last_change":"2024-05-04T00:31:21.447258+0000","last_active":"2024-05-04T00:31:26.088155+0000","last_peered":"2024-05-04T00:31:26.088155+0000","last_clean":"2024-05-04T00:31:26.088155+0000","last_became_active":"2024-05-04T00:31:21.446842+0000","last_became_peered":"2024-05-04T00:31:21.446842+0000","last_unstale":"2024-05-04T00:31:26.088155+0000","last_undegraded":"2024-05-04T00:31:26.088155+0000","last_fullsized":"2024-05-04T00:31:26.088155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:10:57.675700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.719730+0000","last_change":"2024-05-04T00:31:19.190422+0000","last_active":"2024-05-04T00:31:31.719730+0000","last_peered":"2024-05-04T00:31:31.719730+0000","last_clean":"2024-05-04T00:31:31.719730+0000","last_became_active":"2024-05-04T00:31:19.189517+0000","last_became_peered":"2024-05-04T00:31:19.189517+0000","last_unstale":"2024-05-04T00:31:31.719730+0000","last_undegraded":"2024-05-04T00:31:31.719730+0000","last_fullsized":"2024-05-04T00:31:31.719730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:16:41.367677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334482+0000","last_change":"2024-05-04T00:31:21.184586+0000","last_active":"2024-05-04T00:31:26.334482+0000","last_peered":"2024-05-04T00:31:26.334482+0000","last_clean":"2024-05-04T00:31:26.334482+0000","last_became_active":"2024-05-04T00:31:21.183698+0000","last_became_peered":"2024-05-04T00:31:21.183698+0000","last_unstale":"2024-05-04T00:31:26.334482+0000","last_undegraded":"2024-05-04T00:31:26.334482+0000","last_fullsized":"2024-05-04T00:31:26.334482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:47:25.699731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.679301+0000","last_change":"2024-05-04T00:31:19.186623+0000","last_active":"2024-05-04T00:31:31.679301+0000","last_peered":"2024-05-04T00:31:31.679301+0000","last_clean":"2024-05-04T00:31:31.679301+0000","last_became_active":"2024-05-04T00:31:19.185633+0000","last_became_peered":"2024-05-04T00:31:19.185633+0000","last_unstale":"2024-05-04T00:31:31.679301+0000","last_undegraded":"2024-05-04T00:31:31.679301+0000","last_fullsized":"2024-05-04T00:31:31.679301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:10:55.324717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336711+0000","last_change":"2024-05-04T00:31:21.410329+0000","last_active":"2024-05-04T00:31:26.336711+0000","last_peered":"2024-05-04T00:31:26.336711+0000","last_clean":"2024-05-04T00:31:26.336711+0000","last_became_active":"2024-05-04T00:31:21.409655+0000","last_became_peered":"2024-05-04T00:31:21.409655+0000","last_unstale":"2024-05-04T00:31:26.336711+0000","last_undegraded":"2024-05-04T00:31:26.336711+0000","last_fullsized":"2024-05-04T00:31:26.336711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:09:40.562107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334997+0000","last_change":"2024-05-04T00:31:19.178130+0000","last_active":"2024-05-04T00:31:26.334997+0000","last_peered":"2024-05-04T00:31:26.334997+0000","last_clean":"2024-05-04T00:31:26.334997+0000","last_became_active":"2024-05-04T00:31:19.177283+0000","last_became_peered":"2024-05-04T00:31:19.177283+0000","last_unstale":"2024-05-04T00:31:26.334997+0000","last_undegraded":"2024-05-04T00:31:26.334997+0000","last_fullsized":"2024-05-04T00:31:26.334997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:42:41.790988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978336+0000","last_change":"2024-05-04T00:31:21.187102+0000","last_active":"2024-05-04T00:31:25.978336+0000","last_peered":"2024-05-04T00:31:25.978336+0000","last_clean":"2024-05-04T00:31:25.978336+0000","last_became_active":"2024-05-04T00:31:21.186167+0000","last_became_peered":"2024-05-04T00:31:21.186167+0000","last_unstale":"2024-05-04T00:31:25.978336+0000","last_undegraded":"2024-05-04T00:31:25.978336+0000","last_fullsized":"2024-05-04T00:31:25.978336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:05:04.013367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"26'8","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.701064+0000","last_change":"2024-05-04T00:31:19.251247+0000","last_active":"2024-05-04T00:31:31.701064+0000","last_peered":"2024-05-04T00:31:31.701064+0000","last_clean":"2024-05-04T00:31:31.701064+0000","last_became_active":"2024-05-04T00:31:19.250003+0000","last_became_peered":"2024-05-04T00:31:19.250003+0000","last_unstale":"2024-05-04T00:31:31.701064+0000","last_undegraded":"2024-05-04T00:31:31.701064+0000","last_fullsized":"2024-05-04T00:31:31.701064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:40:06.774090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334818+0000","last_change":"2024-05-04T00:31:21.401432+0000","last_active":"2024-05-04T00:31:26.334818+0000","last_peered":"2024-05-04T00:31:26.334818+0000","last_clean":"2024-05-04T00:31:26.334818+0000","last_became_active":"2024-05-04T00:31:21.397220+0000","last_became_peered":"2024-05-04T00:31:21.397220+0000","last_unstale":"2024-05-04T00:31:26.334818+0000","last_undegraded":"2024-05-04T00:31:26.334818+0000","last_fullsized":"2024-05-04T00:31:26.334818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:07.460897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.308011+0000","last_change":"2024-05-04T00:31:19.183674+0000","last_active":"2024-05-04T00:31:35.308011+0000","last_peered":"2024-05-04T00:31:35.308011+0000","last_clean":"2024-05-04T00:31:35.308011+0000","last_became_active":"2024-05-04T00:31:19.183331+0000","last_became_peered":"2024-05-04T00:31:19.183331+0000","last_unstale":"2024-05-04T00:31:35.308011+0000","last_undegraded":"2024-05-04T00:31:35.308011+0000","last_fullsized":"2024-05-04T00:31:35.308011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:13:52.447627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049560+0000","last_change":"2024-05-04T00:31:21.342578+0000","last_active":"2024-05-04T00:31:26.049560+0000","last_peered":"2024-05-04T00:31:26.049560+0000","last_clean":"2024-05-04T00:31:26.049560+0000","last_became_active":"2024-05-04T00:31:21.342064+0000","last_became_peered":"2024-05-04T00:31:21.342064+0000","last_unstale":"2024-05-04T00:31:26.049560+0000","last_undegraded":"2024-05-04T00:31:26.049560+0000","last_fullsized":"2024-05-04T00:31:26.049560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:35.377002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.655969+0000","last_change":"2024-05-04T00:31:19.184166+0000","last_active":"2024-05-04T00:31:31.655969+0000","last_peered":"2024-05-04T00:31:31.655969+0000","last_clean":"2024-05-04T00:31:31.655969+0000","last_became_active":"2024-05-04T00:31:19.181304+0000","last_became_peered":"2024-05-04T00:31:19.181304+0000","last_unstale":"2024-05-04T00:31:31.655969+0000","last_undegraded":"2024-05-04T00:31:31.655969+0000","last_fullsized":"2024-05-04T00:31:31.655969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:49:04.376111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978217+0000","last_change":"2024-05-04T00:31:21.390252+0000","last_active":"2024-05-04T00:31:25.978217+0000","last_peered":"2024-05-04T00:31:25.978217+0000","last_clean":"2024-05-04T00:31:25.978217+0000","last_became_active":"2024-05-04T00:31:21.389360+0000","last_became_peered":"2024-05-04T00:31:21.389360+0000","last_unstale":"2024-05-04T00:31:25.978217+0000","last_undegraded":"2024-05-04T00:31:25.978217+0000","last_fullsized":"2024-05-04T00:31:25.978217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:45:23.177550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333936+0000","last_change":"2024-05-04T00:31:19.176756+0000","last_active":"2024-05-04T00:31:26.333936+0000","last_peered":"2024-05-04T00:31:26.333936+0000","last_clean":"2024-05-04T00:31:26.333936+0000","last_became_active":"2024-05-04T00:31:19.175779+0000","last_became_peered":"2024-05-04T00:31:19.175779+0000","last_unstale":"2024-05-04T00:31:26.333936+0000","last_undegraded":"2024-05-04T00:31:26.333936+0000","last_fullsized":"2024-05-04T00:31:26.333936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:14.453153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.332161+0000","last_change":"2024-05-04T00:31:21.397306+0000","last_active":"2024-05-04T00:31:26.332161+0000","last_peered":"2024-05-04T00:31:26.332161+0000","last_clean":"2024-05-04T00:31:26.332161+0000","last_became_active":"2024-05-04T00:31:21.394863+0000","last_became_peered":"2024-05-04T00:31:21.394863+0000","last_unstale":"2024-05-04T00:31:26.332161+0000","last_undegraded":"2024-05-04T00:31:26.332161+0000","last_fullsized":"2024-05-04T00:31:26.332161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:46:38.463068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"26'10","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.489703+0000","last_change":"2024-05-04T00:31:19.177402+0000","last_active":"2024-05-04T00:31:31.489703+0000","last_peered":"2024-05-04T00:31:31.489703+0000","last_clean":"2024-05-04T00:31:31.489703+0000","last_became_active":"2024-05-04T00:31:19.176805+0000","last_became_peered":"2024-05-04T00:31:19.176805+0000","last_unstale":"2024-05-04T00:31:31.489703+0000","last_undegraded":"2024-05-04T00:31:31.489703+0000","last_fullsized":"2024-05-04T00:31:31.489703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:31.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977565+0000","last_change":"2024-05-04T00:31:21.188457+0000","last_active":"2024-05-04T00:31:25.977565+0000","last_peered":"2024-05-04T00:31:25.977565+0000","last_clean":"2024-05-04T00:31:25.977565+0000","last_became_active":"2024-05-04T00:31:21.187554+0000","last_became_peered":"2024-05-04T00:31:21.187554+0000","last_unstale":"2024-05-04T00:31:25.977565+0000","last_undegraded":"2024-05-04T00:31:25.977565+0000","last_fullsized":"2024-05-04T00:31:25.977565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:31:55.671261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335265+0000","last_change":"2024-05-04T00:31:19.176641+0000","last_active":"2024-05-04T00:31:26.335265+0000","last_peered":"2024-05-04T00:31:26.335265+0000","last_clean":"2024-05-04T00:31:26.335265+0000","last_became_active":"2024-05-04T00:31:19.175715+0000","last_became_peered":"2024-05-04T00:31:19.175715+0000","last_unstale":"2024-05-04T00:31:26.335265+0000","last_undegraded":"2024-05-04T00:31:26.335265+0000","last_fullsized":"2024-05-04T00:31:26.335265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:05:45.097410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334791+0000","last_change":"2024-05-04T00:31:21.407554+0000","last_active":"2024-05-04T00:31:26.334791+0000","last_peered":"2024-05-04T00:31:26.334791+0000","last_clean":"2024-05-04T00:31:26.334791+0000","last_became_active":"2024-05-04T00:31:21.403004+0000","last_became_peered":"2024-05-04T00:31:21.403004+0000","last_unstale":"2024-05-04T00:31:26.334791+0000","last_undegraded":"2024-05-04T00:31:26.334791+0000","last_fullsized":"2024-05-04T00:31:26.334791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:33.938895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088847+0000","last_change":"2024-05-04T00:31:19.187116+0000","last_active":"2024-05-04T00:31:26.088847+0000","last_peered":"2024-05-04T00:31:26.088847+0000","last_clean":"2024-05-04T00:31:26.088847+0000","last_became_active":"2024-05-04T00:31:19.186540+0000","last_became_peered":"2024-05-04T00:31:19.186540+0000","last_unstale":"2024-05-04T00:31:26.088847+0000","last_undegraded":"2024-05-04T00:31:26.088847+0000","last_fullsized":"2024-05-04T00:31:26.088847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:08.420067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334905+0000","last_change":"2024-05-04T00:31:21.407986+0000","last_active":"2024-05-04T00:31:26.334905+0000","last_peered":"2024-05-04T00:31:26.334905+0000","last_clean":"2024-05-04T00:31:26.334905+0000","last_became_active":"2024-05-04T00:31:21.404350+0000","last_became_peered":"2024-05-04T00:31:21.404350+0000","last_unstale":"2024-05-04T00:31:26.334905+0000","last_undegraded":"2024-05-04T00:31:26.334905+0000","last_fullsized":"2024-05-04T00:31:26.334905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:12:34.898595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336199+0000","last_change":"2024-05-04T00:31:19.190045+0000","last_active":"2024-05-04T00:31:26.336199+0000","last_peered":"2024-05-04T00:31:26.336199+0000","last_clean":"2024-05-04T00:31:26.336199+0000","last_became_active":"2024-05-04T00:31:19.189166+0000","last_became_peered":"2024-05-04T00:31:19.189166+0000","last_unstale":"2024-05-04T00:31:26.336199+0000","last_undegraded":"2024-05-04T00:31:26.336199+0000","last_fullsized":"2024-05-04T00:31:26.336199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:31.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334803+0000","last_change":"2024-05-04T00:31:21.402171+0000","last_active":"2024-05-04T00:31:26.334803+0000","last_peered":"2024-05-04T00:31:26.334803+0000","last_clean":"2024-05-04T00:31:26.334803+0000","last_became_active":"2024-05-04T00:31:21.401467+0000","last_became_peered":"2024-05-04T00:31:21.401467+0000","last_unstale":"2024-05-04T00:31:26.334803+0000","last_undegraded":"2024-05-04T00:31:26.334803+0000","last_fullsized":"2024-05-04T00:31:26.334803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:34:25.722557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.050396+0000","last_change":"2024-05-04T00:31:19.155210+0000","last_active":"2024-05-04T00:31:26.050396+0000","last_peered":"2024-05-04T00:31:26.050396+0000","last_clean":"2024-05-04T00:31:26.050396+0000","last_became_active":"2024-05-04T00:31:19.154504+0000","last_became_peered":"2024-05-04T00:31:19.154504+0000","last_unstale":"2024-05-04T00:31:26.050396+0000","last_undegraded":"2024-05-04T00:31:26.050396+0000","last_fullsized":"2024-05-04T00:31:26.050396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:47:23.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978511+0000","last_change":"2024-05-04T00:31:21.406273+0000","last_active":"2024-05-04T00:31:25.978511+0000","last_peered":"2024-05-04T00:31:25.978511+0000","last_clean":"2024-05-04T00:31:25.978511+0000","last_became_active":"2024-05-04T00:31:21.405283+0000","last_became_peered":"2024-05-04T00:31:21.405283+0000","last_unstale":"2024-05-04T00:31:25.978511+0000","last_undegraded":"2024-05-04T00:31:25.978511+0000","last_fullsized":"2024-05-04T00:31:25.978511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:20:31.795673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":117,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.332489+0000","last_change":"2024-05-04T00:30:40.841283+0000","last_active":"2024-05-04T00:31:26.332489+0000","last_peered":"2024-05-04T00:31:26.332489+0000","last_clean":"2024-05-04T00:31:26.332489+0000","last_became_active":"2024-05-04T00:30:40.838353+0000","last_became_peered":"2024-05-04T00:30:40.838353+0000","last_unstale":"2024-05-04T00:31:26.332489+0000","last_undegraded":"2024-05-04T00:31:26.332489+0000","last_fullsized":"2024-05-04T00:31:26.332489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:30:37.159356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:30:37.159356+0000","last_clean_scrub_stamp":"2024-05-04T00:30:37.159356+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:30:10.374994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.656668+0000","last_change":"2024-05-04T00:31:19.248691+0000","last_active":"2024-05-04T00:31:31.656668+0000","last_peered":"2024-05-04T00:31:31.656668+0000","last_clean":"2024-05-04T00:31:31.656668+0000","last_became_active":"2024-05-04T00:31:19.247815+0000","last_became_peered":"2024-05-04T00:31:19.247815+0000","last_unstale":"2024-05-04T00:31:31.656668+0000","last_undegraded":"2024-05-04T00:31:31.656668+0000","last_fullsized":"2024-05-04T00:31:31.656668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:46:05.720208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088363+0000","last_change":"2024-05-04T00:31:21.446500+0000","last_active":"2024-05-04T00:31:26.088363+0000","last_peered":"2024-05-04T00:31:26.088363+0000","last_clean":"2024-05-04T00:31:26.088363+0000","last_became_active":"2024-05-04T00:31:21.446100+0000","last_became_peered":"2024-05-04T00:31:21.446100+0000","last_unstale":"2024-05-04T00:31:26.088363+0000","last_undegraded":"2024-05-04T00:31:26.088363+0000","last_fullsized":"2024-05-04T00:31:26.088363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:06.542614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.418363+0000","last_change":"2024-05-04T00:31:19.184044+0000","last_active":"2024-05-04T00:31:35.418363+0000","last_peered":"2024-05-04T00:31:35.418363+0000","last_clean":"2024-05-04T00:31:35.418363+0000","last_became_active":"2024-05-04T00:31:19.181956+0000","last_became_peered":"2024-05-04T00:31:19.181956+0000","last_unstale":"2024-05-04T00:31:35.418363+0000","last_undegraded":"2024-05-04T00:31:35.418363+0000","last_fullsized":"2024-05-04T00:31:35.418363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:09:33.607433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049528+0000","last_change":"2024-05-04T00:31:21.343953+0000","last_active":"2024-05-04T00:31:26.049528+0000","last_peered":"2024-05-04T00:31:26.049528+0000","last_clean":"2024-05-04T00:31:26.049528+0000","last_became_active":"2024-05-04T00:31:21.343499+0000","last_became_peered":"2024-05-04T00:31:21.343499+0000","last_unstale":"2024-05-04T00:31:26.049528+0000","last_undegraded":"2024-05-04T00:31:26.049528+0000","last_fullsized":"2024-05-04T00:31:26.049528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:33.938895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.311044+0000","last_change":"2024-05-04T00:31:19.184947+0000","last_active":"2024-05-04T00:31:35.311044+0000","last_peered":"2024-05-04T00:31:35.311044+0000","last_clean":"2024-05-04T00:31:35.311044+0000","last_became_active":"2024-05-04T00:31:19.184606+0000","last_became_peered":"2024-05-04T00:31:19.184606+0000","last_unstale":"2024-05-04T00:31:35.311044+0000","last_undegraded":"2024-05-04T00:31:35.311044+0000","last_fullsized":"2024-05-04T00:31:35.311044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:07:49.638230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335413+0000","last_change":"2024-05-04T00:31:21.402799+0000","last_active":"2024-05-04T00:31:26.335413+0000","last_peered":"2024-05-04T00:31:26.335413+0000","last_clean":"2024-05-04T00:31:26.335413+0000","last_became_active":"2024-05-04T00:31:21.401591+0000","last_became_peered":"2024-05-04T00:31:21.401591+0000","last_unstale":"2024-05-04T00:31:26.335413+0000","last_undegraded":"2024-05-04T00:31:26.335413+0000","last_fullsized":"2024-05-04T00:31:26.335413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:28:07.779536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978310+0000","last_change":"2024-05-04T00:31:19.182214+0000","last_active":"2024-05-04T00:31:25.978310+0000","last_peered":"2024-05-04T00:31:25.978310+0000","last_clean":"2024-05-04T00:31:25.978310+0000","last_became_active":"2024-05-04T00:31:19.180317+0000","last_became_peered":"2024-05-04T00:31:19.180317+0000","last_unstale":"2024-05-04T00:31:25.978310+0000","last_undegraded":"2024-05-04T00:31:25.978310+0000","last_fullsized":"2024-05-04T00:31:25.978310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:44.678316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334340+0000","last_change":"2024-05-04T00:31:21.401965+0000","last_active":"2024-05-04T00:31:26.334340+0000","last_peered":"2024-05-04T00:31:26.334340+0000","last_clean":"2024-05-04T00:31:26.334340+0000","last_became_active":"2024-05-04T00:31:21.389808+0000","last_became_peered":"2024-05-04T00:31:21.389808+0000","last_unstale":"2024-05-04T00:31:26.334340+0000","last_undegraded":"2024-05-04T00:31:26.334340+0000","last_fullsized":"2024-05-04T00:31:26.334340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:52:48.345813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336089+0000","last_change":"2024-05-04T00:31:19.183991+0000","last_active":"2024-05-04T00:31:26.336089+0000","last_peered":"2024-05-04T00:31:26.336089+0000","last_clean":"2024-05-04T00:31:26.336089+0000","last_became_active":"2024-05-04T00:31:19.179785+0000","last_became_peered":"2024-05-04T00:31:19.179785+0000","last_unstale":"2024-05-04T00:31:26.336089+0000","last_undegraded":"2024-05-04T00:31:26.336089+0000","last_fullsized":"2024-05-04T00:31:26.336089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:29.575176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333549+0000","last_change":"2024-05-04T00:31:21.342687+0000","last_active":"2024-05-04T00:31:26.333549+0000","last_peered":"2024-05-04T00:31:26.333549+0000","last_clean":"2024-05-04T00:31:26.333549+0000","last_became_active":"2024-05-04T00:31:21.341702+0000","last_became_peered":"2024-05-04T00:31:21.341702+0000","last_unstale":"2024-05-04T00:31:26.333549+0000","last_undegraded":"2024-05-04T00:31:26.333549+0000","last_fullsized":"2024-05-04T00:31:26.333549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:56.687510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978903+0000","last_change":"2024-05-04T00:31:19.176663+0000","last_active":"2024-05-04T00:31:25.978903+0000","last_peered":"2024-05-04T00:31:25.978903+0000","last_clean":"2024-05-04T00:31:25.978903+0000","last_became_active":"2024-05-04T00:31:19.175616+0000","last_became_peered":"2024-05-04T00:31:19.175616+0000","last_unstale":"2024-05-04T00:31:25.978903+0000","last_undegraded":"2024-05-04T00:31:25.978903+0000","last_fullsized":"2024-05-04T00:31:25.978903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:24:47.124717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.050096+0000","last_change":"2024-05-04T00:31:21.403129+0000","last_active":"2024-05-04T00:31:26.050096+0000","last_peered":"2024-05-04T00:31:26.050096+0000","last_clean":"2024-05-04T00:31:26.050096+0000","last_became_active":"2024-05-04T00:31:21.402248+0000","last_became_peered":"2024-05-04T00:31:21.402248+0000","last_unstale":"2024-05-04T00:31:26.050096+0000","last_undegraded":"2024-05-04T00:31:26.050096+0000","last_fullsized":"2024-05-04T00:31:26.050096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:10.771050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.089094+0000","last_change":"2024-05-04T00:31:19.155903+0000","last_active":"2024-05-04T00:31:26.089094+0000","last_peered":"2024-05-04T00:31:26.089094+0000","last_clean":"2024-05-04T00:31:26.089094+0000","last_became_active":"2024-05-04T00:31:19.154909+0000","last_became_peered":"2024-05-04T00:31:19.154909+0000","last_unstale":"2024-05-04T00:31:26.089094+0000","last_undegraded":"2024-05-04T00:31:26.089094+0000","last_fullsized":"2024-05-04T00:31:26.089094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:53:25.815241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088979+0000","last_change":"2024-05-04T00:31:21.445396+0000","last_active":"2024-05-04T00:31:26.088979+0000","last_peered":"2024-05-04T00:31:26.088979+0000","last_clean":"2024-05-04T00:31:26.088979+0000","last_became_active":"2024-05-04T00:31:21.444934+0000","last_became_peered":"2024-05-04T00:31:21.444934+0000","last_unstale":"2024-05-04T00:31:26.088979+0000","last_undegraded":"2024-05-04T00:31:26.088979+0000","last_fullsized":"2024-05-04T00:31:26.088979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:23:02.407000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.645726+0000","last_change":"2024-05-04T00:31:19.182946+0000","last_active":"2024-05-04T00:31:31.645726+0000","last_peered":"2024-05-04T00:31:31.645726+0000","last_clean":"2024-05-04T00:31:31.645726+0000","last_became_active":"2024-05-04T00:31:19.182050+0000","last_became_peered":"2024-05-04T00:31:19.182050+0000","last_unstale":"2024-05-04T00:31:31.645726+0000","last_undegraded":"2024-05-04T00:31:31.645726+0000","last_fullsized":"2024-05-04T00:31:31.645726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:55:12.448558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088626+0000","last_change":"2024-05-04T00:31:21.443100+0000","last_active":"2024-05-04T00:31:26.088626+0000","last_peered":"2024-05-04T00:31:26.088626+0000","last_clean":"2024-05-04T00:31:26.088626+0000","last_became_active":"2024-05-04T00:31:21.442602+0000","last_became_peered":"2024-05-04T00:31:21.442602+0000","last_unstale":"2024-05-04T00:31:26.088626+0000","last_undegraded":"2024-05-04T00:31:26.088626+0000","last_fullsized":"2024-05-04T00:31:26.088626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:16:45.807230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.680264+0000","last_change":"2024-05-04T00:31:19.248358+0000","last_active":"2024-05-04T00:31:31.680264+0000","last_peered":"2024-05-04T00:31:31.680264+0000","last_clean":"2024-05-04T00:31:31.680264+0000","last_became_active":"2024-05-04T00:31:19.247822+0000","last_became_peered":"2024-05-04T00:31:19.247822+0000","last_unstale":"2024-05-04T00:31:31.680264+0000","last_undegraded":"2024-05-04T00:31:31.680264+0000","last_fullsized":"2024-05-04T00:31:31.680264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:04.191631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977590+0000","last_change":"2024-05-04T00:31:21.441959+0000","last_active":"2024-05-04T00:31:25.977590+0000","last_peered":"2024-05-04T00:31:25.977590+0000","last_clean":"2024-05-04T00:31:25.977590+0000","last_became_active":"2024-05-04T00:31:21.441015+0000","last_became_peered":"2024-05-04T00:31:21.441015+0000","last_unstale":"2024-05-04T00:31:25.977590+0000","last_undegraded":"2024-05-04T00:31:25.977590+0000","last_fullsized":"2024-05-04T00:31:25.977590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:54:30.187813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.492350+0000","last_change":"2024-05-04T00:31:19.159146+0000","last_active":"2024-05-04T00:31:31.492350+0000","last_peered":"2024-05-04T00:31:31.492350+0000","last_clean":"2024-05-04T00:31:31.492350+0000","last_became_active":"2024-05-04T00:31:19.158366+0000","last_became_peered":"2024-05-04T00:31:19.158366+0000","last_unstale":"2024-05-04T00:31:31.492350+0000","last_undegraded":"2024-05-04T00:31:31.492350+0000","last_fullsized":"2024-05-04T00:31:31.492350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:07.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088049+0000","last_change":"2024-05-04T00:31:21.441521+0000","last_active":"2024-05-04T00:31:26.088049+0000","last_peered":"2024-05-04T00:31:26.088049+0000","last_clean":"2024-05-04T00:31:26.088049+0000","last_became_active":"2024-05-04T00:31:21.441074+0000","last_became_peered":"2024-05-04T00:31:21.441074+0000","last_unstale":"2024-05-04T00:31:26.088049+0000","last_undegraded":"2024-05-04T00:31:26.088049+0000","last_fullsized":"2024-05-04T00:31:26.088049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:31.926158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.050041+0000","last_change":"2024-05-04T00:31:19.174493+0000","last_active":"2024-05-04T00:31:26.050041+0000","last_peered":"2024-05-04T00:31:26.050041+0000","last_clean":"2024-05-04T00:31:26.050041+0000","last_became_active":"2024-05-04T00:31:19.174113+0000","last_became_peered":"2024-05-04T00:31:19.174113+0000","last_unstale":"2024-05-04T00:31:26.050041+0000","last_undegraded":"2024-05-04T00:31:26.050041+0000","last_fullsized":"2024-05-04T00:31:26.050041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:54.336528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334858+0000","last_change":"2024-05-04T00:31:21.406782+0000","last_active":"2024-05-04T00:31:26.334858+0000","last_peered":"2024-05-04T00:31:26.334858+0000","last_clean":"2024-05-04T00:31:26.334858+0000","last_became_active":"2024-05-04T00:31:21.406008+0000","last_became_peered":"2024-05-04T00:31:21.406008+0000","last_unstale":"2024-05-04T00:31:26.334858+0000","last_undegraded":"2024-05-04T00:31:26.334858+0000","last_fullsized":"2024-05-04T00:31:26.334858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:24:01.565048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.645923+0000","last_change":"2024-05-04T00:31:19.248682+0000","last_active":"2024-05-04T00:31:31.645923+0000","last_peered":"2024-05-04T00:31:31.645923+0000","last_clean":"2024-05-04T00:31:31.645923+0000","last_became_active":"2024-05-04T00:31:19.247736+0000","last_became_peered":"2024-05-04T00:31:19.247736+0000","last_unstale":"2024-05-04T00:31:31.645923+0000","last_undegraded":"2024-05-04T00:31:31.645923+0000","last_fullsized":"2024-05-04T00:31:31.645923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:42:59.459764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977927+0000","last_change":"2024-05-04T00:31:21.401858+0000","last_active":"2024-05-04T00:31:25.977927+0000","last_peered":"2024-05-04T00:31:25.977927+0000","last_clean":"2024-05-04T00:31:25.977927+0000","last_became_active":"2024-05-04T00:31:21.400935+0000","last_became_peered":"2024-05-04T00:31:21.400935+0000","last_unstale":"2024-05-04T00:31:25.977927+0000","last_undegraded":"2024-05-04T00:31:25.977927+0000","last_fullsized":"2024-05-04T00:31:25.977927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:50:11.762845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978424+0000","last_change":"2024-05-04T00:31:21.392918+0000","last_active":"2024-05-04T00:31:25.978424+0000","last_peered":"2024-05-04T00:31:25.978424+0000","last_clean":"2024-05-04T00:31:25.978424+0000","last_became_active":"2024-05-04T00:31:21.392020+0000","last_became_peered":"2024-05-04T00:31:21.392020+0000","last_unstale":"2024-05-04T00:31:25.978424+0000","last_undegraded":"2024-05-04T00:31:25.978424+0000","last_fullsized":"2024-05-04T00:31:25.978424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:19:30.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334811+0000","last_change":"2024-05-04T00:31:19.187930+0000","last_active":"2024-05-04T00:31:26.334811+0000","last_peered":"2024-05-04T00:31:26.334811+0000","last_clean":"2024-05-04T00:31:26.334811+0000","last_became_active":"2024-05-04T00:31:19.185156+0000","last_became_peered":"2024-05-04T00:31:19.185156+0000","last_unstale":"2024-05-04T00:31:26.334811+0000","last_undegraded":"2024-05-04T00:31:26.334811+0000","last_fullsized":"2024-05-04T00:31:26.334811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:40.266177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.332539+0000","last_change":"2024-05-04T00:31:21.397596+0000","last_active":"2024-05-04T00:31:26.332539+0000","last_peered":"2024-05-04T00:31:26.332539+0000","last_clean":"2024-05-04T00:31:26.332539+0000","last_became_active":"2024-05-04T00:31:21.396023+0000","last_became_peered":"2024-05-04T00:31:21.396023+0000","last_unstale":"2024-05-04T00:31:26.332539+0000","last_undegraded":"2024-05-04T00:31:26.332539+0000","last_fullsized":"2024-05-04T00:31:26.332539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:02:02.166274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335177+0000","last_change":"2024-05-04T00:31:19.189413+0000","last_active":"2024-05-04T00:31:26.335177+0000","last_peered":"2024-05-04T00:31:26.335177+0000","last_clean":"2024-05-04T00:31:26.335177+0000","last_became_active":"2024-05-04T00:31:19.188359+0000","last_became_peered":"2024-05-04T00:31:19.188359+0000","last_unstale":"2024-05-04T00:31:26.335177+0000","last_undegraded":"2024-05-04T00:31:26.335177+0000","last_fullsized":"2024-05-04T00:31:26.335177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:16:43.456248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336512+0000","last_change":"2024-05-04T00:31:21.417364+0000","last_active":"2024-05-04T00:31:26.336512+0000","last_peered":"2024-05-04T00:31:26.336512+0000","last_clean":"2024-05-04T00:31:26.336512+0000","last_became_active":"2024-05-04T00:31:21.416267+0000","last_became_peered":"2024-05-04T00:31:21.416267+0000","last_unstale":"2024-05-04T00:31:26.336512+0000","last_undegraded":"2024-05-04T00:31:26.336512+0000","last_fullsized":"2024-05-04T00:31:26.336512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:42:31.303120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336663+0000","last_change":"2024-05-04T00:31:19.187081+0000","last_active":"2024-05-04T00:31:26.336663+0000","last_peered":"2024-05-04T00:31:26.336663+0000","last_clean":"2024-05-04T00:31:26.336663+0000","last_became_active":"2024-05-04T00:31:19.186483+0000","last_became_peered":"2024-05-04T00:31:19.186483+0000","last_unstale":"2024-05-04T00:31:26.336663+0000","last_undegraded":"2024-05-04T00:31:26.336663+0000","last_fullsized":"2024-05-04T00:31:26.336663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:07.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336315+0000","last_change":"2024-05-04T00:31:21.414034+0000","last_active":"2024-05-04T00:31:26.336315+0000","last_peered":"2024-05-04T00:31:26.336315+0000","last_clean":"2024-05-04T00:31:26.336315+0000","last_became_active":"2024-05-04T00:31:21.413330+0000","last_became_peered":"2024-05-04T00:31:21.413330+0000","last_unstale":"2024-05-04T00:31:26.336315+0000","last_undegraded":"2024-05-04T00:31:26.336315+0000","last_fullsized":"2024-05-04T00:31:26.336315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:07.135906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.089033+0000","last_change":"2024-05-04T00:31:19.175936+0000","last_active":"2024-05-04T00:31:26.089033+0000","last_peered":"2024-05-04T00:31:26.089033+0000","last_clean":"2024-05-04T00:31:26.089033+0000","last_became_active":"2024-05-04T00:31:19.175356+0000","last_became_peered":"2024-05-04T00:31:19.175356+0000","last_unstale":"2024-05-04T00:31:26.089033+0000","last_undegraded":"2024-05-04T00:31:26.089033+0000","last_fullsized":"2024-05-04T00:31:26.089033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:33.026019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3940,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":7958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":100305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":102751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":101295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":868352,"data_stored":690121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":99829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":100389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":880640,"data_stored":690765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":100287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T00:31:37.041 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-04T00:31:37.042 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-04T00:31:37.042 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-04T00:31:37.042 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-04T00:31:37.042 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-04T00:31:37.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.229+0000 7f0c0b6f9640 1 Processor -- start 2024-05-04T00:31:37.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.233+0000 7f0c0b6f9640 1 -- start start 2024-05-04T00:31:37.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.233+0000 7f0c0b6f9640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c04163810 0x7f0c04165c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:37.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.233+0000 7f0c0b6f9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c040c8480 con 0x7f0c041431d0 2024-05-04T00:31:37.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.233+0000 7f0c0b6f9640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c0406c9d0 con 0x7f0c04142cd0 2024-05-04T00:31:37.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.233+0000 7f0c0b6f9640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f0c0415aec0 con 0x7f0c04163810 2024-05-04T00:31:37.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.301+0000 7f0c09495640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0c041431d0 0x7f0c0415db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58454/0 (socket says 172.21.15.6:58454) 2024-05-04T00:31:37.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.301+0000 7f0c09495640 1 -- 172.21.15.6:0/1405892699 learned_addr learned my addr 172.21.15.6:0/1405892699 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:37.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.305+0000 7f0c09c96640 1 --2- 172.21.15.6:0/1405892699 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c04163810 0x7f0c04165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:37.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.309+0000 7f0c09c96640 1 -- 172.21.15.6:0/1405892699 >> v1:172.21.15.163:6789/0 conn(0x7f0c04142cd0 legacy=0x7f0c040742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:37.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.309+0000 7f0c09c96640 1 -- 172.21.15.6:0/1405892699 >> v1:172.21.15.6:6789/0 conn(0x7f0c041431d0 legacy=0x7f0c0415db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:37.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.309+0000 7f0c09c96640 1 -- 172.21.15.6:0/1405892699 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c0406ccb0 con 0x7f0c04163810 2024-05-04T00:31:37.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.313+0000 7f0c09c96640 1 --2- 172.21.15.6:0/1405892699 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c04163810 0x7f0c04165c30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009dc0 tx=0x7f0bfc01f110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7eb48dc484be5283 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:37.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.321+0000 7f0bfbfff640 1 -- 172.21.15.6:0/1405892699 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc0b5070 con 0x7f0c04163810 2024-05-04T00:31:37.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.321+0000 7f0bfbfff640 1 -- 172.21.15.6:0/1405892699 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bfc0b0440 con 0x7f0c04163810 2024-05-04T00:31:37.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.321+0000 7f0bfbfff640 1 -- 172.21.15.6:0/1405892699 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc0b0810 con 0x7f0c04163810 2024-05-04T00:31:37.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.321+0000 7f0c0b6f9640 1 -- 172.21.15.6:0/1405892699 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c04163810 msgr2=0x7f0c04165c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:37.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.321+0000 7f0c0b6f9640 1 --2- 172.21.15.6:0/1405892699 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c04163810 0x7f0c04165c30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009dc0 tx=0x7f0bfc01f110 comp rx=0 tx=0).stop 2024-05-04T00:31:37.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.321+0000 7f0c0b6f9640 1 -- 172.21.15.6:0/1405892699 shutdown_connections 2024-05-04T00:31:37.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.321+0000 7f0c0b6f9640 1 --2- 172.21.15.6:0/1405892699 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c04163810 0x7f0c04165c30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:37.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.321+0000 7f0c0b6f9640 1 -- 172.21.15.6:0/1405892699 >> 172.21.15.6:0/1405892699 conn(0x7f0c040737d0 msgr2=0x7f0c04073be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:37.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.321+0000 7f0c0b6f9640 1 -- 172.21.15.6:0/1405892699 shutdown_connections 2024-05-04T00:31:37.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.321+0000 7f0c0b6f9640 1 -- 172.21.15.6:0/1405892699 wait complete. 2024-05-04T00:31:37.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.325+0000 7f0c0b6f9640 1 Processor -- start 2024-05-04T00:31:37.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.325+0000 7f0c0b6f9640 1 -- start start 2024-05-04T00:31:37.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.325+0000 7f0c0b6f9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c04142cd0 0x7f0c04140330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:37.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.325+0000 7f0c0b6f9640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c041431d0 0x7f0c040c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:37.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.325+0000 7f0c0b6f9640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c04163810 0x7f0c04141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:37.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.325+0000 7f0c0b6f9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0c04073380 con 0x7f0c04142cd0 2024-05-04T00:31:37.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.325+0000 7f0c0b6f9640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0406c780 con 0x7f0c04163810 2024-05-04T00:31:37.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.325+0000 7f0c0b6f9640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f0c0415e270 con 0x7f0c041431d0 2024-05-04T00:31:37.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.325+0000 7f0c08c94640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c041431d0 0x7f0c040c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:37.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.325+0000 7f0c08c94640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c041431d0 0x7f0c040c73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38374/0 (socket says 172.21.15.6:38374) 2024-05-04T00:31:37.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.325+0000 7f0c08c94640 1 -- 172.21.15.6:0/2622217894 learned_addr learned my addr 172.21.15.6:0/2622217894 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:37.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.329+0000 7f0c08c94640 1 -- 172.21.15.6:0/2622217894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c04163810 msgr2=0x7f0c04141a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:37.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.329+0000 7f0c08c94640 1 --2- 172.21.15.6:0/2622217894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c04163810 0x7f0c04141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:37.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.329+0000 7f0c08c94640 1 -- 172.21.15.6:0/2622217894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c04142cd0 msgr2=0x7f0c04140330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:37.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.329+0000 7f0c08c94640 1 --2- 172.21.15.6:0/2622217894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c04142cd0 0x7f0c04140330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:37.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.329+0000 7f0c08c94640 1 -- 172.21.15.6:0/2622217894 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c040c7900 con 0x7f0c041431d0 2024-05-04T00:31:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.333+0000 7f0c08c94640 1 --2- 172.21.15.6:0/2622217894 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c041431d0 0x7f0c040c73c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400b3e0 tx=0x7f0bf400b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:37.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.345+0000 7f0bf9ffb640 1 -- 172.21.15.6:0/2622217894 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4015020 con 0x7f0c041431d0 2024-05-04T00:31:37.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.345+0000 7f0bf9ffb640 1 -- 172.21.15.6:0/2622217894 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf4011850 con 0x7f0c041431d0 2024-05-04T00:31:37.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.345+0000 7f0c0b6f9640 1 -- 172.21.15.6:0/2622217894 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c04141fb0 con 0x7f0c041431d0 2024-05-04T00:31:37.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.345+0000 7f0bf9ffb640 1 -- 172.21.15.6:0/2622217894 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4011c40 con 0x7f0c041431d0 2024-05-04T00:31:37.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.345+0000 7f0c0b6f9640 1 -- 172.21.15.6:0/2622217894 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c04140f90 con 0x7f0c041431d0 2024-05-04T00:31:37.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.345+0000 7f0c0b6f9640 1 -- 172.21.15.6:0/2622217894 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c04069a50 con 0x7f0c041431d0 2024-05-04T00:31:37.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.369+0000 7f0bf9ffb640 1 -- 172.21.15.6:0/2622217894 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0bf4018020 con 0x7f0c041431d0 2024-05-04T00:31:37.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.369+0000 7f0bf9ffb640 1 --2- 172.21.15.6:0/2622217894 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f0be806f450 0x7f0be8071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:37.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.369+0000 7f0c09495640 1 --2- 172.21.15.6:0/2622217894 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f0be806f450 0x7f0be8071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:37.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.369+0000 7f0c09495640 1 --2- 172.21.15.6:0/2622217894 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f0be806f450 0x7f0be8071960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0c000096b0 tx=0x7f0c00006be0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:37.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.645+0000 7f0bf9ffb640 1 -- 172.21.15.6:0/2622217894 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f0bf4011de0 con 0x7f0c041431d0 2024-05-04T00:31:37.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.677+0000 7f0bf9ffb640 1 -- 172.21.15.6:0/2622217894 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0bf401f020 con 0x7f0c041431d0 2024-05-04T00:31:37.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:37.901+0000 7f0c0b6f9640 1 -- 172.21.15.6:0/2622217894 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0c040c87d0 con 0x7f0c041431d0 2024-05-04T00:31:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.109+0000 7f0bf9ffb640 1 -- 172.21.15.6:0/2622217894 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+179551 (secure 0 0 0) 0x7f0c040c7900 con 0x7f0c041431d0 2024-05-04T00:31:38.113 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:31:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.113+0000 7f0c0b6f9640 1 -- 172.21.15.6:0/2622217894 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f0be806f450 msgr2=0x7f0be8071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.113+0000 7f0c0b6f9640 1 --2- 172.21.15.6:0/2622217894 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f0be806f450 0x7f0be8071960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0c000096b0 tx=0x7f0c00006be0 comp rx=0 tx=0).stop 2024-05-04T00:31:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.113+0000 7f0c0b6f9640 1 -- 172.21.15.6:0/2622217894 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c041431d0 msgr2=0x7f0c040c73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.113+0000 7f0c0b6f9640 1 --2- 172.21.15.6:0/2622217894 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c041431d0 0x7f0c040c73c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400b3e0 tx=0x7f0bf400b8a0 comp rx=0 tx=0).stop 2024-05-04T00:31:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.113+0000 7f0c0b6f9640 1 -- 172.21.15.6:0/2622217894 shutdown_connections 2024-05-04T00:31:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.113+0000 7f0c0b6f9640 1 --2- 172.21.15.6:0/2622217894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c04163810 0x7f0c04141a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.113+0000 7f0c0b6f9640 1 --2- 172.21.15.6:0/2622217894 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f0be806f450 0x7f0be8071960 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.113+0000 7f0c0b6f9640 1 --2- 172.21.15.6:0/2622217894 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c041431d0 0x7f0c040c73c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.113+0000 7f0c0b6f9640 1 --2- 172.21.15.6:0/2622217894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c04142cd0 0x7f0c04140330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.113+0000 7f0c0b6f9640 1 -- 172.21.15.6:0/2622217894 >> 172.21.15.6:0/2622217894 conn(0x7f0c040737d0 msgr2=0x7f0c04138d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.113+0000 7f0c0b6f9640 1 -- 172.21.15.6:0/2622217894 shutdown_connections 2024-05-04T00:31:38.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.113+0000 7f0c0b6f9640 1 -- 172.21.15.6:0/2622217894 wait complete. 2024-05-04T00:31:38.140 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2152694980},{"type":"v1","addr":"172.21.15.163:6801","nonce":2152694980}]},"active_addr":"172.21.15.163:6801/2152694980","active_change":"2024-05-04T00:30:18.937460+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4117,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":660053353}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":4108326418}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":2474182515}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":2142830214}]}]} 2024-05-04T00:31:38.143 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-04T00:31:38.143 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-04T00:31:38.144 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T00:31:38.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.297+0000 7f3909f37640 1 Processor -- start 2024-05-04T00:31:38.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.297+0000 7f3909f37640 1 -- start start 2024-05-04T00:31:38.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.297+0000 7f3909f37640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f390406c8a0 0x7f390415ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:38.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.297+0000 7f3909f37640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f390415d1f0 con 0x7f390406d670 2024-05-04T00:31:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.297+0000 7f3909f37640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f390406cda0 con 0x7f39040c91d0 2024-05-04T00:31:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.297+0000 7f3909f37640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f390415f820 con 0x7f390406c8a0 2024-05-04T00:31:38.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.345+0000 7f3902ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f390406d670 0x7f39041561a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58464/0 (socket says 172.21.15.6:58464) 2024-05-04T00:31:38.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.345+0000 7f3902ffd640 1 -- 172.21.15.6:0/1296593880 learned_addr learned my addr 172.21.15.6:0/1296593880 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:38.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.353+0000 7f39027fc640 1 -- 172.21.15.6:0/1296593880 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 984833337 0 0) 0x7f38f8001120 con 0x7f390406d670 2024-05-04T00:31:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.353+0000 7f39027fc640 1 -- 172.21.15.6:0/1296593880 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38ec003530 con 0x7f390406d670 2024-05-04T00:31:38.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.365+0000 7f39027fc640 1 -- 172.21.15.6:0/1296593880 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 443698160 0 0) 0x7f38ec003530 con 0x7f390406d670 2024-05-04T00:31:38.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.365+0000 7f39027fc640 1 -- 172.21.15.6:0/1296593880 >> v2:172.21.15.163:3300/0 conn(0x7f390406c8a0 msgr2=0x7f390415ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:38.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.365+0000 7f39027fc640 1 --2- 172.21.15.6:0/1296593880 >> v2:172.21.15.163:3300/0 conn(0x7f390406c8a0 0x7f390415ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:38.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.365+0000 7f39027fc640 1 -- 172.21.15.6:0/1296593880 >> v1:172.21.15.163:6789/0 conn(0x7f39040c91d0 legacy=0x7f39040631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:38.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.365+0000 7f39027fc640 1 -- 172.21.15.6:0/1296593880 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390406d080 con 0x7f390406d670 2024-05-04T00:31:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.365+0000 7f39027fc640 1 -- 172.21.15.6:0/1296593880 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 557976392 0 0) 0x7f38f80018d0 con 0x7f390406d670 2024-05-04T00:31:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.365+0000 7f39027fc640 1 -- 172.21.15.6:0/1296593880 >> v1:172.21.15.6:6789/0 conn(0x7f390406d670 legacy=0x7f39041561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.365+0000 7f39027fc640 1 --2- 172.21.15.6:0/1296593880 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f38ec003a60 0x7f38ec003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.365+0000 7f39027fc640 1 --2- 172.21.15.6:0/1296593880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38ec004810 0x7f38ec004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.365+0000 7f39027fc640 1 --2- 172.21.15.6:0/1296593880 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38ec005400 0x7f38ec00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.365+0000 7f39027fc640 1 -- 172.21.15.6:0/1296593880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f390415f820 con 0x7f38ec004810 2024-05-04T00:31:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.365+0000 7f39027fc640 1 -- 172.21.15.6:0/1296593880 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec00c390 con 0x7f38ec005400 2024-05-04T00:31:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.365+0000 7f39027fc640 1 -- 172.21.15.6:0/1296593880 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f38ec00c590 con 0x7f38ec003a60 2024-05-04T00:31:38.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.369+0000 7f3903fff640 1 --2- 172.21.15.6:0/1296593880 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38ec005400 0x7f38ec00bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.373+0000 7f3902ffd640 1 --2- 172.21.15.6:0/1296593880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38ec004810 0x7f38ec004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.381+0000 7f3902ffd640 1 -- 172.21.15.6:0/1296593880 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f38ec003a60 msgr2=0x7f38ec003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.381+0000 7f3902ffd640 1 --2- 172.21.15.6:0/1296593880 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f38ec003a60 0x7f38ec003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.381+0000 7f3902ffd640 1 -- 172.21.15.6:0/1296593880 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38ec005400 msgr2=0x7f38ec00bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.381+0000 7f3902ffd640 1 --2- 172.21.15.6:0/1296593880 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38ec005400 0x7f38ec00bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.381+0000 7f3902ffd640 1 -- 172.21.15.6:0/1296593880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ec003530 con 0x7f38ec004810 2024-05-04T00:31:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.381+0000 7f3903fff640 1 -- 172.21.15.6:0/1296593880 reap_dead start 2024-05-04T00:31:38.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.385+0000 7f3902ffd640 1 --2- 172.21.15.6:0/1296593880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38ec004810 0x7f38ec004c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f38f800c490 tx=0x7f38f801cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17641c6d7d7c99cc server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:38.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.401+0000 7f39027fc640 1 -- 172.21.15.6:0/1296593880 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f800c0e0 con 0x7f38ec004810 2024-05-04T00:31:38.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.401+0000 7f39027fc640 1 -- 172.21.15.6:0/1296593880 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f80a9020 con 0x7f38ec004810 2024-05-04T00:31:38.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.401+0000 7f39027fc640 1 -- 172.21.15.6:0/1296593880 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f80a5bb0 con 0x7f38ec004810 2024-05-04T00:31:38.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.401+0000 7f3909f37640 1 -- 172.21.15.6:0/1296593880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38ec004810 msgr2=0x7f38ec004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:38.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.401+0000 7f3909f37640 1 --2- 172.21.15.6:0/1296593880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38ec004810 0x7f38ec004c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f38f800c490 tx=0x7f38f801cb60 comp rx=0 tx=0).stop 2024-05-04T00:31:38.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.401+0000 7f3909f37640 1 -- 172.21.15.6:0/1296593880 shutdown_connections 2024-05-04T00:31:38.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.401+0000 7f3909f37640 1 --2- 172.21.15.6:0/1296593880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38ec004810 0x7f38ec004c20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:38.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.401+0000 7f3909f37640 1 -- 172.21.15.6:0/1296593880 >> 172.21.15.6:0/1296593880 conn(0x7f39040ce410 msgr2=0x7f39040ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:38.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.401+0000 7f3909f37640 1 -- 172.21.15.6:0/1296593880 shutdown_connections 2024-05-04T00:31:38.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.401+0000 7f3909f37640 1 -- 172.21.15.6:0/1296593880 wait complete. 2024-05-04T00:31:38.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.405+0000 7f3909f37640 1 Processor -- start 2024-05-04T00:31:38.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.405+0000 7f3909f37640 1 -- start start 2024-05-04T00:31:38.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.405+0000 7f3909f37640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38ec004810 0x7f39041f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:38.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.405+0000 7f3909f37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39041f5ad0 0x7f3904150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:38.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.405+0000 7f3909f37640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3904154e50 0x7f39040c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:38.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.405+0000 7f3909f37640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f390415fd50 con 0x7f39041f5ad0 2024-05-04T00:31:38.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.405+0000 7f3909f37640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f39041600c0 con 0x7f38ec004810 2024-05-04T00:31:38.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.405+0000 7f3909f37640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f39040c95e0 con 0x7f3904154e50 2024-05-04T00:31:38.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.409+0000 7f3903fff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3904154e50 0x7f39040c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:38.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.409+0000 7f39037fe640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38ec004810 0x7f39041f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:38.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.409+0000 7f3903fff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3904154e50 0x7f39040c8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38394/0 (socket says 172.21.15.6:38394) 2024-05-04T00:31:38.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.409+0000 7f3903fff640 1 -- 172.21.15.6:0/3646218784 learned_addr learned my addr 172.21.15.6:0/3646218784 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.417+0000 7f3903fff640 1 -- 172.21.15.6:0/3646218784 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38ec004810 msgr2=0x7f39041f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.417+0000 7f3903fff640 1 --2- 172.21.15.6:0/3646218784 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38ec004810 0x7f39041f25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.417+0000 7f3903fff640 1 -- 172.21.15.6:0/3646218784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39041f5ad0 msgr2=0x7f3904150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.417+0000 7f3903fff640 1 --2- 172.21.15.6:0/3646218784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39041f5ad0 0x7f3904150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.417+0000 7f3903fff640 1 -- 172.21.15.6:0/3646218784 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39041f2af0 con 0x7f3904154e50 2024-05-04T00:31:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.425+0000 7f3903fff640 1 --2- 172.21.15.6:0/3646218784 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3904154e50 0x7f39040c8210 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f390406e2f0 tx=0x7f38fc00fb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:38.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.437+0000 7f38ebfff640 1 -- 172.21.15.6:0/3646218784 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc019070 con 0x7f3904154e50 2024-05-04T00:31:38.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.437+0000 7f38ebfff640 1 -- 172.21.15.6:0/3646218784 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38fc006b40 con 0x7f3904154e50 2024-05-04T00:31:38.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.437+0000 7f38ebfff640 1 -- 172.21.15.6:0/3646218784 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc003980 con 0x7f3904154e50 2024-05-04T00:31:38.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.437+0000 7f3909f37640 1 -- 172.21.15.6:0/3646218784 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39041513c0 con 0x7f3904154e50 2024-05-04T00:31:38.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.437+0000 7f3909f37640 1 -- 172.21.15.6:0/3646218784 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f39041f2d60 con 0x7f3904154e50 2024-05-04T00:31:38.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.437+0000 7f3909f37640 1 -- 172.21.15.6:0/3646218784 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3904069a50 con 0x7f3904154e50 2024-05-04T00:31:38.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.797+0000 7f38ebfff640 1 -- 172.21.15.6:0/3646218784 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f38fc01c070 con 0x7f3904154e50 2024-05-04T00:31:38.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.797+0000 7f38ebfff640 1 --2- 172.21.15.6:0/3646218784 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f38f006f480 0x7f38f0071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:38.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.797+0000 7f39037fe640 1 --2- 172.21.15.6:0/3646218784 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f38f006f480 0x7f38f0071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.797+0000 7f39037fe640 1 --2- 172.21.15.6:0/3646218784 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f38f006f480 0x7f38f0071990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f39040522d0 tx=0x7f38f4009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:38.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.809+0000 7f38ebfff640 1 -- 172.21.15.6:0/3646218784 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f38fc057250 con 0x7f3904154e50 2024-05-04T00:31:38.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:38.841+0000 7f38ebfff640 1 -- 172.21.15.6:0/3646218784 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f38fc023080 con 0x7f3904154e50 2024-05-04T00:31:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.029+0000 7f3909f37640 1 -- 172.21.15.6:0/3646218784 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f390406d3e0 con 0x7f3904154e50 2024-05-04T00:31:39.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.117+0000 7f38ebfff640 1 -- 172.21.15.6:0/3646218784 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+16537 (secure 0 0 0) 0x7f38fc05b6c0 con 0x7f3904154e50 2024-05-04T00:31:39.118 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:31:39.118 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"ad5951ed-0d5e-4770-b5d9-995e08a00213","created":"2024-05-04T00:30:11.236352+0000","modified":"2024-05-04T00:31:25.449331+0000","last_up_change":"2024-05-04T00:30:35.679943+0000","last_in_change":"2024-05-04T00:30:24.926330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T00:30:36.311072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T00:31:17.278288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T00:31:18.957819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a907d753-b7cf-499c-ae36-81e44ed933a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6805","nonce":489144503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6810","nonce":489144503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6824","nonce":489144503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6813","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6817","nonce":489144503}]},"public_addr":"172.21.15.6:6805/489144503","cluster_addr":"172.21.15.6:6810/489144503","heartbeat_back_addr":"172.21.15.6:6824/489144503","heartbeat_front_addr":"172.21.15.6:6817/489144503","state":["exists","up"]},{"osd":1,"uuid":"eab41a32-d5f1-43b8-8835-f2d4bffc9cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6802","nonce":3099957279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6807","nonce":3099957279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6819","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6823","nonce":3099957279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6815","nonce":3099957279}]},"public_addr":"172.21.15.6:6802/3099957279","cluster_addr":"172.21.15.6:6807/3099957279","heartbeat_back_addr":"172.21.15.6:6823/3099957279","heartbeat_front_addr":"172.21.15.6:6815/3099957279","state":["exists","up"]},{"osd":2,"uuid":"f2540144-b533-4ffc-a9cf-24f0e4910a9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6801","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6806","nonce":2770857903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6809","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6812","nonce":2770857903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6827","nonce":2770857903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6821","nonce":2770857903}]},"public_addr":"172.21.15.6:6806/2770857903","cluster_addr":"172.21.15.6:6812/2770857903","heartbeat_back_addr":"172.21.15.6:6827/2770857903","heartbeat_front_addr":"172.21.15.6:6821/2770857903","state":["exists","up"]},{"osd":3,"uuid":"982b7ace-fd02-4f03-aef2-0428468f8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6818","nonce":3149875909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6826","nonce":3149875909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6831","nonce":3149875909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6829","nonce":3149875909}]},"public_addr":"172.21.15.6:6818/3149875909","cluster_addr":"172.21.15.6:6826/3149875909","heartbeat_back_addr":"172.21.15.6:6831/3149875909","heartbeat_front_addr":"172.21.15.6:6829/3149875909","state":["exists","up"]},{"osd":4,"uuid":"ecf94166-cfdf-4ac8-a659-6ae907686e8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6818","nonce":2508264225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6821","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6824","nonce":2508264225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6833","nonce":2508264225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6831","nonce":2508264225}]},"public_addr":"172.21.15.163:6818/2508264225","cluster_addr":"172.21.15.163:6824/2508264225","heartbeat_back_addr":"172.21.15.163:6833/2508264225","heartbeat_front_addr":"172.21.15.163:6831/2508264225","state":["exists","up"]},{"osd":5,"uuid":"fc5cfa90-0e3a-4fc2-829c-5ff57d7a5953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6815","nonce":167619435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6820","nonce":167619435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6827","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6829","nonce":167619435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6825","nonce":167619435}]},"public_addr":"172.21.15.163:6815/167619435","cluster_addr":"172.21.15.163:6820/167619435","heartbeat_back_addr":"172.21.15.163:6829/167619435","heartbeat_front_addr":"172.21.15.163:6825/167619435","state":["exists","up"]},{"osd":6,"uuid":"ed95f0cf-f309-4861-b47c-4a5a6b44ffdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6811","nonce":1460767610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6813","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6814","nonce":1460767610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6830","nonce":1460767610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6819","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6822","nonce":1460767610}]},"public_addr":"172.21.15.163:6811/1460767610","cluster_addr":"172.21.15.163:6814/1460767610","heartbeat_back_addr":"172.21.15.163:6830/1460767610","heartbeat_front_addr":"172.21.15.163:6822/1460767610","state":["exists","up"]},{"osd":7,"uuid":"2f57afcd-567f-44f6-9db7-df0342c8c4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6803","nonce":239650691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6805","nonce":239650691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6809","nonce":239650691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6807","nonce":239650691}]},"public_addr":"172.21.15.163:6803/239650691","cluster_addr":"172.21.15.163:6805/239650691","heartbeat_back_addr":"172.21.15.163:6809/239650691","heartbeat_front_addr":"172.21.15.163:6807/239650691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.818870+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.749094+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.805522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.576430+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.740084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.755726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.797961+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.577731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T00:31:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.117+0000 7f3909f37640 1 -- 172.21.15.6:0/3646218784 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f38f006f480 msgr2=0x7f38f0071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.117+0000 7f3909f37640 1 --2- 172.21.15.6:0/3646218784 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f38f006f480 0x7f38f0071990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f39040522d0 tx=0x7f38f4009110 comp rx=0 tx=0).stop 2024-05-04T00:31:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.117+0000 7f3909f37640 1 -- 172.21.15.6:0/3646218784 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3904154e50 msgr2=0x7f39040c8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.117+0000 7f3909f37640 1 --2- 172.21.15.6:0/3646218784 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3904154e50 0x7f39040c8210 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f390406e2f0 tx=0x7f38fc00fb40 comp rx=0 tx=0).stop 2024-05-04T00:31:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.117+0000 7f3909f37640 1 -- 172.21.15.6:0/3646218784 shutdown_connections 2024-05-04T00:31:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.117+0000 7f3909f37640 1 --2- 172.21.15.6:0/3646218784 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f38f006f480 0x7f38f0071990 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.117+0000 7f3909f37640 1 --2- 172.21.15.6:0/3646218784 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3904154e50 0x7f39040c8210 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.117+0000 7f3909f37640 1 --2- 172.21.15.6:0/3646218784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39041f5ad0 0x7f3904150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.117+0000 7f3909f37640 1 --2- 172.21.15.6:0/3646218784 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38ec004810 0x7f39041f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.117+0000 7f3909f37640 1 -- 172.21.15.6:0/3646218784 >> 172.21.15.6:0/3646218784 conn(0x7f39040ce410 msgr2=0x7f390415ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.117+0000 7f3909f37640 1 -- 172.21.15.6:0/3646218784 shutdown_connections 2024-05-04T00:31:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.117+0000 7f3909f37640 1 -- 172.21.15.6:0/3646218784 wait complete. 2024-05-04T00:31:39.139 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-04T00:31:39.140 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T00:31:39.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.293+0000 7f9a9ba8b640 1 Processor -- start 2024-05-04T00:31:39.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.293+0000 7f9a9ba8b640 1 -- start start 2024-05-04T00:31:39.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.293+0000 7f9a9ba8b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a940ca420 0x7f9a940ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:39.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.293+0000 7f9a9ba8b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9a9406cf90 0x7f9a9406d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:39.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.293+0000 7f9a9ba8b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a94156a60 con 0x7f9a94156650 2024-05-04T00:31:39.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.293+0000 7f9a9ba8b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f9a94070f90 con 0x7f9a9406cf90 2024-05-04T00:31:39.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.293+0000 7f9a9ba8b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f9a9415d0d0 con 0x7f9a940ca420 2024-05-04T00:31:39.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.297+0000 7f9a99026640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a940ca420 0x7f9a940ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:39.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.297+0000 7f9a99026640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a940ca420 0x7f9a940ca830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38408/0 (socket says 172.21.15.6:38408) 2024-05-04T00:31:39.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.297+0000 7f9a99026640 1 -- 172.21.15.6:0/3115329385 learned_addr learned my addr 172.21.15.6:0/3115329385 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:39.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.305+0000 7f9a99026640 1 -- 172.21.15.6:0/3115329385 >> v2:172.21.15.6:3300/0 conn(0x7f9a9406cf90 msgr2=0x7f9a9406d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:39.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.305+0000 7f9a99026640 1 --2- 172.21.15.6:0/3115329385 >> v2:172.21.15.6:3300/0 conn(0x7f9a9406cf90 0x7f9a9406d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:39.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.305+0000 7f9a99026640 1 -- 172.21.15.6:0/3115329385 >> v1:172.21.15.6:6789/0 conn(0x7f9a94156650 legacy=0x7f9a940cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:39.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.305+0000 7f9a99026640 1 -- 172.21.15.6:0/3115329385 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9415c4c0 con 0x7f9a940ca420 2024-05-04T00:31:39.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.309+0000 7f9a99026640 1 --2- 172.21.15.6:0/3115329385 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a940ca420 0x7f9a940ca830 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009870 tx=0x7f9a8401ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c49e600ce0f18348 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:39.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.321+0000 7f9a98825640 1 -- 172.21.15.6:0/3115329385 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a840b5070 con 0x7f9a940ca420 2024-05-04T00:31:39.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.321+0000 7f9a98825640 1 -- 172.21.15.6:0/3115329385 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a840a89f0 con 0x7f9a940ca420 2024-05-04T00:31:39.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.321+0000 7f9a98825640 1 -- 172.21.15.6:0/3115329385 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a840a8dc0 con 0x7f9a940ca420 2024-05-04T00:31:39.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.321+0000 7f9a9ba8b640 1 -- 172.21.15.6:0/3115329385 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a940ca420 msgr2=0x7f9a940ca830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:39.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.321+0000 7f9a9ba8b640 1 --2- 172.21.15.6:0/3115329385 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a940ca420 0x7f9a940ca830 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009870 tx=0x7f9a8401ed70 comp rx=0 tx=0).stop 2024-05-04T00:31:39.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.321+0000 7f9a9ba8b640 1 -- 172.21.15.6:0/3115329385 shutdown_connections 2024-05-04T00:31:39.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.321+0000 7f9a9ba8b640 1 --2- 172.21.15.6:0/3115329385 >> v2:172.21.15.6:3300/0 conn(0x7f9a9406cf90 0x7f9a9406d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:39.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.321+0000 7f9a9ba8b640 1 --2- 172.21.15.6:0/3115329385 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a940ca420 0x7f9a940ca830 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:39.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.321+0000 7f9a9ba8b640 1 -- 172.21.15.6:0/3115329385 >> 172.21.15.6:0/3115329385 conn(0x7f9a94072ce0 msgr2=0x7f9a940704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:39.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.321+0000 7f9a9ba8b640 1 -- 172.21.15.6:0/3115329385 shutdown_connections 2024-05-04T00:31:39.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.321+0000 7f9a9ba8b640 1 -- 172.21.15.6:0/3115329385 wait complete. 2024-05-04T00:31:39.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.321+0000 7f9a9ba8b640 1 Processor -- start 2024-05-04T00:31:39.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.321+0000 7f9a9ba8b640 1 -- start start 2024-05-04T00:31:39.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.325+0000 7f9a9ba8b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a9406cf90 0x7f9a9415aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:39.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.325+0000 7f9a9ba8b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a940ca420 0x7f9a9414ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:39.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.325+0000 7f9a9ba8b640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a94156650 0x7f9a9414e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:39.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.325+0000 7f9a9ba8b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9415cd60 con 0x7f9a9406cf90 2024-05-04T00:31:39.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.325+0000 7f9a9ba8b640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9415ca80 con 0x7f9a94156650 2024-05-04T00:31:39.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.325+0000 7f9a9ba8b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f9a9406d8e0 con 0x7f9a940ca420 2024-05-04T00:31:39.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.325+0000 7f9a99026640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a940ca420 0x7f9a9414ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:39.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.325+0000 7f9a9a028640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a94156650 0x7f9a9414e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:39.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.325+0000 7f9a99026640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a940ca420 0x7f9a9414ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38416/0 (socket says 172.21.15.6:38416) 2024-05-04T00:31:39.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.325+0000 7f9a99026640 1 -- 172.21.15.6:0/3547078496 learned_addr learned my addr 172.21.15.6:0/3547078496 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:39.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.337+0000 7f9a99026640 1 -- 172.21.15.6:0/3547078496 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a94156650 msgr2=0x7f9a9414e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:39.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.337+0000 7f9a99026640 1 --2- 172.21.15.6:0/3547078496 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a94156650 0x7f9a9414e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:39.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.337+0000 7f9a99026640 1 -- 172.21.15.6:0/3547078496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a9406cf90 msgr2=0x7f9a9415aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:39.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.337+0000 7f9a99026640 1 --2- 172.21.15.6:0/3547078496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a9406cf90 0x7f9a9415aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:39.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.337+0000 7f9a99026640 1 -- 172.21.15.6:0/3547078496 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9415b400 con 0x7f9a940ca420 2024-05-04T00:31:39.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.341+0000 7f9a99026640 1 --2- 172.21.15.6:0/3547078496 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a940ca420 0x7f9a9414ddd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009870 tx=0x7f9a8401bb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:39.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.353+0000 7f9a8a7fc640 1 -- 172.21.15.6:0/3547078496 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a840b5050 con 0x7f9a940ca420 2024-05-04T00:31:39.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.353+0000 7f9a8a7fc640 1 -- 172.21.15.6:0/3547078496 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a840bf070 con 0x7f9a940ca420 2024-05-04T00:31:39.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.353+0000 7f9a8a7fc640 1 -- 172.21.15.6:0/3547078496 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a840b0cd0 con 0x7f9a940ca420 2024-05-04T00:31:39.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.353+0000 7f9a9ba8b640 1 -- 172.21.15.6:0/3547078496 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a941f3310 con 0x7f9a940ca420 2024-05-04T00:31:39.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.353+0000 7f9a9ba8b640 1 -- 172.21.15.6:0/3547078496 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a9414e850 con 0x7f9a940ca420 2024-05-04T00:31:39.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.353+0000 7f9a9ba8b640 1 -- 172.21.15.6:0/3547078496 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a94069a50 con 0x7f9a940ca420 2024-05-04T00:31:39.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.725+0000 7f9a8a7fc640 1 -- 172.21.15.6:0/3547078496 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9a840ba440 con 0x7f9a940ca420 2024-05-04T00:31:39.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.725+0000 7f9a8a7fc640 1 --2- 172.21.15.6:0/3547078496 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f9a7806f480 0x7f9a78071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:39.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.725+0000 7f9a99827640 1 --2- 172.21.15.6:0/3547078496 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f9a7806f480 0x7f9a78071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:39.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.725+0000 7f9a99827640 1 --2- 172.21.15.6:0/3547078496 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f9a7806f480 0x7f9a78071990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9a90009650 tx=0x7f9a90006bb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:39.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.737+0000 7f9a8a7fc640 1 -- 172.21.15.6:0/3547078496 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f9a840f6580 con 0x7f9a940ca420 2024-05-04T00:31:39.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.757+0000 7f9a8a7fc640 1 -- 172.21.15.6:0/3547078496 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9a840c9020 con 0x7f9a940ca420 2024-05-04T00:31:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:39.953+0000 7f9a9ba8b640 1 -- 172.21.15.6:0/3547078496 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a94070d70 con 0x7f9a940ca420 2024-05-04T00:31:40.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.225+0000 7f9a8a7fc640 1 -- 172.21.15.6:0/3547078496 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+16537 (secure 0 0 0) 0x7f9a840188d0 con 0x7f9a940ca420 2024-05-04T00:31:40.228 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:31:40.228 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"ad5951ed-0d5e-4770-b5d9-995e08a00213","created":"2024-05-04T00:30:11.236352+0000","modified":"2024-05-04T00:31:25.449331+0000","last_up_change":"2024-05-04T00:30:35.679943+0000","last_in_change":"2024-05-04T00:30:24.926330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T00:30:36.311072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T00:31:17.278288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T00:31:18.957819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a907d753-b7cf-499c-ae36-81e44ed933a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6805","nonce":489144503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6810","nonce":489144503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6824","nonce":489144503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6813","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6817","nonce":489144503}]},"public_addr":"172.21.15.6:6805/489144503","cluster_addr":"172.21.15.6:6810/489144503","heartbeat_back_addr":"172.21.15.6:6824/489144503","heartbeat_front_addr":"172.21.15.6:6817/489144503","state":["exists","up"]},{"osd":1,"uuid":"eab41a32-d5f1-43b8-8835-f2d4bffc9cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6802","nonce":3099957279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6807","nonce":3099957279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6819","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6823","nonce":3099957279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6815","nonce":3099957279}]},"public_addr":"172.21.15.6:6802/3099957279","cluster_addr":"172.21.15.6:6807/3099957279","heartbeat_back_addr":"172.21.15.6:6823/3099957279","heartbeat_front_addr":"172.21.15.6:6815/3099957279","state":["exists","up"]},{"osd":2,"uuid":"f2540144-b533-4ffc-a9cf-24f0e4910a9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6801","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6806","nonce":2770857903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6809","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6812","nonce":2770857903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6827","nonce":2770857903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6821","nonce":2770857903}]},"public_addr":"172.21.15.6:6806/2770857903","cluster_addr":"172.21.15.6:6812/2770857903","heartbeat_back_addr":"172.21.15.6:6827/2770857903","heartbeat_front_addr":"172.21.15.6:6821/2770857903","state":["exists","up"]},{"osd":3,"uuid":"982b7ace-fd02-4f03-aef2-0428468f8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6818","nonce":3149875909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6826","nonce":3149875909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6831","nonce":3149875909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6829","nonce":3149875909}]},"public_addr":"172.21.15.6:6818/3149875909","cluster_addr":"172.21.15.6:6826/3149875909","heartbeat_back_addr":"172.21.15.6:6831/3149875909","heartbeat_front_addr":"172.21.15.6:6829/3149875909","state":["exists","up"]},{"osd":4,"uuid":"ecf94166-cfdf-4ac8-a659-6ae907686e8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6818","nonce":2508264225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6821","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6824","nonce":2508264225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6833","nonce":2508264225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6831","nonce":2508264225}]},"public_addr":"172.21.15.163:6818/2508264225","cluster_addr":"172.21.15.163:6824/2508264225","heartbeat_back_addr":"172.21.15.163:6833/2508264225","heartbeat_front_addr":"172.21.15.163:6831/2508264225","state":["exists","up"]},{"osd":5,"uuid":"fc5cfa90-0e3a-4fc2-829c-5ff57d7a5953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6815","nonce":167619435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6820","nonce":167619435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6827","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6829","nonce":167619435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6825","nonce":167619435}]},"public_addr":"172.21.15.163:6815/167619435","cluster_addr":"172.21.15.163:6820/167619435","heartbeat_back_addr":"172.21.15.163:6829/167619435","heartbeat_front_addr":"172.21.15.163:6825/167619435","state":["exists","up"]},{"osd":6,"uuid":"ed95f0cf-f309-4861-b47c-4a5a6b44ffdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6811","nonce":1460767610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6813","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6814","nonce":1460767610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6830","nonce":1460767610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6819","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6822","nonce":1460767610}]},"public_addr":"172.21.15.163:6811/1460767610","cluster_addr":"172.21.15.163:6814/1460767610","heartbeat_back_addr":"172.21.15.163:6830/1460767610","heartbeat_front_addr":"172.21.15.163:6822/1460767610","state":["exists","up"]},{"osd":7,"uuid":"2f57afcd-567f-44f6-9db7-df0342c8c4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6803","nonce":239650691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6805","nonce":239650691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6809","nonce":239650691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6807","nonce":239650691}]},"public_addr":"172.21.15.163:6803/239650691","cluster_addr":"172.21.15.163:6805/239650691","heartbeat_back_addr":"172.21.15.163:6809/239650691","heartbeat_front_addr":"172.21.15.163:6807/239650691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.818870+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.749094+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.805522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.576430+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.740084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.755726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.797961+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.577731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T00:31:40.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.229+0000 7f9a9ba8b640 1 -- 172.21.15.6:0/3547078496 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f9a7806f480 msgr2=0x7f9a78071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.229+0000 7f9a9ba8b640 1 --2- 172.21.15.6:0/3547078496 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f9a7806f480 0x7f9a78071990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9a90009650 tx=0x7f9a90006bb0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.229+0000 7f9a9ba8b640 1 -- 172.21.15.6:0/3547078496 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a940ca420 msgr2=0x7f9a9414ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.229+0000 7f9a9ba8b640 1 --2- 172.21.15.6:0/3547078496 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a940ca420 0x7f9a9414ddd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009870 tx=0x7f9a8401bb10 comp rx=0 tx=0).stop 2024-05-04T00:31:40.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.229+0000 7f9a9ba8b640 1 -- 172.21.15.6:0/3547078496 shutdown_connections 2024-05-04T00:31:40.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.229+0000 7f9a9ba8b640 1 --2- 172.21.15.6:0/3547078496 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a94156650 0x7f9a9414e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.229+0000 7f9a9ba8b640 1 --2- 172.21.15.6:0/3547078496 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f9a7806f480 0x7f9a78071990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.229+0000 7f9a9ba8b640 1 --2- 172.21.15.6:0/3547078496 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a940ca420 0x7f9a9414ddd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.229+0000 7f9a9ba8b640 1 --2- 172.21.15.6:0/3547078496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a9406cf90 0x7f9a9415aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.229+0000 7f9a9ba8b640 1 -- 172.21.15.6:0/3547078496 >> 172.21.15.6:0/3547078496 conn(0x7f9a94072ce0 msgr2=0x7f9a94150200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:40.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.229+0000 7f9a9ba8b640 1 -- 172.21.15.6:0/3547078496 shutdown_connections 2024-05-04T00:31:40.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.229+0000 7f9a9ba8b640 1 -- 172.21.15.6:0/3547078496 wait complete. 2024-05-04T00:31:40.254 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-04T00:31:40.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-04T00:31:40.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-04T00:31:40.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-04T00:31:40.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-04T00:31:40.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-04T00:31:40.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-04T00:31:40.257 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-04T00:31:40.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.481+0000 7f9ac638e640 1 Processor -- start 2024-05-04T00:31:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.481+0000 7f9ac638e640 1 -- start start 2024-05-04T00:31:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.481+0000 7f9ac638e640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9ac0072740 0x7f9ac0072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.481+0000 7f9ac638e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ac00c9c20 con 0x7f9ac00c9810 2024-05-04T00:31:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.481+0000 7f9ac638e640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ac015a820 con 0x7f9ac015a410 2024-05-04T00:31:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.481+0000 7f9ac638e640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f9ac00c9ed0 con 0x7f9ac0072740 2024-05-04T00:31:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.485+0000 7f9abffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9ac00c9810 0x7f9ac00c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58486/0 (socket says 172.21.15.6:58486) 2024-05-04T00:31:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.485+0000 7f9abffff640 1 -- 172.21.15.6:0/2857927701 learned_addr learned my addr 172.21.15.6:0/2857927701 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.489+0000 7f9abeffd640 1 -- 172.21.15.6:0/2857927701 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2301674252 0 0) 0x7f9ac00c9c20 con 0x7f9ac00c9810 2024-05-04T00:31:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.489+0000 7f9abeffd640 1 -- 172.21.15.6:0/2857927701 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9aa8003530 con 0x7f9ac00c9810 2024-05-04T00:31:40.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.485+0000 7f803a543640 1 Processor -- start 2024-05-04T00:31:40.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.489+0000 7f803a543640 1 -- start start 2024-05-04T00:31:40.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.489+0000 7f803a543640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f80340c7a10 0x7f8034160dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.489+0000 7f803a543640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8034072ba0 con 0x7f8034168cf0 2024-05-04T00:31:40.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.489+0000 7f803a543640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8034163b10 con 0x7f803415a410 2024-05-04T00:31:40.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.489+0000 7f803a543640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8034073120 con 0x7f80340c7a10 2024-05-04T00:31:40.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.489+0000 7f33c43c6640 1 Processor -- start 2024-05-04T00:31:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.489+0000 7f33c43c6640 1 -- start start 2024-05-04T00:31:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.493+0000 7f33c43c6640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f33bc0c8140 0x7f33bc15bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.493+0000 7f33c43c6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f33bc158930 0x7f33bc072c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.493+0000 7f33c43c6640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33bc073160 0x7f33bc06e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.493+0000 7f33c43c6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f33bc0c9e70 con 0x7f33bc158930 2024-05-04T00:31:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.493+0000 7f33c43c6640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f33bc0ca110 con 0x7f33bc0c8140 2024-05-04T00:31:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.493+0000 7f33c43c6640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f33bc0ca3d0 con 0x7f33bc073160 2024-05-04T00:31:40.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.493+0000 7f9ac492b640 1 --2- 172.21.15.6:0/2857927701 >> v2:172.21.15.163:3300/0 conn(0x7f9ac0072740 0x7f9ac0072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.493+0000 7f33c2963640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33bc073160 0x7f33bc06e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.493+0000 7f80337fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f80340c7a10 0x7f8034160dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.497+0000 7f33c2963640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33bc073160 0x7f33bc06e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38428/0 (socket says 172.21.15.6:38428) 2024-05-04T00:31:40.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.497+0000 7f33c2963640 1 -- 172.21.15.6:0/1247895875 learned_addr learned my addr 172.21.15.6:0/1247895875 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:40.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.497+0000 7f80337fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f80340c7a10 0x7f8034160dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40628/0 (socket says 172.21.15.6:40628) 2024-05-04T00:31:40.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.497+0000 7f80337fe640 1 -- 172.21.15.6:0/565030449 learned_addr learned my addr 172.21.15.6:0/565030449 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:40.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.497+0000 7fb6063d4640 1 Processor -- start 2024-05-04T00:31:40.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.497+0000 7fb6063d4640 1 -- start start 2024-05-04T00:31:40.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7fb6063d4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb6000c9030 0x7fb600071a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7fb6063d4640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb600070c70 0x7fb600071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7fb6063d4640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6000c5910 con 0x7fb60015c3d0 2024-05-04T00:31:40.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7fb6063d4640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb6000c7b90 con 0x7fb6000c9030 2024-05-04T00:31:40.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7fb6063d4640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fb6000c5bb0 con 0x7fb600070c70 2024-05-04T00:31:40.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7f80337fe640 1 -- 172.21.15.6:0/565030449 >> v1:172.21.15.163:6789/0 conn(0x7f803415a410 legacy=0x7f80340c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:40.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7f80337fe640 1 -- 172.21.15.6:0/565030449 >> v1:172.21.15.6:6789/0 conn(0x7f8034168cf0 legacy=0x7f803416b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:40.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7f80337fe640 1 -- 172.21.15.6:0/565030449 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803406d670 con 0x7f80340c7a10 2024-05-04T00:31:40.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7f9abeffd640 1 -- 172.21.15.6:0/2857927701 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2640843966 0 0) 0x7f9aa8003530 con 0x7f9ac00c9810 2024-05-04T00:31:40.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7f9abeffd640 1 -- 172.21.15.6:0/2857927701 >> v2:172.21.15.163:3300/0 conn(0x7f9ac0072740 msgr2=0x7f9ac0072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:40.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7f9abeffd640 1 --2- 172.21.15.6:0/2857927701 >> v2:172.21.15.163:3300/0 conn(0x7f9ac0072740 0x7f9ac0072b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7f9abeffd640 1 -- 172.21.15.6:0/2857927701 >> v1:172.21.15.163:6789/0 conn(0x7f9ac015a410 legacy=0x7f9ac0160dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7f9abeffd640 1 -- 172.21.15.6:0/2857927701 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac00ca1b0 con 0x7f9ac00c9810 2024-05-04T00:31:40.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7f9abeffd640 1 -- 172.21.15.6:0/2857927701 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 557976392 0 0) 0x7f9ab0001700 con 0x7f9ac00c9810 2024-05-04T00:31:40.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7f9abeffd640 1 -- 172.21.15.6:0/2857927701 >> v1:172.21.15.6:6789/0 conn(0x7f9ac00c9810 legacy=0x7f9ac00c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7f9abeffd640 1 --2- 172.21.15.6:0/2857927701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9aa8003a60 0x7f9aa8003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7f9abeffd640 1 --2- 172.21.15.6:0/2857927701 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9aa8004810 0x7f9aa8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7f9abeffd640 1 --2- 172.21.15.6:0/2857927701 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9aa8005280 0x7f9aa800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7f9abeffd640 1 -- 172.21.15.6:0/2857927701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac00c9ed0 con 0x7f9aa8003a60 2024-05-04T00:31:40.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7f9abeffd640 1 -- 172.21.15.6:0/2857927701 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa800c190 con 0x7f9aa8005280 2024-05-04T00:31:40.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.501+0000 7f9abeffd640 1 -- 172.21.15.6:0/2857927701 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f9aa800c390 con 0x7f9aa8004810 2024-05-04T00:31:40.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.505+0000 7f33c2963640 1 -- 172.21.15.6:0/1247895875 >> v2:172.21.15.163:3300/0 conn(0x7f33bc0c8140 msgr2=0x7f33bc15bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:40.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.505+0000 7f33c2963640 1 --2- 172.21.15.6:0/1247895875 >> v2:172.21.15.163:3300/0 conn(0x7f33bc0c8140 0x7f33bc15bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.505+0000 7f33c2963640 1 -- 172.21.15.6:0/1247895875 >> v2:172.21.15.6:3300/0 conn(0x7f33bc158930 msgr2=0x7f33bc072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:40.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.505+0000 7f33c2963640 1 --2- 172.21.15.6:0/1247895875 >> v2:172.21.15.6:3300/0 conn(0x7f33bc158930 0x7f33bc072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.505+0000 7f33c2963640 1 -- 172.21.15.6:0/1247895875 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33bc0ca6b0 con 0x7f33bc073160 2024-05-04T00:31:40.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.505+0000 7f083ea45640 1 Processor -- start 2024-05-04T00:31:40.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.505+0000 7f083ea45640 1 -- start start 2024-05-04T00:31:40.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.509+0000 7f9abf7fe640 1 --2- 172.21.15.6:0/2857927701 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9aa8004810 0x7f9aa8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.509+0000 7f083ea45640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f08380726f0 0x7f0838072b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.509+0000 7f083ea45640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f08380c66a0 0x7f08380c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.509+0000 7f083ea45640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f083815c2e0 con 0x7f0838152f50 2024-05-04T00:31:40.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.509+0000 7f083ea45640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f083815cbd0 con 0x7f08380c66a0 2024-05-04T00:31:40.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.509+0000 7f083ea45640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f08380c71e0 con 0x7f08380726f0 2024-05-04T00:31:40.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.513+0000 7f33c2963640 1 --2- 172.21.15.6:0/1247895875 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33bc073160 0x7f33bc06e470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f33bc06dbd0 tx=0x7f33b801ff40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35f2d5c35b958fa6 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.513+0000 7f80337fe640 1 --2- 172.21.15.6:0/565030449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80340c7a10 0x7f8034160dd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80340cab20 tx=0x7f802801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf98155fd4e9b32e server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.517+0000 7fb5ff7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb6000c9030 0x7fb600071a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.517+0000 7f9abffff640 1 --2- 172.21.15.6:0/2857927701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9aa8003a60 0x7f9aa8003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.517+0000 7fb5fffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb60015c3d0 0x7fb6000c8350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58498/0 (socket says 172.21.15.6:58498) 2024-05-04T00:31:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.517+0000 7fb5fffff640 1 -- 172.21.15.6:0/3541162402 learned_addr learned my addr 172.21.15.6:0/3541162402 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:40.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.517+0000 7fc8d1e60640 1 Processor -- start 2024-05-04T00:31:40.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.517+0000 7fc8d1e60640 1 -- start start 2024-05-04T00:31:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.521+0000 7fc8d1e60640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc8cc070730 0x7fc8cc070b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.521+0000 7fc8d1e60640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8cc0ca150 con 0x7fc8cc0c4350 2024-05-04T00:31:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.521+0000 7fc8d1e60640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8cc0717b0 con 0x7fc8cc15a770 2024-05-04T00:31:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.521+0000 7fc8d1e60640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc8cc0702a0 con 0x7fc8cc070730 2024-05-04T00:31:40.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.525+0000 7fb5ff7fe640 1 -- 172.21.15.6:0/3541162402 >> v2:172.21.15.163:3300/0 conn(0x7fb600070c70 msgr2=0x7fb600071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:40.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.525+0000 7fb5ff7fe640 1 --2- 172.21.15.6:0/3541162402 >> v2:172.21.15.163:3300/0 conn(0x7fb600070c70 0x7fb600071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.525+0000 7fb5ff7fe640 1 -- 172.21.15.6:0/3541162402 >> v1:172.21.15.6:6789/0 conn(0x7fb60015c3d0 legacy=0x7fb6000c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.525+0000 7fb5ff7fe640 1 -- 172.21.15.6:0/3541162402 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6000c5e90 con 0x7fb6000c9030 2024-05-04T00:31:40.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.529+0000 7f1d3c0ac640 1 Processor -- start 2024-05-04T00:31:40.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.529+0000 7f1d3c0ac640 1 -- start start 2024-05-04T00:31:40.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.529+0000 7f9abf7fe640 1 -- 172.21.15.6:0/2857927701 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9aa8005280 msgr2=0x7f9aa800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:40.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.529+0000 7f9abf7fe640 1 --2- 172.21.15.6:0/2857927701 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9aa8005280 0x7f9aa800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.529+0000 7f9abf7fe640 1 -- 172.21.15.6:0/2857927701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9aa8003a60 msgr2=0x7f9aa8003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.529+0000 7f9abf7fe640 1 --2- 172.21.15.6:0/2857927701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9aa8003a60 0x7f9aa8003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.529+0000 7f9abf7fe640 1 -- 172.21.15.6:0/2857927701 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac00ca1b0 con 0x7f9aa8004810 2024-05-04T00:31:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.529+0000 7f9ac492b640 1 -- 172.21.15.6:0/2857927701 reap_dead start 2024-05-04T00:31:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.529+0000 7f1d3c0ac640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d3413f400 0x7f1d34165810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.529+0000 7f1d3c0ac640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d3413f810 con 0x7f1d3413eff0 2024-05-04T00:31:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.529+0000 7f1d3c0ac640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d340c9220 con 0x7f1d340c79e0 2024-05-04T00:31:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.529+0000 7f1d3c0ac640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f1d34159e80 con 0x7f1d3413f400 2024-05-04T00:31:40.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.529+0000 7f8becd22640 1 Processor -- start 2024-05-04T00:31:40.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.529+0000 7f33c1160640 1 -- 172.21.15.6:0/1247895875 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b80b6070 con 0x7f33bc073160 2024-05-04T00:31:40.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.529+0000 7f33c1160640 1 -- 172.21.15.6:0/1247895875 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b80a9d10 con 0x7f33bc073160 2024-05-04T00:31:40.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.529+0000 7f33c1160640 1 -- 172.21.15.6:0/1247895875 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b80b1660 con 0x7f33bc073160 2024-05-04T00:31:40.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f8becd22640 1 -- start start 2024-05-04T00:31:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f33c43c6640 1 -- 172.21.15.6:0/1247895875 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33bc073160 msgr2=0x7f33bc06e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f33c43c6640 1 --2- 172.21.15.6:0/1247895875 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33bc073160 0x7f33bc06e470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f33bc06dbd0 tx=0x7f33b801ff40 comp rx=0 tx=0).stop 2024-05-04T00:31:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f33c43c6640 1 -- 172.21.15.6:0/1247895875 shutdown_connections 2024-05-04T00:31:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f33c43c6640 1 --2- 172.21.15.6:0/1247895875 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33bc073160 0x7f33bc06e470 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f33c43c6640 1 --2- 172.21.15.6:0/1247895875 >> v2:172.21.15.6:3300/0 conn(0x7f33bc158930 0x7f33bc072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f33c43c6640 1 --2- 172.21.15.6:0/1247895875 >> v2:172.21.15.163:3300/0 conn(0x7f33bc0c8140 0x7f33bc15bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f33c43c6640 1 -- 172.21.15.6:0/1247895875 >> 172.21.15.6:0/1247895875 conn(0x7f33bc06c780 msgr2=0x7f33bc06cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f33c43c6640 1 -- 172.21.15.6:0/1247895875 shutdown_connections 2024-05-04T00:31:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f33c43c6640 1 -- 172.21.15.6:0/1247895875 wait complete. 2024-05-04T00:31:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f8becd22640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8be81541f0 0x7f8be8159e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f8becd22640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8be80c5800 0x7f8be80ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f8becd22640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8be815a6c0 con 0x7f8be80c5c10 2024-05-04T00:31:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f8becd22640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8be80c4db0 con 0x7f8be80c5800 2024-05-04T00:31:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f8becd22640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f8be815a9a0 con 0x7f8be81541f0 2024-05-04T00:31:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f8032ffd640 1 -- 172.21.15.6:0/565030449 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80280b5070 con 0x7f80340c7a10 2024-05-04T00:31:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f8032ffd640 1 -- 172.21.15.6:0/565030449 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80280a89b0 con 0x7f80340c7a10 2024-05-04T00:31:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f8032ffd640 1 -- 172.21.15.6:0/565030449 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80280a8d80 con 0x7f80340c7a10 2024-05-04T00:31:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f082ffff640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f08380726f0 0x7f0838072b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f33c43c6640 1 Processor -- start 2024-05-04T00:31:40.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.533+0000 7f33c43c6640 1 -- start start 2024-05-04T00:31:40.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.537+0000 7f803a543640 1 -- 172.21.15.6:0/565030449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80340c7a10 msgr2=0x7f8034160dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.537+0000 7f803a543640 1 --2- 172.21.15.6:0/565030449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80340c7a10 0x7f8034160dd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80340cab20 tx=0x7f802801ed30 comp rx=0 tx=0).stop 2024-05-04T00:31:40.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.537+0000 7f803a543640 1 -- 172.21.15.6:0/565030449 shutdown_connections 2024-05-04T00:31:40.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.537+0000 7f803a543640 1 --2- 172.21.15.6:0/565030449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80340c7a10 0x7f8034160dd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.537+0000 7f803a543640 1 -- 172.21.15.6:0/565030449 >> 172.21.15.6:0/565030449 conn(0x7f803406c780 msgr2=0x7f803406cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.537+0000 7f803a543640 1 -- 172.21.15.6:0/565030449 shutdown_connections 2024-05-04T00:31:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.537+0000 7fc8caffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc8cc070730 0x7fc8cc070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.537+0000 7fc8caffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc8cc070730 0x7fc8cc070b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40678/0 (socket says 172.21.15.6:40678) 2024-05-04T00:31:40.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.537+0000 7fc8caffd640 1 -- 172.21.15.6:0/1396671073 learned_addr learned my addr 172.21.15.6:0/1396671073 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:40.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.537+0000 7f803a543640 1 -- 172.21.15.6:0/565030449 wait complete. 2024-05-04T00:31:40.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.537+0000 7f803a543640 1 Processor -- start 2024-05-04T00:31:40.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.537+0000 7f33c43c6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33bc073160 0x7f33bc1f1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.537+0000 7f33c43c6640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33bc0c8140 0x7f33bc0cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.537+0000 7f33c43c6640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f33bc158930 0x7f33bc149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.537+0000 7f33c43c6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f33bc158d40 con 0x7f33bc073160 2024-05-04T00:31:40.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.537+0000 7f33c43c6640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f33bc15b9e0 con 0x7f33bc158930 2024-05-04T00:31:40.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.537+0000 7f33c43c6640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f33bc06f9d0 con 0x7f33bc0c8140 2024-05-04T00:31:40.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.537+0000 7f9abf7fe640 1 --2- 172.21.15.6:0/2857927701 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9aa8004810 0x7f9aa8004c20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4001790 tx=0x7f9ab401c090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3816f04e739a5f06 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.541+0000 7f082ffff640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f08380726f0 0x7f0838072b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:54928/0 (socket says 172.21.15.6:54928) 2024-05-04T00:31:40.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.541+0000 7f082ffff640 1 -- 172.21.15.6:0/4229577800 learned_addr learned my addr 172.21.15.6:0/4229577800 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:40.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.541+0000 7f083cfe2640 1 --2- 172.21.15.6:0/4229577800 >> v2:172.21.15.6:3300/0 conn(0x7f08380c66a0 0x7f08380c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.537+0000 7f803a543640 1 -- start start 2024-05-04T00:31:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.541+0000 7f803a543640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80340c7a10 0x7f80340c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.541+0000 7f803a543640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f803415a410 0x7f8034155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.541+0000 7f803a543640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8034168cf0 0x7f80341561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.541+0000 7f803a543640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8034164120 con 0x7f80340c7a10 2024-05-04T00:31:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.541+0000 7f803a543640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8034072e40 con 0x7f8034168cf0 2024-05-04T00:31:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.541+0000 7f803a543640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f8034163db0 con 0x7f803415a410 2024-05-04T00:31:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.541+0000 7fc8caffd640 1 -- 172.21.15.6:0/1396671073 >> v1:172.21.15.163:6789/0 conn(0x7fc8cc15a770 legacy=0x7fc8cc153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.541+0000 7fc8caffd640 1 -- 172.21.15.6:0/1396671073 >> v1:172.21.15.6:6789/0 conn(0x7fc8cc0c4350 legacy=0x7fc8cc164670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.541+0000 7fc8caffd640 1 -- 172.21.15.6:0/1396671073 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8cc15ab80 con 0x7fc8cc070730 2024-05-04T00:31:40.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.545+0000 7f083cfe2640 1 -- 172.21.15.6:0/4229577800 >> v2:172.21.15.163:3300/0 conn(0x7f08380726f0 msgr2=0x7f0838072b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:40.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.545+0000 7f083cfe2640 1 --2- 172.21.15.6:0/4229577800 >> v2:172.21.15.163:3300/0 conn(0x7f08380726f0 0x7f0838072b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.545+0000 7f083cfe2640 1 -- 172.21.15.6:0/4229577800 >> v1:172.21.15.163:6789/0 conn(0x7f0838152f50 legacy=0x7f0838073940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:40.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.545+0000 7f083cfe2640 1 -- 172.21.15.6:0/4229577800 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08380c74c0 con 0x7f08380c66a0 2024-05-04T00:31:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.545+0000 7f8bdffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8be80c5800 0x7f8be80ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.545+0000 7f8bdffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8be80c5800 0x7f8be80ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40698/0 (socket says 172.21.15.6:40698) 2024-05-04T00:31:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.545+0000 7f8bdffff640 1 -- 172.21.15.6:0/2910094326 learned_addr learned my addr 172.21.15.6:0/2910094326 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.549+0000 7f1d3a649640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d3413f400 0x7f1d34165810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.549+0000 7fc8caffd640 1 --2- 172.21.15.6:0/1396671073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8cc070730 0x7fc8cc070b40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc071980 tx=0x7fc8c001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62575aa2a0a30797 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.553+0000 7f8bdffff640 1 -- 172.21.15.6:0/2910094326 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8be81541f0 msgr2=0x7f8be8159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.553+0000 7f8bdffff640 1 --2- 172.21.15.6:0/2910094326 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8be81541f0 0x7f8be8159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.553+0000 7f8bdffff640 1 -- 172.21.15.6:0/2910094326 >> v1:172.21.15.163:6789/0 conn(0x7f8be80c5c10 legacy=0x7f8be815d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.553+0000 7f8bdffff640 1 -- 172.21.15.6:0/2910094326 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be815ac80 con 0x7f8be80c5800 2024-05-04T00:31:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.553+0000 7f9abeffd640 1 -- 172.21.15.6:0/2857927701 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40013e0 con 0x7f9aa8004810 2024-05-04T00:31:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.553+0000 7f9abeffd640 1 -- 172.21.15.6:0/2857927701 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab40052d0 con 0x7f9aa8004810 2024-05-04T00:31:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.553+0000 7f9abeffd640 1 -- 172.21.15.6:0/2857927701 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40a4c10 con 0x7f9aa8004810 2024-05-04T00:31:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.553+0000 7f1d3a649640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d3413f400 0x7f1d34165810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40692/0 (socket says 172.21.15.6:40692) 2024-05-04T00:31:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.553+0000 7f1d3a649640 1 -- 172.21.15.6:0/1628853574 learned_addr learned my addr 172.21.15.6:0/1628853574 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.553+0000 7f9ac638e640 1 -- 172.21.15.6:0/2857927701 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9aa8004810 msgr2=0x7f9aa8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.553+0000 7f9ac638e640 1 --2- 172.21.15.6:0/2857927701 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9aa8004810 0x7f9aa8004c20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4001790 tx=0x7f9ab401c090 comp rx=0 tx=0).stop 2024-05-04T00:31:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.553+0000 7f9ac638e640 1 -- 172.21.15.6:0/2857927701 shutdown_connections 2024-05-04T00:31:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.553+0000 7f9ac638e640 1 --2- 172.21.15.6:0/2857927701 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9aa8004810 0x7f9aa8004c20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.553+0000 7f9ac638e640 1 -- 172.21.15.6:0/2857927701 >> 172.21.15.6:0/2857927701 conn(0x7f9ac006c780 msgr2=0x7f9ac006cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.553+0000 7f9ac638e640 1 -- 172.21.15.6:0/2857927701 shutdown_connections 2024-05-04T00:31:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.553+0000 7f9ac638e640 1 -- 172.21.15.6:0/2857927701 wait complete. 2024-05-04T00:31:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.553+0000 7f80337fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f803415a410 0x7f8034155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.557+0000 7f9ac638e640 1 Processor -- start 2024-05-04T00:31:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.557+0000 7f9ac638e640 1 -- start start 2024-05-04T00:31:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.557+0000 7f9ac638e640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9aa8004810 0x7f9ac0158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.557+0000 7f9ac638e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ac01f6860 0x7f9ac01538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.557+0000 7f9ac638e640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ac01588b0 0x7f9ac00c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.557+0000 7f9ac638e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac0164110 con 0x7f9ac01f6860 2024-05-04T00:31:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.557+0000 7f9ac638e640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac0163e30 con 0x7f9aa8004810 2024-05-04T00:31:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.557+0000 7f9ac638e640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac0074000 con 0x7f9ac01588b0 2024-05-04T00:31:40.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.557+0000 7f80337fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f803415a410 0x7f8034155ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38464/0 (socket says 172.21.15.6:38464) 2024-05-04T00:31:40.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.557+0000 7f80337fe640 1 -- 172.21.15.6:0/4151123178 learned_addr learned my addr 172.21.15.6:0/4151123178 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:40.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.557+0000 7f1d3a649640 1 -- 172.21.15.6:0/1628853574 >> v1:172.21.15.163:6789/0 conn(0x7f1d340c79e0 legacy=0x7f1d3415d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:40.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.557+0000 7f1d3a649640 1 -- 172.21.15.6:0/1628853574 >> v1:172.21.15.6:6789/0 conn(0x7f1d3413eff0 legacy=0x7f1d340cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:40.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.557+0000 7f1d3a649640 1 -- 172.21.15.6:0/1628853574 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3413faa0 con 0x7f1d3413f400 2024-05-04T00:31:40.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.557+0000 7f8038ae0640 1 --2- 172.21.15.6:0/4151123178 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8034168cf0 0x7f80341561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.561+0000 7fb5ff7fe640 1 --2- 172.21.15.6:0/3541162402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6000c9030 0x7fb600071a90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb600074d80 tx=0x7fb5f001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6f24dd81feb26e server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.561+0000 7f33c2963640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f33bc158930 0x7f33bc149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.565+0000 7f33c2963640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f33bc158930 0x7f33bc149810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:54940/0 (socket says 172.21.15.6:54940) 2024-05-04T00:31:40.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.565+0000 7f33c2963640 1 -- 172.21.15.6:0/250726030 learned_addr learned my addr 172.21.15.6:0/250726030 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:40.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.569+0000 7fb5feffd640 1 -- 172.21.15.6:0/3541162402 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00b5070 con 0x7fb6000c9030 2024-05-04T00:31:40.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.569+0000 7fb5feffd640 1 -- 172.21.15.6:0/3541162402 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f00a8970 con 0x7fb6000c9030 2024-05-04T00:31:40.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.569+0000 7fb5feffd640 1 -- 172.21.15.6:0/3541162402 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00a8d40 con 0x7fb6000c9030 2024-05-04T00:31:40.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.569+0000 7f9abf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ac01f6860 0x7f9ac01538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.569+0000 7f1d3a649640 1 --2- 172.21.15.6:0/1628853574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d3413f400 0x7f1d34165810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009e50 tx=0x7f1d2c01f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6979b454c477125c server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.569+0000 7fb6063d4640 1 -- 172.21.15.6:0/3541162402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6000c9030 msgr2=0x7fb600071a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.569+0000 7fb6063d4640 1 --2- 172.21.15.6:0/3541162402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6000c9030 0x7fb600071a90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb600074d80 tx=0x7fb5f001ec70 comp rx=0 tx=0).stop 2024-05-04T00:31:40.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.569+0000 7fb6063d4640 1 -- 172.21.15.6:0/3541162402 shutdown_connections 2024-05-04T00:31:40.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.569+0000 7fb6063d4640 1 --2- 172.21.15.6:0/3541162402 >> v2:172.21.15.163:3300/0 conn(0x7fb600070c70 0x7fb600071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.569+0000 7fb6063d4640 1 --2- 172.21.15.6:0/3541162402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6000c9030 0x7fb600071a90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.569+0000 7fb6063d4640 1 -- 172.21.15.6:0/3541162402 >> 172.21.15.6:0/3541162402 conn(0x7fb6000cb310 msgr2=0x7fb6000cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:40.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.569+0000 7f33c2162640 1 --2- 172.21.15.6:0/250726030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33bc073160 0x7f33bc1f1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.569+0000 7fb6063d4640 1 -- 172.21.15.6:0/3541162402 shutdown_connections 2024-05-04T00:31:40.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.569+0000 7fb6063d4640 1 -- 172.21.15.6:0/3541162402 wait complete. 2024-05-04T00:31:40.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.573+0000 7f9abf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ac01f6860 0x7f9ac01538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40726/0 (socket says 172.21.15.6:40726) 2024-05-04T00:31:40.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.573+0000 7f9abf7fe640 1 -- 172.21.15.6:0/831463275 learned_addr learned my addr 172.21.15.6:0/831463275 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:40.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.573+0000 7fb6063d4640 1 Processor -- start 2024-05-04T00:31:40.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.573+0000 7fb6063d4640 1 -- start start 2024-05-04T00:31:40.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.573+0000 7f80337fe640 1 -- 172.21.15.6:0/4151123178 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8034168cf0 msgr2=0x7f80341561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.573+0000 7f80337fe640 1 --2- 172.21.15.6:0/4151123178 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8034168cf0 0x7f80341561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.573+0000 7f80337fe640 1 -- 172.21.15.6:0/4151123178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80340c7a10 msgr2=0x7f80340c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.573+0000 7f80337fe640 1 --2- 172.21.15.6:0/4151123178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80340c7a10 0x7f80340c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.573+0000 7f80337fe640 1 -- 172.21.15.6:0/4151123178 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80341541c0 con 0x7f803415a410 2024-05-04T00:31:40.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.573+0000 7f33c1961640 1 --2- 172.21.15.6:0/250726030 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33bc0c8140 0x7f33bc0cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.573+0000 7fb6063d4640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb600070c70 0x7fb6000cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.573+0000 7fb6063d4640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6000c9030 0x7fb6001517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.573+0000 7fb6063d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb60015c3d0 0x7fb600151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.573+0000 7fb6063d4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb6000c6450 con 0x7fb60015c3d0 2024-05-04T00:31:40.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.573+0000 7fb6063d4640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb6000c7e30 con 0x7fb6000c9030 2024-05-04T00:31:40.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.573+0000 7fb6063d4640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fb6000c65d0 con 0x7fb600070c70 2024-05-04T00:31:40.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.581+0000 7f9abf7fe640 1 -- 172.21.15.6:0/831463275 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ac01588b0 msgr2=0x7f9ac00c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.581+0000 7f9abf7fe640 1 --2- 172.21.15.6:0/831463275 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ac01588b0 0x7f9ac00c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.581+0000 7f9abf7fe640 1 -- 172.21.15.6:0/831463275 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9aa8004810 msgr2=0x7f9ac0158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.581+0000 7f9abf7fe640 1 --2- 172.21.15.6:0/831463275 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9aa8004810 0x7f9ac0158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.581+0000 7f9abf7fe640 1 -- 172.21.15.6:0/831463275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac0069c00 con 0x7f9ac01f6860 2024-05-04T00:31:40.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.581+0000 7f80337fe640 1 --2- 172.21.15.6:0/4151123178 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f803415a410 0x7f8034155ca0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f802801eb60 tx=0x7f802801bad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.581+0000 7f9abf7fe640 1 --2- 172.21.15.6:0/831463275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ac01f6860 0x7f9ac01538f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4000c10 tx=0x7f9ab40191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.585+0000 7f33c2162640 1 -- 172.21.15.6:0/250726030 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33bc0c8140 msgr2=0x7f33bc0cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.585+0000 7f33c2162640 1 --2- 172.21.15.6:0/250726030 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33bc0c8140 0x7f33bc0cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.585+0000 7f33c2162640 1 -- 172.21.15.6:0/250726030 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f33bc158930 msgr2=0x7f33bc149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.585+0000 7f33c2162640 1 --2- 172.21.15.6:0/250726030 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f33bc158930 0x7f33bc149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.585+0000 7f33c2162640 1 -- 172.21.15.6:0/250726030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33bc150200 con 0x7f33bc073160 2024-05-04T00:31:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.593+0000 7f33c2162640 1 --2- 172.21.15.6:0/250726030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33bc073160 0x7f33bc1f1540 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f33b400bda0 tx=0x7f33b400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.597+0000 7fc8ca7fc640 1 -- 172.21.15.6:0/1396671073 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c00b1070 con 0x7fc8cc070730 2024-05-04T00:31:40.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.597+0000 7fc8ca7fc640 1 -- 172.21.15.6:0/1396671073 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c00ac410 con 0x7fc8cc070730 2024-05-04T00:31:40.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.597+0000 7fc8ca7fc640 1 -- 172.21.15.6:0/1396671073 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c00ac7e0 con 0x7fc8cc070730 2024-05-04T00:31:40.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.597+0000 7f1d38e46640 1 -- 172.21.15.6:0/1628853574 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c0b4070 con 0x7f1d3413f400 2024-05-04T00:31:40.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.597+0000 7f1d38e46640 1 -- 172.21.15.6:0/1628853574 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d2c0af400 con 0x7f1d3413f400 2024-05-04T00:31:40.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.597+0000 7f1d38e46640 1 -- 172.21.15.6:0/1628853574 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c0af7d0 con 0x7f1d3413f400 2024-05-04T00:31:40.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.597+0000 7fc8d1e60640 1 -- 172.21.15.6:0/1396671073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8cc070730 msgr2=0x7fc8cc070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.597+0000 7fc8d1e60640 1 --2- 172.21.15.6:0/1396671073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8cc070730 0x7fc8cc070b40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc071980 tx=0x7fc8c001c540 comp rx=0 tx=0).stop 2024-05-04T00:31:40.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.597+0000 7fc8d1e60640 1 -- 172.21.15.6:0/1396671073 shutdown_connections 2024-05-04T00:31:40.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.597+0000 7fc8d1e60640 1 --2- 172.21.15.6:0/1396671073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8cc070730 0x7fc8cc070b40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.597+0000 7fc8d1e60640 1 -- 172.21.15.6:0/1396671073 >> 172.21.15.6:0/1396671073 conn(0x7fc8cc06f4c0 msgr2=0x7fc8cc0723c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:40.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.597+0000 7fc8d1e60640 1 -- 172.21.15.6:0/1396671073 shutdown_connections 2024-05-04T00:31:40.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.597+0000 7fc8d1e60640 1 -- 172.21.15.6:0/1396671073 wait complete. 2024-05-04T00:31:40.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.597+0000 7f1d3c0ac640 1 -- 172.21.15.6:0/1628853574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d3413f400 msgr2=0x7f1d34165810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.597+0000 7f1d3c0ac640 1 --2- 172.21.15.6:0/1628853574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d3413f400 0x7f1d34165810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009e50 tx=0x7f1d2c01f210 comp rx=0 tx=0).stop 2024-05-04T00:31:40.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7f1d3c0ac640 1 -- 172.21.15.6:0/1628853574 shutdown_connections 2024-05-04T00:31:40.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7f1d3c0ac640 1 --2- 172.21.15.6:0/1628853574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d3413f400 0x7f1d34165810 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7f1d3c0ac640 1 -- 172.21.15.6:0/1628853574 >> 172.21.15.6:0/1628853574 conn(0x7f1d3406cb80 msgr2=0x7f1d3406cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:40.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7f1d3c0ac640 1 -- 172.21.15.6:0/1628853574 shutdown_connections 2024-05-04T00:31:40.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7f1d3c0ac640 1 -- 172.21.15.6:0/1628853574 wait complete. 2024-05-04T00:31:40.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7fc8d1e60640 1 Processor -- start 2024-05-04T00:31:40.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7fc8d1e60640 1 -- start start 2024-05-04T00:31:40.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7f1d3c0ac640 1 Processor -- start 2024-05-04T00:31:40.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7f1d3c0ac640 1 -- start start 2024-05-04T00:31:40.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7fc8d1e60640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8cc070730 0x7fc8cc1f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7fc8d1e60640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8cc0c4350 0x7fc8cc159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7fc8d1e60640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc8cc15a770 0x7fc8cc140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7fc8d1e60640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc0c4b70 con 0x7fc8cc0c4350 2024-05-04T00:31:40.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7fc8d1e60640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc0ca3c0 con 0x7fc8cc070730 2024-05-04T00:31:40.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7fc8d1e60640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fc8cc0c4e90 con 0x7fc8cc15a770 2024-05-04T00:31:40.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7f1d3c0ac640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d340c79e0 0x7f1d341568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7f1d3c0ac640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d3413eff0 0x7f1d34155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7f1d3c0ac640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d3413f400 0x7f1d34140c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7f1d3c0ac640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3415a420 con 0x7f1d3413f400 2024-05-04T00:31:40.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7f1d3c0ac640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3415a140 con 0x7f1d3413eff0 2024-05-04T00:31:40.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.601+0000 7f1d3c0ac640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f1d3415a700 con 0x7f1d340c79e0 2024-05-04T00:31:40.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.605+0000 7f083cfe2640 1 --2- 172.21.15.6:0/4229577800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08380c66a0 0x7f08380c6ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f083815cd50 tx=0x7f083001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebaa02ea1eb1e3b server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.605+0000 7f33b2ffd640 1 -- 172.21.15.6:0/250726030 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4019070 con 0x7f33bc073160 2024-05-04T00:31:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.605+0000 7f33b2ffd640 1 -- 172.21.15.6:0/250726030 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b4014440 con 0x7f33bc073160 2024-05-04T00:31:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.605+0000 7f33c43c6640 1 -- 172.21.15.6:0/250726030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33bc1504e0 con 0x7f33bc073160 2024-05-04T00:31:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.605+0000 7f33c43c6640 1 -- 172.21.15.6:0/250726030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33bc150aa0 con 0x7f33bc073160 2024-05-04T00:31:40.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.605+0000 7fb604971640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb60015c3d0 0x7fb600151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.605+0000 7f33c43c6640 1 -- 172.21.15.6:0/250726030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f33bc0508f0 con 0x7f33bc073160 2024-05-04T00:31:40.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.605+0000 7f33b2ffd640 1 -- 172.21.15.6:0/250726030 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4014830 con 0x7f33bc073160 2024-05-04T00:31:40.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7fb5fffff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb600070c70 0x7fb6000cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7fb5fffff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb600070c70 0x7fb6000cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38494/0 (socket says 172.21.15.6:38494) 2024-05-04T00:31:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7fb5fffff640 1 -- 172.21.15.6:0/3571920726 learned_addr learned my addr 172.21.15.6:0/3571920726 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:40.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7f08377fe640 1 -- 172.21.15.6:0/4229577800 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08300b2070 con 0x7f08380c66a0 2024-05-04T00:31:40.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7f08377fe640 1 -- 172.21.15.6:0/4229577800 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08300a5780 con 0x7f08380c66a0 2024-05-04T00:31:40.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7f08377fe640 1 -- 172.21.15.6:0/4229577800 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08300a5b50 con 0x7f08380c66a0 2024-05-04T00:31:40.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7f8030ff9640 1 -- 172.21.15.6:0/4151123178 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80280b5050 con 0x7f803415a410 2024-05-04T00:31:40.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7f8030ff9640 1 -- 172.21.15.6:0/4151123178 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80280bf070 con 0x7f803415a410 2024-05-04T00:31:40.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7f803a543640 1 -- 172.21.15.6:0/4151123178 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80340c6270 con 0x7f803415a410 2024-05-04T00:31:40.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7fc8cb7fe640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8cc070730 0x7fc8cc1f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7f083ea45640 1 -- 172.21.15.6:0/4229577800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08380c66a0 msgr2=0x7f08380c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7f083ea45640 1 --2- 172.21.15.6:0/4229577800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08380c66a0 0x7f08380c6ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f083815cd50 tx=0x7f083001c8f0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7f8030ff9640 1 -- 172.21.15.6:0/4151123178 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80280b0c50 con 0x7f803415a410 2024-05-04T00:31:40.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7f083ea45640 1 -- 172.21.15.6:0/4229577800 shutdown_connections 2024-05-04T00:31:40.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7f083ea45640 1 --2- 172.21.15.6:0/4229577800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08380c66a0 0x7f08380c6ab0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7f083ea45640 1 --2- 172.21.15.6:0/4229577800 >> v2:172.21.15.163:3300/0 conn(0x7f08380726f0 0x7f0838072b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7f083ea45640 1 -- 172.21.15.6:0/4229577800 >> 172.21.15.6:0/4229577800 conn(0x7f083806cf70 msgr2=0x7f08380c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:40.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7f803a543640 1 -- 172.21.15.6:0/4151123178 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f80341627f0 con 0x7f803415a410 2024-05-04T00:31:40.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7f083ea45640 1 -- 172.21.15.6:0/4229577800 shutdown_connections 2024-05-04T00:31:40.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.609+0000 7f083ea45640 1 -- 172.21.15.6:0/4229577800 wait complete. 2024-05-04T00:31:40.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.613+0000 7f803a543640 1 -- 172.21.15.6:0/4151123178 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f80340c5600 con 0x7f803415a410 2024-05-04T00:31:40.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.613+0000 7f083ea45640 1 Processor -- start 2024-05-04T00:31:40.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.613+0000 7f083ea45640 1 -- start start 2024-05-04T00:31:40.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.613+0000 7fb5ff7fe640 1 --2- 172.21.15.6:0/3571920726 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6000c9030 0x7fb6001517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.613+0000 7fc8cb7fe640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8cc070730 0x7fc8cc1f3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:54976/0 (socket says 172.21.15.6:54976) 2024-05-04T00:31:40.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.613+0000 7fc8cb7fe640 1 -- 172.21.15.6:0/2822222747 learned_addr learned my addr 172.21.15.6:0/2822222747 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:40.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.613+0000 7f083ea45640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08380726f0 0x7f0838162180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.613+0000 7f083ea45640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08380c66a0 0x7f0838136d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.613+0000 7f083ea45640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0838152f50 0x7f08381516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.613+0000 7f083ea45640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f083815d1e0 con 0x7f0838152f50 2024-05-04T00:31:40.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.613+0000 7f083ea45640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f083815d060 con 0x7f08380726f0 2024-05-04T00:31:40.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.613+0000 7f083ea45640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f0838070900 con 0x7f08380c66a0 2024-05-04T00:31:40.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.617+0000 7fc8cbfff640 1 --2- 172.21.15.6:0/2822222747 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc8cc15a770 0x7fc8cc140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.617+0000 7f9abcff9640 1 -- 172.21.15.6:0/831463275 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40013c0 con 0x7f9ac01f6860 2024-05-04T00:31:40.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.617+0000 7f9abcff9640 1 -- 172.21.15.6:0/831463275 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab4005480 con 0x7f9ac01f6860 2024-05-04T00:31:40.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.617+0000 7f9ac638e640 1 -- 172.21.15.6:0/831463275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac0159630 con 0x7f9ac01f6860 2024-05-04T00:31:40.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.617+0000 7f9abcff9640 1 -- 172.21.15.6:0/831463275 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4003bc0 con 0x7f9ac01f6860 2024-05-04T00:31:40.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.617+0000 7f9ac638e640 1 -- 172.21.15.6:0/831463275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac00cbfa0 con 0x7f9ac01f6860 2024-05-04T00:31:40.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.617+0000 7f9ac638e640 1 -- 172.21.15.6:0/831463275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9ac01e9790 con 0x7f9ac01f6860 2024-05-04T00:31:40.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.621+0000 7fb604971640 1 -- 172.21.15.6:0/3571920726 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb600070c70 msgr2=0x7fb6000cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.621+0000 7fb604971640 1 --2- 172.21.15.6:0/3571920726 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb600070c70 0x7fb6000cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.621+0000 7fb604971640 1 -- 172.21.15.6:0/3571920726 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6000c9030 msgr2=0x7fb6001517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.621+0000 7fb604971640 1 --2- 172.21.15.6:0/3571920726 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6000c9030 0x7fb6001517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.621+0000 7fb604971640 1 -- 172.21.15.6:0/3571920726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6000cce10 con 0x7fb60015c3d0 2024-05-04T00:31:40.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.625+0000 7f8bdffff640 1 --2- 172.21.15.6:0/2910094326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be80c5800 0x7f8be80ca420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0009870 tx=0x7f8bd001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ae51827a1aa238 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.625+0000 7fb604971640 1 --2- 172.21.15.6:0/3571920726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb60015c3d0 0x7fb600151d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800be20 tx=0x7fb5f800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.629+0000 7fc8caffd640 1 --2- 172.21.15.6:0/2822222747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8cc0c4350 0x7fc8cc159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.629+0000 7f1d39647640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d3413eff0 0x7f1d34155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.641+0000 7fc8cb7fe640 1 -- 172.21.15.6:0/2822222747 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc8cc15a770 msgr2=0x7fc8cc140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.641+0000 7fc8cb7fe640 1 --2- 172.21.15.6:0/2822222747 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc8cc15a770 0x7fc8cc140a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.641+0000 7fc8cb7fe640 1 -- 172.21.15.6:0/2822222747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8cc0c4350 msgr2=0x7fc8cc159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.641+0000 7fc8cb7fe640 1 --2- 172.21.15.6:0/2822222747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8cc0c4350 0x7fc8cc159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.641+0000 7fc8cb7fe640 1 -- 172.21.15.6:0/2822222747 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8cc1f3e50 con 0x7fc8cc070730 2024-05-04T00:31:40.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.645+0000 7f8be5d9b640 1 -- 172.21.15.6:0/2910094326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd00b0070 con 0x7f8be80c5800 2024-05-04T00:31:40.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.645+0000 7f8be5d9b640 1 -- 172.21.15.6:0/2910094326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bd00ab600 con 0x7f8be80c5800 2024-05-04T00:31:40.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.645+0000 7f8be5d9b640 1 -- 172.21.15.6:0/2910094326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd00ab9d0 con 0x7f8be80c5800 2024-05-04T00:31:40.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.645+0000 7f1d3a649640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d3413f400 0x7f1d34140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.645+0000 7f8becd22640 1 -- 172.21.15.6:0/2910094326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be80c5800 msgr2=0x7f8be80ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.645+0000 7f8becd22640 1 --2- 172.21.15.6:0/2910094326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be80c5800 0x7f8be80ca420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0009870 tx=0x7f8bd001c560 comp rx=0 tx=0).stop 2024-05-04T00:31:40.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.645+0000 7f8becd22640 1 -- 172.21.15.6:0/2910094326 shutdown_connections 2024-05-04T00:31:40.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.645+0000 7f8becd22640 1 --2- 172.21.15.6:0/2910094326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be80c5800 0x7f8be80ca420 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.645+0000 7f8becd22640 1 --2- 172.21.15.6:0/2910094326 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8be81541f0 0x7f8be8159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.645+0000 7f8becd22640 1 -- 172.21.15.6:0/2910094326 >> 172.21.15.6:0/2910094326 conn(0x7f8be8072ce0 msgr2=0x7f8be80704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:40.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.645+0000 7f8becd22640 1 -- 172.21.15.6:0/2910094326 shutdown_connections 2024-05-04T00:31:40.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.645+0000 7f8becd22640 1 -- 172.21.15.6:0/2910094326 wait complete. 2024-05-04T00:31:40.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.645+0000 7f8becd22640 1 Processor -- start 2024-05-04T00:31:40.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.645+0000 7f8becd22640 1 -- start start 2024-05-04T00:31:40.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.649+0000 7f8becd22640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8be80c5800 0x7f8be80cd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.649+0000 7f8becd22640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8be80c5c10 0x7f8be8147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.649+0000 7f8becd22640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be81541f0 0x7f8be8147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.649+0000 7f8becd22640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8be8070de0 con 0x7f8be81541f0 2024-05-04T00:31:40.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.649+0000 7f8becd22640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8be80cb800 con 0x7f8be80c5c10 2024-05-04T00:31:40.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.649+0000 7f8becd22640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f8be8070f60 con 0x7f8be80c5800 2024-05-04T00:31:40.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.649+0000 7fc8cb7fe640 1 --2- 172.21.15.6:0/2822222747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8cc070730 0x7fc8cc1f3910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800b3e0 tx=0x7fc8b800b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.649+0000 7f1d39647640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d3413eff0 0x7f1d34155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:54992/0 (socket says 172.21.15.6:54992) 2024-05-04T00:31:40.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.649+0000 7f1d39647640 1 -- 172.21.15.6:0/26471796 learned_addr learned my addr 172.21.15.6:0/26471796 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.657+0000 7fb5fcff9640 1 -- 172.21.15.6:0/3571920726 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8019070 con 0x7fb60015c3d0 2024-05-04T00:31:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.657+0000 7fb5fcff9640 1 -- 172.21.15.6:0/3571920726 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f8014440 con 0x7fb60015c3d0 2024-05-04T00:31:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.657+0000 7fb6063d4640 1 -- 172.21.15.6:0/3571920726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb600147fc0 con 0x7fb60015c3d0 2024-05-04T00:31:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.657+0000 7fb5fcff9640 1 -- 172.21.15.6:0/3571920726 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8014830 con 0x7fb60015c3d0 2024-05-04T00:31:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.657+0000 7fb6063d4640 1 -- 172.21.15.6:0/3571920726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6001526d0 con 0x7fb60015c3d0 2024-05-04T00:31:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.657+0000 7fb6063d4640 1 -- 172.21.15.6:0/3571920726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb600069a50 con 0x7fb60015c3d0 2024-05-04T00:31:40.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.657+0000 7f1d39e48640 1 --2- 172.21.15.6:0/26471796 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d340c79e0 0x7f1d341568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.665+0000 7f1d39647640 1 -- 172.21.15.6:0/26471796 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d340c79e0 msgr2=0x7f1d341568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.665+0000 7f1d39647640 1 --2- 172.21.15.6:0/26471796 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d340c79e0 0x7f1d341568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.665+0000 7f1d39647640 1 -- 172.21.15.6:0/26471796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d3413f400 msgr2=0x7f1d34140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.665+0000 7f1d39647640 1 --2- 172.21.15.6:0/26471796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d3413f400 0x7f1d34140c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.665+0000 7f1d39647640 1 -- 172.21.15.6:0/26471796 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d341407d0 con 0x7f1d3413eff0 2024-05-04T00:31:40.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.673+0000 7f9abcff9640 1 -- 172.21.15.6:0/831463275 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9ab40bb060 con 0x7f9ac01f6860 2024-05-04T00:31:40.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.673+0000 7f9abcff9640 1 --2- 172.21.15.6:0/831463275 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f9aac06f430 0x7f9aac071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.673+0000 7f9abffff640 1 --2- 172.21.15.6:0/831463275 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f9aac06f430 0x7f9aac071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.673+0000 7f9abffff640 1 --2- 172.21.15.6:0/831463275 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f9aac06f430 0x7f9aac071940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0007d30 tx=0x7f9ab0000f40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.677+0000 7f9abcff9640 1 -- 172.21.15.6:0/831463275 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f9ab4126c70 con 0x7f9ac01f6860 2024-05-04T00:31:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.677+0000 7fc8b7fff640 1 -- 172.21.15.6:0/2822222747 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8015020 con 0x7fc8cc070730 2024-05-04T00:31:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.677+0000 7f9abcff9640 1 --2- 172.21.15.6:0/831463275 >> [v2:172.21.15.6:6801/2770857903,v1:172.21.15.6:6806/2770857903] conn(0x7f9aac077680 0x7f9aac079ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.677+0000 7f9abcff9640 1 -- 172.21.15.6:0/831463275 --> [v2:172.21.15.6:6801/2770857903,v1:172.21.15.6:6806/2770857903] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ab400bf30 con 0x7f9aac077680 2024-05-04T00:31:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.677+0000 7fc8b7fff640 1 -- 172.21.15.6:0/2822222747 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b8011850 con 0x7fc8cc070730 2024-05-04T00:31:40.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.677+0000 7f9abcff9640 1 -- 172.21.15.6:0/831463275 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9ab40f1470 con 0x7f9ac01f6860 2024-05-04T00:31:40.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.677+0000 7f9ac492b640 1 --2- 172.21.15.6:0/831463275 >> [v2:172.21.15.6:6801/2770857903,v1:172.21.15.6:6806/2770857903] conn(0x7f9aac077680 0x7f9aac079ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.677+0000 7fc8b7fff640 1 -- 172.21.15.6:0/2822222747 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8011c40 con 0x7fc8cc070730 2024-05-04T00:31:40.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.677+0000 7fc8d1e60640 1 -- 172.21.15.6:0/2822222747 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8cc1f3430 con 0x7fc8cc070730 2024-05-04T00:31:40.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.677+0000 7fc8d1e60640 1 -- 172.21.15.6:0/2822222747 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8cc1f7440 con 0x7fc8cc070730 2024-05-04T00:31:40.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.677+0000 7f9ac492b640 1 --2- 172.21.15.6:0/831463275 >> [v2:172.21.15.6:6801/2770857903,v1:172.21.15.6:6806/2770857903] conn(0x7f9aac077680 0x7f9aac079ad0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.677+0000 7fc8d1e60640 1 -- 172.21.15.6:0/2822222747 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc8cc1f7270 con 0x7fc8cc070730 2024-05-04T00:31:40.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.677+0000 7f9abcff9640 1 -- 172.21.15.6:0/831463275 <== osd.2 v2:172.21.15.6:6801/2770857903 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ab400bf30 con 0x7f9aac077680 2024-05-04T00:31:40.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.681+0000 7f1d39647640 1 --2- 172.21.15.6:0/26471796 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d3413eff0 0x7f1d34155aa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400b3c0 tx=0x7f1d2400b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.693+0000 7f9ac638e640 1 -- 172.21.15.6:0/831463275 --> [v2:172.21.15.6:6801/2770857903,v1:172.21.15.6:6806/2770857903] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9ac01fa9a0 con 0x7f9aac077680 2024-05-04T00:31:40.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.693+0000 7f9abcff9640 1 -- 172.21.15.6:0/831463275 <== osd.2 v2:172.21.15.6:6801/2770857903 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9ac01fa9a0 con 0x7f9aac077680 2024-05-04T00:31:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.693+0000 7f9ac638e640 1 -- 172.21.15.6:0/831463275 >> [v2:172.21.15.6:6801/2770857903,v1:172.21.15.6:6806/2770857903] conn(0x7f9aac077680 msgr2=0x7f9aac079ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.693+0000 7f9ac638e640 1 --2- 172.21.15.6:0/831463275 >> [v2:172.21.15.6:6801/2770857903,v1:172.21.15.6:6806/2770857903] conn(0x7f9aac077680 0x7f9aac079ad0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.693+0000 7f9ac638e640 1 -- 172.21.15.6:0/831463275 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f9aac06f430 msgr2=0x7f9aac071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.693+0000 7f9ac638e640 1 --2- 172.21.15.6:0/831463275 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f9aac06f430 0x7f9aac071940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0007d30 tx=0x7f9ab0000f40 comp rx=0 tx=0).stop 2024-05-04T00:31:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.693+0000 7f9ac638e640 1 -- 172.21.15.6:0/831463275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ac01f6860 msgr2=0x7f9ac01538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.693+0000 7f9ac638e640 1 --2- 172.21.15.6:0/831463275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ac01f6860 0x7f9ac01538f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4000c10 tx=0x7f9ab40191a0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.693+0000 7f9ac492b640 1 -- 172.21.15.6:0/831463275 reap_dead start 2024-05-04T00:31:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.693+0000 7f9ac638e640 1 -- 172.21.15.6:0/831463275 shutdown_connections 2024-05-04T00:31:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.693+0000 7f9ac638e640 1 -- 172.21.15.6:0/831463275 >> 172.21.15.6:0/831463275 conn(0x7f9ac006c780 msgr2=0x7f9ac00c5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.693+0000 7f9ac638e640 1 -- 172.21.15.6:0/831463275 shutdown_connections 2024-05-04T00:31:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.693+0000 7f9ac638e640 1 -- 172.21.15.6:0/831463275 wait complete. 2024-05-04T00:31:40.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.705+0000 7f083cfe2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0838152f50 0x7f08381516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.705+0000 7f33b2ffd640 1 -- 172.21.15.6:0/250726030 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f33b401c070 con 0x7f33bc073160 2024-05-04T00:31:40.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.705+0000 7f33b2ffd640 1 --2- 172.21.15.6:0/250726030 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f33a006f450 0x7f33a0071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.705+0000 7f33c1961640 1 --2- 172.21.15.6:0/250726030 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f33a006f450 0x7f33a0071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.705+0000 7f33c1961640 1 --2- 172.21.15.6:0/250726030 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f33a006f450 0x7f33a0071960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f33bc1524e0 tx=0x7f33ac006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.709+0000 7f33b2ffd640 1 -- 172.21.15.6:0/250726030 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f33b4058450 con 0x7f33bc073160 2024-05-04T00:31:40.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.709+0000 7f33b2ffd640 1 --2- 172.21.15.6:0/250726030 >> [v2:172.21.15.6:6803/489144503,v1:172.21.15.6:6805/489144503] conn(0x7f33a00776a0 0x7f33a0079af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.713 INFO:teuthology.orchestra.run.smithi006.stdout:64424509459 2024-05-04T00:31:40.713 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-04T00:31:40.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.709+0000 7f33b2ffd640 1 -- 172.21.15.6:0/250726030 --> [v2:172.21.15.6:6803/489144503,v1:172.21.15.6:6805/489144503] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f33b4010e50 con 0x7f33a00776a0 2024-05-04T00:31:40.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.709+0000 7f33b2ffd640 1 -- 172.21.15.6:0/250726030 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f33b4058810 con 0x7f33bc073160 2024-05-04T00:31:40.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.709+0000 7f33c2963640 1 --2- 172.21.15.6:0/250726030 >> [v2:172.21.15.6:6803/489144503,v1:172.21.15.6:6805/489144503] conn(0x7f33a00776a0 0x7f33a0079af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.709+0000 7f33c2963640 1 --2- 172.21.15.6:0/250726030 >> [v2:172.21.15.6:6803/489144503,v1:172.21.15.6:6805/489144503] conn(0x7f33a00776a0 0x7f33a0079af0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.713+0000 7f33b2ffd640 1 -- 172.21.15.6:0/250726030 <== osd.0 v2:172.21.15.6:6803/489144503 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f33b4010e50 con 0x7f33a00776a0 2024-05-04T00:31:40.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.717+0000 7f8030ff9640 1 -- 172.21.15.6:0/4151123178 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f80280c4460 con 0x7f803415a410 2024-05-04T00:31:40.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.717+0000 7f8030ff9640 1 --2- 172.21.15.6:0/4151123178 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f802006f450 0x7f8020071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.717+0000 7f8033fff640 1 --2- 172.21.15.6:0/4151123178 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f802006f450 0x7f8020071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.721+0000 7f8033fff640 1 --2- 172.21.15.6:0/4151123178 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f802006f450 0x7f8020071960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8024009650 tx=0x7f8024006bb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.725+0000 7fb5fcff9640 1 -- 172.21.15.6:0/3571920726 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb5f801c070 con 0x7fb60015c3d0 2024-05-04T00:31:40.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.725+0000 7fb5fcff9640 1 --2- 172.21.15.6:0/3571920726 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb5ec06f400 0x7fb5ec071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7fb5fffff640 1 --2- 172.21.15.6:0/3571920726 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb5ec06f400 0x7fb5ec071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f8030ff9640 1 -- 172.21.15.6:0/4151123178 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f80280b0df0 con 0x7f803415a410 2024-05-04T00:31:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f8030ff9640 1 --2- 172.21.15.6:0/4151123178 >> [v2:172.21.15.163:6816/2508264225,v1:172.21.15.163:6818/2508264225] conn(0x7f80200776a0 0x7f8020079af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f8030ff9640 1 -- 172.21.15.6:0/4151123178 --> [v2:172.21.15.163:6816/2508264225,v1:172.21.15.163:6818/2508264225] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8028007e50 con 0x7f80200776a0 2024-05-04T00:31:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f33c43c6640 1 -- 172.21.15.6:0/250726030 --> [v2:172.21.15.6:6803/489144503,v1:172.21.15.6:6805/489144503] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f33bc072990 con 0x7f33a00776a0 2024-05-04T00:31:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f8038ae0640 1 --2- 172.21.15.6:0/4151123178 >> [v2:172.21.15.163:6816/2508264225,v1:172.21.15.163:6818/2508264225] conn(0x7f80200776a0 0x7f8020079af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f8030ff9640 1 -- 172.21.15.6:0/4151123178 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f80280f66b0 con 0x7f803415a410 2024-05-04T00:31:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f33b2ffd640 1 -- 172.21.15.6:0/250726030 <== osd.0 v2:172.21.15.6:6803/489144503 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f33bc072990 con 0x7f33a00776a0 2024-05-04T00:31:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f33c43c6640 1 -- 172.21.15.6:0/250726030 >> [v2:172.21.15.6:6803/489144503,v1:172.21.15.6:6805/489144503] conn(0x7f33a00776a0 msgr2=0x7f33a0079af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f33c43c6640 1 --2- 172.21.15.6:0/250726030 >> [v2:172.21.15.6:6803/489144503,v1:172.21.15.6:6805/489144503] conn(0x7f33a00776a0 0x7f33a0079af0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f33c43c6640 1 -- 172.21.15.6:0/250726030 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f33a006f450 msgr2=0x7f33a0071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f33c43c6640 1 --2- 172.21.15.6:0/250726030 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f33a006f450 0x7f33a0071960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f33bc1524e0 tx=0x7f33ac006f90 comp rx=0 tx=0).stop 2024-05-04T00:31:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f33c43c6640 1 -- 172.21.15.6:0/250726030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33bc073160 msgr2=0x7f33bc1f1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f33c43c6640 1 --2- 172.21.15.6:0/250726030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33bc073160 0x7f33bc1f1540 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f33b400bda0 tx=0x7f33b400be90 comp rx=0 tx=0).stop 2024-05-04T00:31:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f33c2963640 1 -- 172.21.15.6:0/250726030 reap_dead start 2024-05-04T00:31:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f33c43c6640 1 -- 172.21.15.6:0/250726030 shutdown_connections 2024-05-04T00:31:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f33c43c6640 1 -- 172.21.15.6:0/250726030 >> 172.21.15.6:0/250726030 conn(0x7f33bc06c780 msgr2=0x7f33bc14bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7fb5fffff640 1 --2- 172.21.15.6:0/3571920726 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb5ec06f400 0x7fb5ec071910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4005890 tx=0x7fb5f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f33c43c6640 1 -- 172.21.15.6:0/250726030 shutdown_connections 2024-05-04T00:31:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f33c43c6640 1 -- 172.21.15.6:0/250726030 wait complete. 2024-05-04T00:31:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f8038ae0640 1 --2- 172.21.15.6:0/4151123178 >> [v2:172.21.15.163:6816/2508264225,v1:172.21.15.163:6818/2508264225] conn(0x7f80200776a0 0x7f8020079af0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.729+0000 7f8030ff9640 1 -- 172.21.15.6:0/4151123178 <== osd.4 v2:172.21.15.163:6816/2508264225 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8028007e50 con 0x7f80200776a0 2024-05-04T00:31:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.733+0000 7f083cfe2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0838152f50 0x7f08381516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40752/0 (socket says 172.21.15.6:40752) 2024-05-04T00:31:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.733+0000 7f083cfe2640 1 -- 172.21.15.6:0/490216086 learned_addr learned my addr 172.21.15.6:0/490216086 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:40.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.733+0000 7fb5fcff9640 1 -- 172.21.15.6:0/3571920726 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fb5f808dee0 con 0x7fb60015c3d0 2024-05-04T00:31:40.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.733+0000 7fb5fcff9640 1 --2- 172.21.15.6:0/3571920726 >> [v2:172.21.15.163:6802/239650691,v1:172.21.15.163:6803/239650691] conn(0x7fb5ec077650 0x7fb5ec079aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.733+0000 7fb5fcff9640 1 -- 172.21.15.6:0/3571920726 --> [v2:172.21.15.163:6802/239650691,v1:172.21.15.163:6803/239650691] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5f8010e50 con 0x7fb5ec077650 2024-05-04T00:31:40.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.733+0000 7fb5fcff9640 1 -- 172.21.15.6:0/3571920726 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb5f8058820 con 0x7fb60015c3d0 2024-05-04T00:31:40.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.733+0000 7fb5ff7fe640 1 --2- 172.21.15.6:0/3571920726 >> [v2:172.21.15.163:6802/239650691,v1:172.21.15.163:6803/239650691] conn(0x7fb5ec077650 0x7fb5ec079aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.733+0000 7f082ffff640 1 --2- 172.21.15.6:0/490216086 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08380c66a0 0x7f0838136d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.733+0000 7f8be659c640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8be80c5800 0x7f8be80cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.737+0000 7fb5ff7fe640 1 --2- 172.21.15.6:0/3571920726 >> [v2:172.21.15.163:6802/239650691,v1:172.21.15.163:6803/239650691] conn(0x7fb5ec077650 0x7fb5ec079aa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.737+0000 7fb5fcff9640 1 -- 172.21.15.6:0/3571920726 <== osd.7 v2:172.21.15.163:6802/239650691 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb5f8010e50 con 0x7fb5ec077650 2024-05-04T00:31:40.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.737+0000 7f8be659c640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8be80c5800 0x7f8be80cd730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38542/0 (socket says 172.21.15.6:38542) 2024-05-04T00:31:40.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.737+0000 7f8be659c640 1 -- 172.21.15.6:0/1033129113 learned_addr learned my addr 172.21.15.6:0/1033129113 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.745+0000 7f083cfe2640 1 -- 172.21.15.6:0/490216086 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08380c66a0 msgr2=0x7f0838136d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.745+0000 7f083cfe2640 1 --2- 172.21.15.6:0/490216086 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08380c66a0 0x7f0838136d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.745+0000 7f083cfe2640 1 -- 172.21.15.6:0/490216086 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08380726f0 msgr2=0x7f0838162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.745+0000 7f083cfe2640 1 --2- 172.21.15.6:0/490216086 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08380726f0 0x7f0838162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.745+0000 7f083cfe2640 1 -- 172.21.15.6:0/490216086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0838138120 con 0x7f0838152f50 2024-05-04T00:31:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.745+0000 7f083cfe2640 1 --2- 172.21.15.6:0/490216086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0838152f50 0x7f08381516f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f083001afa0 tx=0x7f0830019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.753+0000 7f8be6d9d640 1 --2- 172.21.15.6:0/1033129113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be81541f0 0x7f8be8147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.759 INFO:teuthology.orchestra.run.smithi006.stdout:64424509458 2024-05-04T00:31:40.760 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-04T00:31:40.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.757+0000 7fc8b7fff640 1 -- 172.21.15.6:0/2822222747 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc8b8018020 con 0x7fc8cc070730 2024-05-04T00:31:40.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.757+0000 7f803a543640 1 -- 172.21.15.6:0/4151123178 --> [v2:172.21.15.163:6816/2508264225,v1:172.21.15.163:6818/2508264225] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f80340508f0 con 0x7f80200776a0 2024-05-04T00:31:40.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.757+0000 7fc8b7fff640 1 --2- 172.21.15.6:0/2822222747 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fc8b006f430 0x7fc8b0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.757+0000 7fc8caffd640 1 --2- 172.21.15.6:0/2822222747 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fc8b006f430 0x7fc8b0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.757+0000 7f8030ff9640 1 -- 172.21.15.6:0/4151123178 <== osd.4 v2:172.21.15.163:6816/2508264225 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f80340508f0 con 0x7f80200776a0 2024-05-04T00:31:40.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.757+0000 7f803a543640 1 -- 172.21.15.6:0/4151123178 >> [v2:172.21.15.163:6816/2508264225,v1:172.21.15.163:6818/2508264225] conn(0x7f80200776a0 msgr2=0x7f8020079af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.757+0000 7f803a543640 1 --2- 172.21.15.6:0/4151123178 >> [v2:172.21.15.163:6816/2508264225,v1:172.21.15.163:6818/2508264225] conn(0x7f80200776a0 0x7f8020079af0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.757+0000 7f803a543640 1 -- 172.21.15.6:0/4151123178 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f802006f450 msgr2=0x7f8020071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.757+0000 7f803a543640 1 --2- 172.21.15.6:0/4151123178 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f802006f450 0x7f8020071960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8024009650 tx=0x7f8024006bb0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.757+0000 7f803a543640 1 -- 172.21.15.6:0/4151123178 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f803415a410 msgr2=0x7f8034155ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.757+0000 7f803a543640 1 --2- 172.21.15.6:0/4151123178 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f803415a410 0x7f8034155ca0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f802801eb60 tx=0x7f802801bad0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.757+0000 7f8038ae0640 1 -- 172.21.15.6:0/4151123178 reap_dead start 2024-05-04T00:31:40.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.757+0000 7f803a543640 1 -- 172.21.15.6:0/4151123178 shutdown_connections 2024-05-04T00:31:40.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.757+0000 7f803a543640 1 -- 172.21.15.6:0/4151123178 >> 172.21.15.6:0/4151123178 conn(0x7f803406c780 msgr2=0x7f80340c8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:40.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.757+0000 7f803a543640 1 -- 172.21.15.6:0/4151123178 shutdown_connections 2024-05-04T00:31:40.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.757+0000 7f803a543640 1 -- 172.21.15.6:0/4151123178 wait complete. 2024-05-04T00:31:40.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.761+0000 7f8be6d9d640 1 -- 172.21.15.6:0/1033129113 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8be80c5800 msgr2=0x7f8be80cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.761+0000 7f8be6d9d640 1 --2- 172.21.15.6:0/1033129113 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8be80c5800 0x7f8be80cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.761+0000 7f8be6d9d640 1 -- 172.21.15.6:0/1033129113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8be80c5c10 msgr2=0x7f8be8147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.761+0000 7f8be6d9d640 1 --2- 172.21.15.6:0/1033129113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8be80c5c10 0x7f8be8147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.761+0000 7fc8caffd640 1 --2- 172.21.15.6:0/2822222747 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fc8b006f430 0x7fc8b0071940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00ae000 tx=0x7fc8c00a6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.761+0000 7fb6063d4640 1 -- 172.21.15.6:0/3571920726 --> [v2:172.21.15.163:6802/239650691,v1:172.21.15.163:6803/239650691] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb6000c8e10 con 0x7fb5ec077650 2024-05-04T00:31:40.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.761+0000 7f8be6d9d640 1 -- 172.21.15.6:0/1033129113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be81454c0 con 0x7f8be81541f0 2024-05-04T00:31:40.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.761+0000 7fb5fcff9640 1 -- 172.21.15.6:0/3571920726 <== osd.7 v2:172.21.15.163:6802/239650691 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb6000c8e10 con 0x7fb5ec077650 2024-05-04T00:31:40.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.761+0000 7fb6063d4640 1 -- 172.21.15.6:0/3571920726 >> [v2:172.21.15.163:6802/239650691,v1:172.21.15.163:6803/239650691] conn(0x7fb5ec077650 msgr2=0x7fb5ec079aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.761+0000 7fb6063d4640 1 --2- 172.21.15.6:0/3571920726 >> [v2:172.21.15.163:6802/239650691,v1:172.21.15.163:6803/239650691] conn(0x7fb5ec077650 0x7fb5ec079aa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.761+0000 7fb6063d4640 1 -- 172.21.15.6:0/3571920726 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb5ec06f400 msgr2=0x7fb5ec071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.761+0000 7fb6063d4640 1 --2- 172.21.15.6:0/3571920726 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb5ec06f400 0x7fb5ec071910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4005890 tx=0x7fb5f4009040 comp rx=0 tx=0).stop 2024-05-04T00:31:40.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.761+0000 7fb6063d4640 1 -- 172.21.15.6:0/3571920726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb60015c3d0 msgr2=0x7fb600151d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.761+0000 7fb6063d4640 1 --2- 172.21.15.6:0/3571920726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb60015c3d0 0x7fb600151d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800be20 tx=0x7fb5f800bf10 comp rx=0 tx=0).stop 2024-05-04T00:31:40.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.761+0000 7fb604971640 1 -- 172.21.15.6:0/3571920726 reap_dead start 2024-05-04T00:31:40.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.761+0000 7fb6063d4640 1 -- 172.21.15.6:0/3571920726 shutdown_connections 2024-05-04T00:31:40.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.761+0000 7fb6063d4640 1 -- 172.21.15.6:0/3571920726 >> 172.21.15.6:0/3571920726 conn(0x7fb6000cb310 msgr2=0x7fb600159240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:40.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.761+0000 7fb6063d4640 1 -- 172.21.15.6:0/3571920726 shutdown_connections 2024-05-04T00:31:40.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.761+0000 7fb6063d4640 1 -- 172.21.15.6:0/3571920726 wait complete. 2024-05-04T00:31:40.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.765+0000 7f8be6d9d640 1 --2- 172.21.15.6:0/1033129113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be81541f0 0x7f8be8147690 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8be000bdf0 tx=0x7f8be0009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.765+0000 7fc8b7fff640 1 -- 172.21.15.6:0/2822222747 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fc8b8011de0 con 0x7fc8cc070730 2024-05-04T00:31:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.765+0000 7fc8b7fff640 1 --2- 172.21.15.6:0/2822222747 >> [v2:172.21.15.163:6812/167619435,v1:172.21.15.163:6815/167619435] conn(0x7fc8b0077680 0x7fc8b0079ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.765+0000 7fc8b7fff640 1 -- 172.21.15.6:0/2822222747 --> [v2:172.21.15.163:6812/167619435,v1:172.21.15.163:6815/167619435] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8b007a1a0 con 0x7fc8b0077680 2024-05-04T00:31:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.769+0000 7fc8cbfff640 1 --2- 172.21.15.6:0/2822222747 >> [v2:172.21.15.163:6812/167619435,v1:172.21.15.163:6815/167619435] conn(0x7fc8b0077680 0x7fc8b0079ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.769+0000 7fc8cbfff640 1 --2- 172.21.15.6:0/2822222747 >> [v2:172.21.15.163:6812/167619435,v1:172.21.15.163:6815/167619435] conn(0x7fc8b0077680 0x7fc8b0079ad0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.769+0000 7fc8b7fff640 1 -- 172.21.15.6:0/2822222747 <== osd.5 v2:172.21.15.163:6812/167619435 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc8b007a1a0 con 0x7fc8b0077680 2024-05-04T00:31:40.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.773+0000 7f08357fa640 1 -- 172.21.15.6:0/490216086 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08300b2070 con 0x7f0838152f50 2024-05-04T00:31:40.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.773+0000 7f08357fa640 1 -- 172.21.15.6:0/490216086 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08300bf070 con 0x7f0838152f50 2024-05-04T00:31:40.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.773+0000 7f083ea45640 1 -- 172.21.15.6:0/490216086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08381f8f10 con 0x7f0838152f50 2024-05-04T00:31:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.773+0000 7f08357fa640 1 -- 172.21.15.6:0/490216086 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08300b98d0 con 0x7f0838152f50 2024-05-04T00:31:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.773+0000 7f083ea45640 1 -- 172.21.15.6:0/490216086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0838162ba0 con 0x7f0838152f50 2024-05-04T00:31:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.773+0000 7f8bdeffd640 1 -- 172.21.15.6:0/1033129113 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0019070 con 0x7f8be81541f0 2024-05-04T00:31:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.773+0000 7f8bdeffd640 1 -- 172.21.15.6:0/1033129113 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be0014440 con 0x7f8be81541f0 2024-05-04T00:31:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.773+0000 7f8becd22640 1 -- 172.21.15.6:0/1033129113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be8144ae0 con 0x7f8be81541f0 2024-05-04T00:31:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.773+0000 7f8bdeffd640 1 -- 172.21.15.6:0/1033129113 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0014830 con 0x7f8be81541f0 2024-05-04T00:31:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.773+0000 7f8becd22640 1 -- 172.21.15.6:0/1033129113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be806cb00 con 0x7f8be81541f0 2024-05-04T00:31:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.777+0000 7fc8b7fff640 1 -- 172.21.15.6:0/2822222747 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc8b8058600 con 0x7fc8cc070730 2024-05-04T00:31:40.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.781+0000 7f8becd22640 1 -- 172.21.15.6:0/1033129113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8be8069a50 con 0x7f8be81541f0 2024-05-04T00:31:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.781+0000 7f083ea45640 1 -- 172.21.15.6:0/490216086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f083806a390 con 0x7f0838152f50 2024-05-04T00:31:40.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.781+0000 7f1d2a7fc640 1 -- 172.21.15.6:0/26471796 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d24011830 con 0x7f1d3413eff0 2024-05-04T00:31:40.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.781+0000 7f1d2a7fc640 1 -- 172.21.15.6:0/26471796 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d24016070 con 0x7f1d3413eff0 2024-05-04T00:31:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.781+0000 7f1d2a7fc640 1 -- 172.21.15.6:0/26471796 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d24011bf0 con 0x7f1d3413eff0 2024-05-04T00:31:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.785+0000 7f1d3c0ac640 1 -- 172.21.15.6:0/26471796 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d341f10f0 con 0x7f1d3413eff0 2024-05-04T00:31:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.785+0000 7f1d3c0ac640 1 -- 172.21.15.6:0/26471796 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d341f16b0 con 0x7f1d3413eff0 2024-05-04T00:31:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.785+0000 7f1d3c0ac640 1 -- 172.21.15.6:0/26471796 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1d34156e30 con 0x7f1d3413eff0 2024-05-04T00:31:40.792 INFO:teuthology.orchestra.run.smithi006.stdout:64424509458 2024-05-04T00:31:40.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-04T00:31:40.794 INFO:teuthology.orchestra.run.smithi006.stdout:60129542162 2024-05-04T00:31:40.794 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-04T00:31:40.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.801+0000 7fc8d1e60640 1 -- 172.21.15.6:0/2822222747 --> [v2:172.21.15.163:6812/167619435,v1:172.21.15.163:6815/167619435] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc8cc069a50 con 0x7fc8b0077680 2024-05-04T00:31:40.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.801+0000 7fc8b7fff640 1 -- 172.21.15.6:0/2822222747 <== osd.5 v2:172.21.15.163:6812/167619435 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc8cc069a50 con 0x7fc8b0077680 2024-05-04T00:31:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.801+0000 7fc8d1e60640 1 -- 172.21.15.6:0/2822222747 >> [v2:172.21.15.163:6812/167619435,v1:172.21.15.163:6815/167619435] conn(0x7fc8b0077680 msgr2=0x7fc8b0079ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.801+0000 7fc8d1e60640 1 --2- 172.21.15.6:0/2822222747 >> [v2:172.21.15.163:6812/167619435,v1:172.21.15.163:6815/167619435] conn(0x7fc8b0077680 0x7fc8b0079ad0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.801+0000 7fc8d1e60640 1 -- 172.21.15.6:0/2822222747 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fc8b006f430 msgr2=0x7fc8b0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.801+0000 7fc8d1e60640 1 --2- 172.21.15.6:0/2822222747 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fc8b006f430 0x7fc8b0071940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00ae000 tx=0x7fc8c00a6040 comp rx=0 tx=0).stop 2024-05-04T00:31:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.801+0000 7fc8d1e60640 1 -- 172.21.15.6:0/2822222747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8cc070730 msgr2=0x7fc8cc1f3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.801+0000 7fc8d1e60640 1 --2- 172.21.15.6:0/2822222747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8cc070730 0x7fc8cc1f3910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800b3e0 tx=0x7fc8b800b8a0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.801+0000 7fc8cbfff640 1 -- 172.21.15.6:0/2822222747 reap_dead start 2024-05-04T00:31:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.801+0000 7fc8d1e60640 1 -- 172.21.15.6:0/2822222747 shutdown_connections 2024-05-04T00:31:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.801+0000 7fc8d1e60640 1 -- 172.21.15.6:0/2822222747 >> 172.21.15.6:0/2822222747 conn(0x7fc8cc06f4c0 msgr2=0x7fc8cc1514f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.801+0000 7fc8d1e60640 1 -- 172.21.15.6:0/2822222747 shutdown_connections 2024-05-04T00:31:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.801+0000 7fc8d1e60640 1 -- 172.21.15.6:0/2822222747 wait complete. 2024-05-04T00:31:40.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.813+0000 7f08357fa640 1 -- 172.21.15.6:0/490216086 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f08300b9a70 con 0x7f0838152f50 2024-05-04T00:31:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.813+0000 7f08357fa640 1 --2- 172.21.15.6:0/490216086 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f081806f400 0x7f0818071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.813+0000 7f0837fff640 1 --2- 172.21.15.6:0/490216086 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f081806f400 0x7f0818071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.813+0000 7f0837fff640 1 --2- 172.21.15.6:0/490216086 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f081806f400 0x7f0818071910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0828009670 tx=0x7f0828006bd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.836 INFO:teuthology.orchestra.run.smithi006.stdout:60129542162 2024-05-04T00:31:40.836 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-04T00:31:40.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.833+0000 7f08357fa640 1 -- 172.21.15.6:0/490216086 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f0830128ed0 con 0x7f0838152f50 2024-05-04T00:31:40.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.833+0000 7f08357fa640 1 --2- 172.21.15.6:0/490216086 >> [v2:172.21.15.6:6800/3099957279,v1:172.21.15.6:6802/3099957279] conn(0x7f08180775f0 0x7f0818079a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.833+0000 7f08357fa640 1 -- 172.21.15.6:0/490216086 --> [v2:172.21.15.6:6800/3099957279,v1:172.21.15.6:6802/3099957279] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f08300a5780 con 0x7f08180775f0 2024-05-04T00:31:40.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.833+0000 7f082ffff640 1 --2- 172.21.15.6:0/490216086 >> [v2:172.21.15.6:6800/3099957279,v1:172.21.15.6:6802/3099957279] conn(0x7f08180775f0 0x7f0818079a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.837+0000 7f082ffff640 1 --2- 172.21.15.6:0/490216086 >> [v2:172.21.15.6:6800/3099957279,v1:172.21.15.6:6802/3099957279] conn(0x7f08180775f0 0x7f0818079a40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.837+0000 7f08357fa640 1 -- 172.21.15.6:0/490216086 <== osd.1 v2:172.21.15.6:6800/3099957279 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f08300a5780 con 0x7f08180775f0 2024-05-04T00:31:40.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.845+0000 7f1d2a7fc640 1 -- 172.21.15.6:0/26471796 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1d2401b460 con 0x7f1d3413eff0 2024-05-04T00:31:40.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.845+0000 7f1d2a7fc640 1 --2- 172.21.15.6:0/26471796 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1d1806f450 0x7f1d18071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.845+0000 7f1d39e48640 1 --2- 172.21.15.6:0/26471796 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1d1806f450 0x7f1d18071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.845+0000 7f1d39e48640 1 --2- 172.21.15.6:0/26471796 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1d1806f450 0x7f1d18071960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000a790 tx=0x7f1d30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.853+0000 7f1d2a7fc640 1 -- 172.21.15.6:0/26471796 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f1d24058490 con 0x7f1d3413eff0 2024-05-04T00:31:40.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.853+0000 7f1d2a7fc640 1 --2- 172.21.15.6:0/26471796 >> [v2:172.21.15.163:6810/1460767610,v1:172.21.15.163:6811/1460767610] conn(0x7f1d180776a0 0x7f1d18079af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.853+0000 7f1d2a7fc640 1 -- 172.21.15.6:0/26471796 --> [v2:172.21.15.163:6810/1460767610,v1:172.21.15.163:6811/1460767610] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d1807a1c0 con 0x7f1d180776a0 2024-05-04T00:31:40.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.853+0000 7f1d2a7fc640 1 -- 172.21.15.6:0/26471796 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1d24058850 con 0x7f1d3413eff0 2024-05-04T00:31:40.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.853+0000 7f1d3a649640 1 --2- 172.21.15.6:0/26471796 >> [v2:172.21.15.163:6810/1460767610,v1:172.21.15.163:6811/1460767610] conn(0x7f1d180776a0 0x7f1d18079af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.853+0000 7f1d3a649640 1 --2- 172.21.15.6:0/26471796 >> [v2:172.21.15.163:6810/1460767610,v1:172.21.15.163:6811/1460767610] conn(0x7f1d180776a0 0x7f1d18079af0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.857+0000 7f1d2a7fc640 1 -- 172.21.15.6:0/26471796 <== osd.6 v2:172.21.15.163:6810/1460767610 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1d1807a1c0 con 0x7f1d180776a0 2024-05-04T00:31:40.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.857+0000 7f8bdeffd640 1 -- 172.21.15.6:0/1033129113 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8be001c070 con 0x7f8be81541f0 2024-05-04T00:31:40.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.857+0000 7f8bdeffd640 1 --2- 172.21.15.6:0/1033129113 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8bc806f450 0x7f8bc8071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.857+0000 7f8be659c640 1 --2- 172.21.15.6:0/1033129113 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8bc806f450 0x7f8bc8071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.861+0000 7f8be659c640 1 --2- 172.21.15.6:0/1033129113 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8bc806f450 0x7f8bc8071960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80099b0 tx=0x7f8bd8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.861+0000 7f8bdeffd640 1 -- 172.21.15.6:0/1033129113 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f8be00587e0 con 0x7f8be81541f0 2024-05-04T00:31:40.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.861+0000 7f8bdeffd640 1 --2- 172.21.15.6:0/1033129113 >> [v2:172.21.15.6:6814/3149875909,v1:172.21.15.6:6818/3149875909] conn(0x7f8bc80776a0 0x7f8bc8079af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.861+0000 7f8bdeffd640 1 -- 172.21.15.6:0/1033129113 --> [v2:172.21.15.6:6814/3149875909,v1:172.21.15.6:6818/3149875909] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8be0020ec0 con 0x7f8bc80776a0 2024-05-04T00:31:40.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.861+0000 7f8bdeffd640 1 -- 172.21.15.6:0/1033129113 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8be0058ba0 con 0x7f8be81541f0 2024-05-04T00:31:40.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.861+0000 7f8bdffff640 1 --2- 172.21.15.6:0/1033129113 >> [v2:172.21.15.6:6814/3149875909,v1:172.21.15.6:6818/3149875909] conn(0x7f8bc80776a0 0x7f8bc8079af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.865+0000 7f8bdffff640 1 --2- 172.21.15.6:0/1033129113 >> [v2:172.21.15.6:6814/3149875909,v1:172.21.15.6:6818/3149875909] conn(0x7f8bc80776a0 0x7f8bc8079af0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.865+0000 7f8bdeffd640 1 -- 172.21.15.6:0/1033129113 <== osd.3 v2:172.21.15.6:6814/3149875909 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8be0020ec0 con 0x7f8bc80776a0 2024-05-04T00:31:40.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.865+0000 7f08357fa640 1 -- 172.21.15.6:0/490216086 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f08300f3760 con 0x7f0838152f50 2024-05-04T00:31:40.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.877+0000 7f083ea45640 1 -- 172.21.15.6:0/490216086 --> [v2:172.21.15.6:6800/3099957279,v1:172.21.15.6:6802/3099957279] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0838137ed0 con 0x7f08180775f0 2024-05-04T00:31:40.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.877+0000 7f08357fa640 1 -- 172.21.15.6:0/490216086 <== osd.1 v2:172.21.15.6:6800/3099957279 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0838137ed0 con 0x7f08180775f0 2024-05-04T00:31:40.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.889+0000 7f082e7fc640 1 -- 172.21.15.6:0/490216086 >> [v2:172.21.15.6:6800/3099957279,v1:172.21.15.6:6802/3099957279] conn(0x7f08180775f0 msgr2=0x7f0818079a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.889+0000 7f082e7fc640 1 --2- 172.21.15.6:0/490216086 >> [v2:172.21.15.6:6800/3099957279,v1:172.21.15.6:6802/3099957279] conn(0x7f08180775f0 0x7f0818079a40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.889+0000 7f082e7fc640 1 -- 172.21.15.6:0/490216086 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f081806f400 msgr2=0x7f0818071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.889+0000 7f082e7fc640 1 --2- 172.21.15.6:0/490216086 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f081806f400 0x7f0818071910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0828009670 tx=0x7f0828006bd0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.889+0000 7f082e7fc640 1 -- 172.21.15.6:0/490216086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0838152f50 msgr2=0x7f08381516f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.889+0000 7f082e7fc640 1 --2- 172.21.15.6:0/490216086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0838152f50 0x7f08381516f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f083001afa0 tx=0x7f0830019690 comp rx=0 tx=0).stop 2024-05-04T00:31:40.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.889+0000 7f083cfe2640 1 -- 172.21.15.6:0/490216086 reap_dead start 2024-05-04T00:31:40.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.889+0000 7f082e7fc640 1 -- 172.21.15.6:0/490216086 shutdown_connections 2024-05-04T00:31:40.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.889+0000 7f082e7fc640 1 -- 172.21.15.6:0/490216086 >> 172.21.15.6:0/490216086 conn(0x7f083806cf70 msgr2=0x7f08380c9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:40.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.889+0000 7f082e7fc640 1 -- 172.21.15.6:0/490216086 shutdown_connections 2024-05-04T00:31:40.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.889+0000 7f082e7fc640 1 -- 172.21.15.6:0/490216086 wait complete. 2024-05-04T00:31:40.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.893+0000 7f8becd22640 1 -- 172.21.15.6:0/1033129113 --> [v2:172.21.15.6:6814/3149875909,v1:172.21.15.6:6818/3149875909] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8be8145220 con 0x7f8bc80776a0 2024-05-04T00:31:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.893+0000 7f8bdeffd640 1 -- 172.21.15.6:0/1033129113 <== osd.3 v2:172.21.15.6:6814/3149875909 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8be8145220 con 0x7f8bc80776a0 2024-05-04T00:31:40.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.897+0000 7f1d3c0ac640 1 -- 172.21.15.6:0/26471796 --> [v2:172.21.15.163:6810/1460767610,v1:172.21.15.163:6811/1460767610] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1d34156e30 con 0x7f1d180776a0 2024-05-04T00:31:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.897+0000 7f1d2a7fc640 1 -- 172.21.15.6:0/26471796 <== osd.6 v2:172.21.15.163:6810/1460767610 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1d34156e30 con 0x7f1d180776a0 2024-05-04T00:31:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.897+0000 7f8bdcff9640 1 -- 172.21.15.6:0/1033129113 >> [v2:172.21.15.6:6814/3149875909,v1:172.21.15.6:6818/3149875909] conn(0x7f8bc80776a0 msgr2=0x7f8bc8079af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.897+0000 7f8bdcff9640 1 --2- 172.21.15.6:0/1033129113 >> [v2:172.21.15.6:6814/3149875909,v1:172.21.15.6:6818/3149875909] conn(0x7f8bc80776a0 0x7f8bc8079af0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.897+0000 7f8bdcff9640 1 -- 172.21.15.6:0/1033129113 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8bc806f450 msgr2=0x7f8bc8071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.897+0000 7f8bdcff9640 1 --2- 172.21.15.6:0/1033129113 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8bc806f450 0x7f8bc8071960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80099b0 tx=0x7f8bd8009190 comp rx=0 tx=0).stop 2024-05-04T00:31:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.897+0000 7f8bdcff9640 1 -- 172.21.15.6:0/1033129113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be81541f0 msgr2=0x7f8be8147690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.897+0000 7f8bdcff9640 1 --2- 172.21.15.6:0/1033129113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be81541f0 0x7f8be8147690 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8be000bdf0 tx=0x7f8be0009ef0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.897+0000 7f8be6d9d640 1 -- 172.21.15.6:0/1033129113 reap_dead start 2024-05-04T00:31:40.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.901+0000 7f8bdcff9640 1 -- 172.21.15.6:0/1033129113 shutdown_connections 2024-05-04T00:31:40.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.901+0000 7f8bdcff9640 1 -- 172.21.15.6:0/1033129113 >> 172.21.15.6:0/1033129113 conn(0x7f8be8072ce0 msgr2=0x7f8be814e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:40.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.901+0000 7f8bdcff9640 1 -- 172.21.15.6:0/1033129113 shutdown_connections 2024-05-04T00:31:40.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.901+0000 7f8bdcff9640 1 -- 172.21.15.6:0/1033129113 wait complete. 2024-05-04T00:31:40.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.913+0000 7f1d3c0ac640 1 -- 172.21.15.6:0/26471796 >> [v2:172.21.15.163:6810/1460767610,v1:172.21.15.163:6811/1460767610] conn(0x7f1d180776a0 msgr2=0x7f1d18079af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.913+0000 7f1d3c0ac640 1 --2- 172.21.15.6:0/26471796 >> [v2:172.21.15.163:6810/1460767610,v1:172.21.15.163:6811/1460767610] conn(0x7f1d180776a0 0x7f1d18079af0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.913+0000 7f1d3c0ac640 1 -- 172.21.15.6:0/26471796 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1d1806f450 msgr2=0x7f1d18071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.913+0000 7f1d3c0ac640 1 --2- 172.21.15.6:0/26471796 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1d1806f450 0x7f1d18071960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000a790 tx=0x7f1d30008040 comp rx=0 tx=0).stop 2024-05-04T00:31:40.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.913+0000 7f1d3c0ac640 1 -- 172.21.15.6:0/26471796 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d3413eff0 msgr2=0x7f1d34155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.913+0000 7f1d3c0ac640 1 --2- 172.21.15.6:0/26471796 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d3413eff0 0x7f1d34155aa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400b3c0 tx=0x7f1d2400b880 comp rx=0 tx=0).stop 2024-05-04T00:31:40.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.917+0000 7f1d3a649640 1 -- 172.21.15.6:0/26471796 reap_dead start 2024-05-04T00:31:40.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.917+0000 7f1d3c0ac640 1 -- 172.21.15.6:0/26471796 shutdown_connections 2024-05-04T00:31:40.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.917+0000 7f1d3c0ac640 1 -- 172.21.15.6:0/26471796 >> 172.21.15.6:0/26471796 conn(0x7f1d3406cb80 msgr2=0x7f1d34157cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:40.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.917+0000 7f1d3c0ac640 1 -- 172.21.15.6:0/26471796 shutdown_connections 2024-05-04T00:31:40.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.917+0000 7f1d3c0ac640 1 -- 172.21.15.6:0/26471796 wait complete. 2024-05-04T00:31:40.926 INFO:teuthology.orchestra.run.smithi006.stdout:64424509459 2024-05-04T00:31:40.927 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-04T00:31:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.925+0000 7f87d359e640 1 Processor -- start 2024-05-04T00:31:40.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.925+0000 7f87d359e640 1 -- start start 2024-05-04T00:31:40.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.925+0000 7f87d359e640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f87d414ec40 0x7f87d40725d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.925+0000 7f87d359e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f87d406f1a0 0x7f87d415b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.925+0000 7f87d359e640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f87d415ba80 0x7f87d415be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.925+0000 7f87d359e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f87d406e420 con 0x7f87d406f1a0 2024-05-04T00:31:40.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.925+0000 7f87d359e640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f87d406e730 con 0x7f87d415ba80 2024-05-04T00:31:40.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.925+0000 7f87d359e640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f87d40c8c60 con 0x7f87d414ec40 2024-05-04T00:31:40.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.929+0000 7f87d1d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f87d406f1a0 0x7f87d415b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.929+0000 7f87d1d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f87d406f1a0 0x7f87d415b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40758/0 (socket says 172.21.15.6:40758) 2024-05-04T00:31:40.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.929+0000 7f87d1d9b640 1 -- 172.21.15.6:0/80351538 learned_addr learned my addr 172.21.15.6:0/80351538 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:40.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.929+0000 7f87d2d9d640 1 --2- 172.21.15.6:0/80351538 >> v2:172.21.15.163:3300/0 conn(0x7f87d415ba80 0x7f87d415be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.933+0000 7f87d259c640 1 --2- 172.21.15.6:0/80351538 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f87d414ec40 0x7f87d40725d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.933+0000 7f87d1d9b640 1 -- 172.21.15.6:0/80351538 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f87d414ec40 msgr2=0x7f87d40725d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:40.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.933+0000 7f87d1d9b640 1 --2- 172.21.15.6:0/80351538 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f87d414ec40 0x7f87d40725d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.933+0000 7f87d1d9b640 1 -- 172.21.15.6:0/80351538 >> v2:172.21.15.163:3300/0 conn(0x7f87d415ba80 msgr2=0x7f87d415be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:40.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.933+0000 7f87d1d9b640 1 --2- 172.21.15.6:0/80351538 >> v2:172.21.15.163:3300/0 conn(0x7f87d415ba80 0x7f87d415be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.933+0000 7f87d1d9b640 1 -- 172.21.15.6:0/80351538 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d406e9a0 con 0x7f87d406f1a0 2024-05-04T00:31:40.948 INFO:teuthology.orchestra.run.smithi006.stdout:60129542162 2024-05-04T00:31:40.949 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-04T00:31:40.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.949+0000 7f87d1d9b640 1 --2- 172.21.15.6:0/80351538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87d406f1a0 0x7f87d415b540 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f87d40700c0 tx=0x7f87cc01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee035690827900b server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.957+0000 7f87d159a640 1 -- 172.21.15.6:0/80351538 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87cc0b4070 con 0x7f87d406f1a0 2024-05-04T00:31:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.957+0000 7f87d159a640 1 -- 172.21.15.6:0/80351538 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87cc0af400 con 0x7f87d406f1a0 2024-05-04T00:31:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.957+0000 7f87d159a640 1 -- 172.21.15.6:0/80351538 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87cc0af7d0 con 0x7f87d406f1a0 2024-05-04T00:31:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.957+0000 7f87d359e640 1 -- 172.21.15.6:0/80351538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87d406f1a0 msgr2=0x7f87d415b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.957+0000 7f87d359e640 1 --2- 172.21.15.6:0/80351538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87d406f1a0 0x7f87d415b540 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f87d40700c0 tx=0x7f87cc01f1e0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.957+0000 7f87d359e640 1 -- 172.21.15.6:0/80351538 shutdown_connections 2024-05-04T00:31:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.957+0000 7f87d359e640 1 --2- 172.21.15.6:0/80351538 >> v2:172.21.15.163:3300/0 conn(0x7f87d415ba80 0x7f87d415be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.957+0000 7f87d359e640 1 --2- 172.21.15.6:0/80351538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87d406f1a0 0x7f87d415b540 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.957+0000 7f87d359e640 1 --2- 172.21.15.6:0/80351538 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f87d414ec40 0x7f87d40725d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.957+0000 7f87d359e640 1 -- 172.21.15.6:0/80351538 >> 172.21.15.6:0/80351538 conn(0x7f87d406cb80 msgr2=0x7f87d406cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.957+0000 7f87d359e640 1 -- 172.21.15.6:0/80351538 shutdown_connections 2024-05-04T00:31:40.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.957+0000 7f87d359e640 1 -- 172.21.15.6:0/80351538 wait complete. 2024-05-04T00:31:40.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.961+0000 7f87d359e640 1 Processor -- start 2024-05-04T00:31:40.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.961+0000 7f87d359e640 1 -- start start 2024-05-04T00:31:40.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.965+0000 7f87d359e640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f87d406f1a0 0x7f87d41f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.965+0000 7f87d359e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87d414ec40 0x7f87d414d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.965+0000 7f87d359e640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87d415ba80 0x7f87d4144af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:40.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.965+0000 7f87d359e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f87d4072b10 con 0x7f87d414ec40 2024-05-04T00:31:40.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.965+0000 7f87d359e640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f87d40c91e0 con 0x7f87d415ba80 2024-05-04T00:31:40.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.965+0000 7f87d359e640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f87d406ec80 con 0x7f87d406f1a0 2024-05-04T00:31:40.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.965+0000 7f87d259c640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f87d406f1a0 0x7f87d41f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.965+0000 7f87d2d9d640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87d415ba80 0x7f87d4144af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.965+0000 7f87d259c640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f87d406f1a0 0x7f87d41f5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38550/0 (socket says 172.21.15.6:38550) 2024-05-04T00:31:40.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.965+0000 7f87d259c640 1 -- 172.21.15.6:0/532889086 learned_addr learned my addr 172.21.15.6:0/532889086 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:40.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.965+0000 7f87d1d9b640 1 --2- 172.21.15.6:0/532889086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87d414ec40 0x7f87d414d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:40.974 INFO:teuthology.orchestra.run.smithi006.stdout:64424509458 2024-05-04T00:31:40.974 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-04T00:31:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.973+0000 7f87d1d9b640 1 -- 172.21.15.6:0/532889086 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f87d406f1a0 msgr2=0x7f87d41f5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.973+0000 7f87d1d9b640 1 --2- 172.21.15.6:0/532889086 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f87d406f1a0 0x7f87d41f5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.973+0000 7f87d1d9b640 1 -- 172.21.15.6:0/532889086 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87d415ba80 msgr2=0x7f87d4144af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.973+0000 7f87d1d9b640 1 --2- 172.21.15.6:0/532889086 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87d415ba80 0x7f87d4144af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.973+0000 7f87d1d9b640 1 -- 172.21.15.6:0/532889086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d406def0 con 0x7f87d414ec40 2024-05-04T00:31:40.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.977+0000 7f87d1d9b640 1 --2- 172.21.15.6:0/532889086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87d414ec40 0x7f87d414d170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f87cc0ae000 tx=0x7f87cc01bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:40.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.985+0000 7f87c2ffd640 1 -- 172.21.15.6:0/532889086 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87cc0b4040 con 0x7f87d414ec40 2024-05-04T00:31:40.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.985+0000 7f87c2ffd640 1 -- 172.21.15.6:0/532889086 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87cc0090d0 con 0x7f87d414ec40 2024-05-04T00:31:40.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.985+0000 7f87c2ffd640 1 -- 172.21.15.6:0/532889086 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87cc009510 con 0x7f87d414ec40 2024-05-04T00:31:40.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.985+0000 7f87d359e640 1 -- 172.21.15.6:0/532889086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87d40caf90 con 0x7f87d414ec40 2024-05-04T00:31:40.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.985+0000 7f87d359e640 1 -- 172.21.15.6:0/532889086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87d40cb550 con 0x7f87d414ec40 2024-05-04T00:31:40.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:40.989+0000 7f87d359e640 1 -- 172.21.15.6:0/532889086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87d414e400 con 0x7f87d414ec40 2024-05-04T00:31:41.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.005+0000 7f42a23cc640 1 Processor -- start 2024-05-04T00:31:41.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.005+0000 7f42a23cc640 1 -- start start 2024-05-04T00:31:41.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.005+0000 7f42a23cc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f429c0c8140 0x7f429c15bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.005+0000 7f42a23cc640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f429c160870 0x7f429c162c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.005+0000 7f42a23cc640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f429c0c9e70 con 0x7f429c158930 2024-05-04T00:31:41.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.005+0000 7f42a23cc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f429c0ca110 con 0x7f429c0c8140 2024-05-04T00:31:41.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.005+0000 7f42a23cc640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f429c0ca3d0 con 0x7f429c160870 2024-05-04T00:31:41.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.009+0000 7f42a0969640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f429c160870 0x7f429c162c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.009+0000 7f42a0969640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f429c160870 0x7f429c162c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:55062/0 (socket says 172.21.15.6:55062) 2024-05-04T00:31:41.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.009+0000 7f42a0969640 1 -- 172.21.15.6:0/3656819746 learned_addr learned my addr 172.21.15.6:0/3656819746 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:41.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.021+0000 7f42a0969640 1 -- 172.21.15.6:0/3656819746 >> v2:172.21.15.6:3300/0 conn(0x7f429c0c8140 msgr2=0x7f429c15bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:41.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.021+0000 7f42a0969640 1 --2- 172.21.15.6:0/3656819746 >> v2:172.21.15.6:3300/0 conn(0x7f429c0c8140 0x7f429c15bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.021+0000 7f42a0969640 1 -- 172.21.15.6:0/3656819746 >> v1:172.21.15.6:6789/0 conn(0x7f429c158930 legacy=0x7f429c072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:41.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.021+0000 7f42a0969640 1 -- 172.21.15.6:0/3656819746 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429c0ca6b0 con 0x7f429c160870 2024-05-04T00:31:41.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.029+0000 7f42a0969640 1 --2- 172.21.15.6:0/3656819746 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f429c160870 0x7f429c162c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f429c06f7c0 tx=0x7f429001ff60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56a5778db8039886 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:41.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.029+0000 7fe54ac19640 1 Processor -- start 2024-05-04T00:31:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.029+0000 7fe54ac19640 1 -- start start 2024-05-04T00:31:41.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.033+0000 7fe54ac19640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe5440731c0 0x7fe5440cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.033+0000 7fe54ac19640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe54415fb80 0x7fe544167810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.033+0000 7fe54ac19640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe54415ce30 con 0x7fe5440cce50 2024-05-04T00:31:41.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.033+0000 7fe54ac19640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe54415c900 con 0x7fe5440731c0 2024-05-04T00:31:41.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.033+0000 7fe54ac19640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe5440cbe70 con 0x7fe54415fb80 2024-05-04T00:31:41.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.029+0000 7f7fba4b0640 1 Processor -- start 2024-05-04T00:31:41.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.029+0000 7f7fba4b0640 1 -- start start 2024-05-04T00:31:41.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.033+0000 7f7fba4b0640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7fb4072ea0 0x7f7fb4162ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.033+0000 7f7fba4b0640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7fb4070b60 0x7f7fb4163010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.033+0000 7f7fba4b0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb40c7d40 con 0x7f7fb4072a90 2024-05-04T00:31:41.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.033+0000 7f7fba4b0640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f7fb4163550 con 0x7f7fb4072ea0 2024-05-04T00:31:41.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.033+0000 7f7fba4b0640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb40c7af0 con 0x7f7fb4070b60 2024-05-04T00:31:41.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.033+0000 7fe54a418640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe54415fb80 0x7fe544167810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.033+0000 7fe54a418640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe54415fb80 0x7fe544167810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38566/0 (socket says 172.21.15.6:38566) 2024-05-04T00:31:41.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.033+0000 7fe54a418640 1 -- 172.21.15.6:0/2728468898 learned_addr learned my addr 172.21.15.6:0/2728468898 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:41.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.041+0000 7fe54a418640 1 -- 172.21.15.6:0/2728468898 >> v2:172.21.15.6:3300/0 conn(0x7fe5440731c0 msgr2=0x7fe5440cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:41.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.041+0000 7fe54a418640 1 --2- 172.21.15.6:0/2728468898 >> v2:172.21.15.6:3300/0 conn(0x7fe5440731c0 0x7fe5440cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.041+0000 7fe54a418640 1 -- 172.21.15.6:0/2728468898 >> v1:172.21.15.6:6789/0 conn(0x7fe5440cce50 legacy=0x7fe54415f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:41.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.041+0000 7fe54a418640 1 -- 172.21.15.6:0/2728468898 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5440b4120 con 0x7fe54415fb80 2024-05-04T00:31:41.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.045+0000 7f429affd640 1 -- 172.21.15.6:0/3656819746 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42900b6070 con 0x7f429c160870 2024-05-04T00:31:41.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.045+0000 7f429affd640 1 -- 172.21.15.6:0/3656819746 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42900a9d30 con 0x7f429c160870 2024-05-04T00:31:41.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.045+0000 7f429affd640 1 -- 172.21.15.6:0/3656819746 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42900b1660 con 0x7f429c160870 2024-05-04T00:31:41.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.045+0000 7f42a23cc640 1 -- 172.21.15.6:0/3656819746 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f429c160870 msgr2=0x7f429c162c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.045+0000 7f42a23cc640 1 --2- 172.21.15.6:0/3656819746 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f429c160870 0x7f429c162c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f429c06f7c0 tx=0x7f429001ff60 comp rx=0 tx=0).stop 2024-05-04T00:31:41.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.045+0000 7f42a23cc640 1 -- 172.21.15.6:0/3656819746 shutdown_connections 2024-05-04T00:31:41.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.045+0000 7f42a23cc640 1 --2- 172.21.15.6:0/3656819746 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f429c160870 0x7f429c162c90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.045+0000 7f42a23cc640 1 --2- 172.21.15.6:0/3656819746 >> v2:172.21.15.6:3300/0 conn(0x7f429c0c8140 0x7f429c15bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.045+0000 7f42a23cc640 1 -- 172.21.15.6:0/3656819746 >> 172.21.15.6:0/3656819746 conn(0x7f429c06c780 msgr2=0x7f429c06cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:41.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.045+0000 7f42a23cc640 1 -- 172.21.15.6:0/3656819746 shutdown_connections 2024-05-04T00:31:41.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.045+0000 7f87c2ffd640 1 -- 172.21.15.6:0/532889086 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f87cc0c1060 con 0x7f87d414ec40 2024-05-04T00:31:41.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.045+0000 7f87c2ffd640 1 --2- 172.21.15.6:0/532889086 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f87b406f450 0x7f87b4071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.045+0000 7fe54a418640 1 --2- 172.21.15.6:0/2728468898 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe54415fb80 0x7fe544167810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe534009870 tx=0x7fe53401c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f02fedfbf4c1747 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:41.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.045+0000 7f7fb37fe640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7fb4072ea0 0x7f7fb4162ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.045+0000 7f87d259c640 1 --2- 172.21.15.6:0/532889086 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f87b406f450 0x7f87b4071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.049+0000 7f87d259c640 1 --2- 172.21.15.6:0/532889086 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f87b406f450 0x7f87b4071960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f87c400aae0 tx=0x7f87c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:41.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.045+0000 7f42a23cc640 1 -- 172.21.15.6:0/3656819746 wait complete. 2024-05-04T00:31:41.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.049+0000 7f42a23cc640 1 Processor -- start 2024-05-04T00:31:41.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.049+0000 7f42a23cc640 1 -- start start 2024-05-04T00:31:41.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.053+0000 7f42a23cc640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f429c0c8140 0x7f429c14d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.053+0000 7f7fb37fe640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7fb4072ea0 0x7f7fb4162ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:55076/0 (socket says 172.21.15.6:55076) 2024-05-04T00:31:41.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.053+0000 7f7fb37fe640 1 -- 172.21.15.6:0/2785100714 learned_addr learned my addr 172.21.15.6:0/2785100714 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:41.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.053+0000 7f42a23cc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f429c158930 0x7f429c146b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.053+0000 7f42a23cc640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f429c160870 0x7f429c1498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.053+0000 7f42a23cc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f429c158d40 con 0x7f429c158930 2024-05-04T00:31:41.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.053+0000 7f42a23cc640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f429c15b9e0 con 0x7f429c0c8140 2024-05-04T00:31:41.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.053+0000 7f42a23cc640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f429c06f9d0 con 0x7f429c160870 2024-05-04T00:31:41.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.053+0000 7f87c2ffd640 1 -- 172.21.15.6:0/532889086 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f87cc0bbd30 con 0x7f87d414ec40 2024-05-04T00:31:41.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.057+0000 7f7fb37fe640 1 -- 172.21.15.6:0/2785100714 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7fb4070b60 msgr2=0x7f7fb4163010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:41.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.057+0000 7f7fb37fe640 1 --2- 172.21.15.6:0/2785100714 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7fb4070b60 0x7f7fb4163010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.057+0000 7f7fb37fe640 1 -- 172.21.15.6:0/2785100714 >> v1:172.21.15.6:6789/0 conn(0x7f7fb4072a90 legacy=0x7f7fb406f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.057+0000 7f7fb37fe640 1 -- 172.21.15.6:0/2785100714 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb40c8020 con 0x7f7fb4072ea0 2024-05-04T00:31:41.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.061+0000 7fe548c15640 1 -- 172.21.15.6:0/2728468898 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5340b2070 con 0x7fe54415fb80 2024-05-04T00:31:41.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.061+0000 7fe548c15640 1 -- 172.21.15.6:0/2728468898 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5340a9070 con 0x7fe54415fb80 2024-05-04T00:31:41.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.061+0000 7fe548c15640 1 -- 172.21.15.6:0/2728468898 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5340ad8c0 con 0x7fe54415fb80 2024-05-04T00:31:41.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.061+0000 7f42a0969640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f429c160870 0x7f429c1498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.065+0000 7fe54ac19640 1 -- 172.21.15.6:0/2728468898 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe54415fb80 msgr2=0x7fe544167810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.065+0000 7fe54ac19640 1 --2- 172.21.15.6:0/2728468898 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe54415fb80 0x7fe544167810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe534009870 tx=0x7fe53401c4f0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.065+0000 7fe54ac19640 1 -- 172.21.15.6:0/2728468898 shutdown_connections 2024-05-04T00:31:41.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.065+0000 7fe54ac19640 1 --2- 172.21.15.6:0/2728468898 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe54415fb80 0x7fe544167810 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.065+0000 7fe54ac19640 1 --2- 172.21.15.6:0/2728468898 >> v2:172.21.15.6:3300/0 conn(0x7fe5440731c0 0x7fe5440cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.065+0000 7fe54ac19640 1 -- 172.21.15.6:0/2728468898 >> 172.21.15.6:0/2728468898 conn(0x7fe54406cd80 msgr2=0x7fe5440d13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:41.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.065+0000 7fe54ac19640 1 -- 172.21.15.6:0/2728468898 shutdown_connections 2024-05-04T00:31:41.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.065+0000 7fe54ac19640 1 -- 172.21.15.6:0/2728468898 wait complete. 2024-05-04T00:31:41.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.065+0000 7f429bfff640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f429c0c8140 0x7f429c14d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.065+0000 7f42a0969640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f429c160870 0x7f429c1498e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38580/0 (socket says 172.21.15.6:38580) 2024-05-04T00:31:41.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.065+0000 7f42a0969640 1 -- 172.21.15.6:0/3928684639 learned_addr learned my addr 172.21.15.6:0/3928684639 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:41.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.065+0000 7fe54ac19640 1 Processor -- start 2024-05-04T00:31:41.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.065+0000 7fe54ac19640 1 -- start start 2024-05-04T00:31:41.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.069+0000 7fe54ac19640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5440731c0 0x7fe5440cf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.069+0000 7fe54ac19640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5440cce50 0x7fe5441ef450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.069+0000 7fe54ac19640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe54415fb80 0x7fe54414fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.069+0000 7fe54ac19640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe544156560 con 0x7fe5440cce50 2024-05-04T00:31:41.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.069+0000 7fe54ac19640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe5440735d0 con 0x7fe54415fb80 2024-05-04T00:31:41.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.069+0000 7fe54ac19640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe5440c6b80 con 0x7fe5440731c0 2024-05-04T00:31:41.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.069+0000 7f7fb37fe640 1 --2- 172.21.15.6:0/2785100714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fb4072ea0 0x7f7fb4162ad0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009870 tx=0x7f7fa401c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de3222b562445d5f server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:41.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.073+0000 7f71125b1640 1 Processor -- start 2024-05-04T00:31:41.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.073+0000 7f71125b1640 1 -- start start 2024-05-04T00:31:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.073+0000 7f71125b1640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f710c0c8480 0x7f710c1647d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.073+0000 7f71125b1640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f710c074bc0 con 0x7f710c152ed0 2024-05-04T00:31:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.073+0000 7f71125b1640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f710c0c5b60 con 0x7f710c1532e0 2024-05-04T00:31:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.073+0000 7f71125b1640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f710c0c5910 con 0x7f710c0c8480 2024-05-04T00:31:41.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.077+0000 7f42a0969640 1 -- 172.21.15.6:0/3928684639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f429c0c8140 msgr2=0x7f429c14d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.077+0000 7f42a0969640 1 --2- 172.21.15.6:0/3928684639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f429c0c8140 0x7f429c14d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.077+0000 7f42a0969640 1 -- 172.21.15.6:0/3928684639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f429c158930 msgr2=0x7f429c146b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.077+0000 7f42a0969640 1 --2- 172.21.15.6:0/3928684639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f429c158930 0x7f429c146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.077+0000 7f42a0969640 1 -- 172.21.15.6:0/3928684639 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429c1f7490 con 0x7f429c160870 2024-05-04T00:31:41.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.085+0000 7f42a0969640 1 --2- 172.21.15.6:0/3928684639 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f429c160870 0x7f429c1498e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4290020800 tx=0x7f429001cd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:41.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.097+0000 7f7fb2ffd640 1 -- 172.21.15.6:0/2785100714 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40b0070 con 0x7f7fb4072ea0 2024-05-04T00:31:41.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.097+0000 7f7fb2ffd640 1 -- 172.21.15.6:0/2785100714 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa40ab600 con 0x7f7fb4072ea0 2024-05-04T00:31:41.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.097+0000 7f7fb2ffd640 1 -- 172.21.15.6:0/2785100714 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40ab9d0 con 0x7f7fb4072ea0 2024-05-04T00:31:41.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.097+0000 7f7fba4b0640 1 -- 172.21.15.6:0/2785100714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fb4072ea0 msgr2=0x7f7fb4162ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.097+0000 7f7fba4b0640 1 --2- 172.21.15.6:0/2785100714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fb4072ea0 0x7f7fb4162ad0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009870 tx=0x7f7fa401c4f0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.097+0000 7fe549c17640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5440731c0 0x7fe5440cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.097+0000 7f7fba4b0640 1 -- 172.21.15.6:0/2785100714 shutdown_connections 2024-05-04T00:31:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.097+0000 7f7fba4b0640 1 --2- 172.21.15.6:0/2785100714 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7fb4070b60 0x7f7fb4163010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.097+0000 7f7fba4b0640 1 --2- 172.21.15.6:0/2785100714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fb4072ea0 0x7f7fb4162ad0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.097+0000 7f7fba4b0640 1 -- 172.21.15.6:0/2785100714 >> 172.21.15.6:0/2785100714 conn(0x7f7fb406cf70 msgr2=0x7f7fb40c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.097+0000 7f7fba4b0640 1 -- 172.21.15.6:0/2785100714 shutdown_connections 2024-05-04T00:31:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.097+0000 7f7fba4b0640 1 -- 172.21.15.6:0/2785100714 wait complete. 2024-05-04T00:31:41.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.101+0000 7fe549c17640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5440731c0 0x7fe5440cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38590/0 (socket says 172.21.15.6:38590) 2024-05-04T00:31:41.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.101+0000 7fe549c17640 1 -- 172.21.15.6:0/989471797 learned_addr learned my addr 172.21.15.6:0/989471797 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:41.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.101+0000 7f7fba4b0640 1 Processor -- start 2024-05-04T00:31:41.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.101+0000 7f7fba4b0640 1 -- start start 2024-05-04T00:31:41.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.101+0000 7f7103fff640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f710c1532e0 0x7f710c0c7d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:52598/0 (socket says 172.21.15.6:52598) 2024-05-04T00:31:41.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.101+0000 7f7103fff640 1 -- 172.21.15.6:0/2432174632 learned_addr learned my addr 172.21.15.6:0/2432174632 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:41.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.101+0000 7f4298ff9640 1 -- 172.21.15.6:0/3928684639 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42900b6040 con 0x7f429c160870 2024-05-04T00:31:41.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.101+0000 7f4298ff9640 1 -- 172.21.15.6:0/3928684639 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42900bf070 con 0x7f429c160870 2024-05-04T00:31:41.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.101+0000 7f42a23cc640 1 -- 172.21.15.6:0/3928684639 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f429c14dd00 con 0x7f429c160870 2024-05-04T00:31:41.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.101+0000 7f42a23cc640 1 -- 172.21.15.6:0/3928684639 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f429c14ca00 con 0x7f429c160870 2024-05-04T00:31:41.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.101+0000 7f4298ff9640 1 -- 172.21.15.6:0/3928684639 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42900ba430 con 0x7f429c160870 2024-05-04T00:31:41.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.105+0000 7f42a23cc640 1 -- 172.21.15.6:0/3928684639 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f427c0052a0 con 0x7f429c160870 2024-05-04T00:31:41.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.105+0000 7fe54a418640 1 --2- 172.21.15.6:0/989471797 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe54415fb80 0x7fe54414fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.105+0000 7f7fba4b0640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fb4070b60 0x7f7fb415c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.105+0000 7f7fba4b0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fb4072a90 0x7f7fb4163fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.105+0000 7f7fba4b0640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7fb4072ea0 0x7f7fb4164e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.105+0000 7f7fba4b0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb40c8ba0 con 0x7f7fb4072a90 2024-05-04T00:31:41.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.105+0000 7f7fba4b0640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb4176fc0 con 0x7f7fb4070b60 2024-05-04T00:31:41.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.105+0000 7f7fba4b0640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb4169c10 con 0x7f7fb4072ea0 2024-05-04T00:31:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.121+0000 7fe549c17640 1 -- 172.21.15.6:0/989471797 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe54415fb80 msgr2=0x7fe54414fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.121+0000 7fe549c17640 1 --2- 172.21.15.6:0/989471797 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe54415fb80 0x7fe54414fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.121+0000 7fe549c17640 1 -- 172.21.15.6:0/989471797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5440cce50 msgr2=0x7fe5441ef450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.121+0000 7fe549c17640 1 --2- 172.21.15.6:0/989471797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5440cce50 0x7fe5441ef450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.121+0000 7fe549c17640 1 -- 172.21.15.6:0/989471797 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5440cf980 con 0x7fe5440731c0 2024-05-04T00:31:41.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.121+0000 7fe402785640 1 Processor -- start 2024-05-04T00:31:41.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.125+0000 7fe402785640 1 -- start start 2024-05-04T00:31:41.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.125+0000 7fe402785640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe3fc06d670 0x7fe3fc1561a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.125+0000 7fe402785640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3fc0c91d0 0x7fe3fc0631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.125+0000 7fe402785640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3fc1566e0 con 0x7fe3fc06c8a0 2024-05-04T00:31:41.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.125+0000 7fe402785640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fe3fc15f820 con 0x7fe3fc06d670 2024-05-04T00:31:41.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.125+0000 7fe402785640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe3fc1600c0 con 0x7fe3fc0c91d0 2024-05-04T00:31:41.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.129+0000 7f7110b4e640 1 --2- 172.21.15.6:0/2432174632 >> v2:172.21.15.163:3300/0 conn(0x7f710c0c8480 0x7f710c1647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.137+0000 7f7110b4e640 1 -- 172.21.15.6:0/2432174632 >> v1:172.21.15.163:6789/0 conn(0x7f710c1532e0 legacy=0x7f710c0c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.137+0000 7f7110b4e640 1 -- 172.21.15.6:0/2432174632 >> v1:172.21.15.6:6789/0 conn(0x7f710c152ed0 legacy=0x7f710c073780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.137+0000 7f7110b4e640 1 -- 172.21.15.6:0/2432174632 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c0c5e40 con 0x7f710c0c8480 2024-05-04T00:31:41.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.141+0000 7fa5a7bfe640 1 Processor -- start 2024-05-04T00:31:41.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.141+0000 7fa5a7bfe640 1 -- start start 2024-05-04T00:31:41.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.145+0000 7fa5a7bfe640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa5a0152ed0 0x7fa5a0073780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.145+0000 7fa5a7bfe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5a01532e0 0x7fa5a0073cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.145+0000 7fa5a7bfe640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5a0074bc0 con 0x7fa5a00c7d70 2024-05-04T00:31:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.145+0000 7fa5a7bfe640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fa5a00c5910 con 0x7fa5a0152ed0 2024-05-04T00:31:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.145+0000 7fa5a7bfe640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a00c6490 con 0x7fa5a01532e0 2024-05-04T00:31:41.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.145+0000 7f7110b4e640 1 --2- 172.21.15.6:0/2432174632 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f710c0c8480 0x7f710c1647d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7104009d90 tx=0x7f710401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6bba9c75a22f2cc server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:41.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.153+0000 7f7fb3fff640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fb4070b60 0x7f7fb415c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.157+0000 7fa5a599a640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa5a0152ed0 0x7fa5a0073780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.157+0000 7f7fb3fff640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fb4070b60 0x7f7fb415c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:55116/0 (socket says 172.21.15.6:55116) 2024-05-04T00:31:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.157+0000 7f7fb3fff640 1 -- 172.21.15.6:0/1989758695 learned_addr learned my addr 172.21.15.6:0/1989758695 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:41.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.169+0000 7f8d45a77640 1 Processor -- start 2024-05-04T00:31:41.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.169+0000 7f8d45a77640 1 -- start start 2024-05-04T00:31:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.169+0000 7f7fb3fff640 1 -- 172.21.15.6:0/1989758695 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7fb4072ea0 msgr2=0x7f7fb4164e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.169+0000 7f7fb3fff640 1 --2- 172.21.15.6:0/1989758695 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7fb4072ea0 0x7f7fb4164e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.169+0000 7f7fb3fff640 1 -- 172.21.15.6:0/1989758695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fb4072a90 msgr2=0x7f7fb4163fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.169+0000 7f7fb3fff640 1 --2- 172.21.15.6:0/1989758695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fb4072a90 0x7f7fb4163fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.169+0000 7f7fb3fff640 1 -- 172.21.15.6:0/1989758695 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb415c830 con 0x7f7fb4070b60 2024-05-04T00:31:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.173+0000 7f8d45a77640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8d401541f0 0x7f8d40159e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.173+0000 7f8d45a77640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8d400c5800 0x7f8d400ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.173+0000 7f8d45a77640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8d400c5c10 0x7f8d400ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.173+0000 7f8d45a77640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8d400c4db0 con 0x7f8d400c5800 2024-05-04T00:31:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.173+0000 7f8d45a77640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f8d4015a6c0 con 0x7f8d400c5c10 2024-05-04T00:31:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.173+0000 7f8d45a77640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f8d4015a9a0 con 0x7f8d401541f0 2024-05-04T00:31:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.177+0000 7f7fb3fff640 1 --2- 172.21.15.6:0/1989758695 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fb4070b60 0x7f7fb415c2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800c3c0 tx=0x7f7fa800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:41.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.189+0000 7fe3fb7fe640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe3fc06d670 0x7fe3fc1561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.189+0000 7fe3fbfff640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fe3fc06c8a0 0x7fe3fc15ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:52600/0 (socket says 172.21.15.6:52600) 2024-05-04T00:31:41.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.189+0000 7fe3fbfff640 1 -- 172.21.15.6:0/2208932172 learned_addr learned my addr 172.21.15.6:0/2208932172 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:41.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.189+0000 7fa5a599a640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa5a0152ed0 0x7fa5a0073780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:55120/0 (socket says 172.21.15.6:55120) 2024-05-04T00:31:41.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.189+0000 7fa5a599a640 1 -- 172.21.15.6:0/2051767490 learned_addr learned my addr 172.21.15.6:0/2051767490 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:41.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.201+0000 7f7fb0ff9640 1 -- 172.21.15.6:0/1989758695 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8017070 con 0x7f7fb4070b60 2024-05-04T00:31:41.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.201+0000 7f7fb0ff9640 1 -- 172.21.15.6:0/1989758695 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa80052d0 con 0x7f7fb4070b60 2024-05-04T00:31:41.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.201+0000 7f7fb0ff9640 1 -- 172.21.15.6:0/1989758695 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80054c0 con 0x7f7fb4070b60 2024-05-04T00:31:41.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.201+0000 7f7fba4b0640 1 -- 172.21.15.6:0/1989758695 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb4164510 con 0x7f7fb4070b60 2024-05-04T00:31:41.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.201+0000 7f7fba4b0640 1 -- 172.21.15.6:0/1989758695 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb40c6c90 con 0x7f7fb4070b60 2024-05-04T00:31:41.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.201+0000 7f7fba4b0640 1 -- 172.21.15.6:0/1989758695 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fb406a390 con 0x7f7fb4070b60 2024-05-04T00:31:41.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.205+0000 7fe3fb7fe640 1 -- 172.21.15.6:0/2208932172 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3fc0c91d0 msgr2=0x7fe3fc0631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:41.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.205+0000 7fe3fb7fe640 1 --2- 172.21.15.6:0/2208932172 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3fc0c91d0 0x7fe3fc0631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.205+0000 7fe3fb7fe640 1 -- 172.21.15.6:0/2208932172 >> v1:172.21.15.163:6789/0 conn(0x7fe3fc06c8a0 legacy=0x7fe3fc15ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.205+0000 7fe3fb7fe640 1 -- 172.21.15.6:0/2208932172 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3fc06cda0 con 0x7fe3fc06d670 2024-05-04T00:31:41.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.213+0000 7fa5a599a640 1 -- 172.21.15.6:0/2051767490 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5a01532e0 msgr2=0x7fa5a0073cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:41.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.213+0000 7fa5a599a640 1 --2- 172.21.15.6:0/2051767490 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5a01532e0 0x7fa5a0073cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.213+0000 7fa5a599a640 1 -- 172.21.15.6:0/2051767490 >> v1:172.21.15.6:6789/0 conn(0x7fa5a00c7d70 legacy=0x7fa5a00c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:41.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.213+0000 7fa5a599a640 1 -- 172.21.15.6:0/2051767490 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a00c5b60 con 0x7fa5a0152ed0 2024-05-04T00:31:41.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.401+0000 7f87c2ffd640 1 -- 172.21.15.6:0/532889086 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f87cc018d40 con 0x7f87d414ec40 2024-05-04T00:31:41.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.417+0000 7f8d3effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8d400c5800 0x7f8d400ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.421+0000 7f8d3effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8d400c5800 0x7f8d400ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40814/0 (socket says 172.21.15.6:40814) 2024-05-04T00:31:41.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.421+0000 7f8d3effd640 1 -- 172.21.15.6:0/161527029 learned_addr learned my addr 172.21.15.6:0/161527029 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:41.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.433+0000 7f8d3effd640 1 -- 172.21.15.6:0/161527029 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8d401541f0 msgr2=0x7f8d40159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:41.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.433+0000 7f8d3effd640 1 --2- 172.21.15.6:0/161527029 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8d401541f0 0x7f8d40159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.433+0000 7f8d3effd640 1 -- 172.21.15.6:0/161527029 >> v2:172.21.15.163:3300/0 conn(0x7f8d400c5c10 msgr2=0x7f8d400ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:41.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.433+0000 7f8d3effd640 1 --2- 172.21.15.6:0/161527029 >> v2:172.21.15.163:3300/0 conn(0x7f8d400c5c10 0x7f8d400ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.433+0000 7f8d3effd640 1 -- 172.21.15.6:0/161527029 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4015ac80 con 0x7f8d400c5800 2024-05-04T00:31:41.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.453+0000 7fe549c17640 1 --2- 172.21.15.6:0/989471797 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5440731c0 0x7fe5440cf440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00ba80 tx=0x7fe53c00bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.513+0000 7f8d3effd640 1 --2- 172.21.15.6:0/161527029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d400c5800 0x7f8d400ca420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8d400746d0 tx=0x7f8d3401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8073268e0e4a14 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:41.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.513+0000 7f4298ff9640 1 -- 172.21.15.6:0/3928684639 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f42900ba5d0 con 0x7f429c160870 2024-05-04T00:31:41.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.513+0000 7f4298ff9640 1 --2- 172.21.15.6:0/3928684639 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f428806f400 0x7f4288071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.513+0000 7f429bfff640 1 --2- 172.21.15.6:0/3928684639 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f428806f400 0x7f4288071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.517+0000 7f429bfff640 1 --2- 172.21.15.6:0/3928684639 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f428806f400 0x7f4288071910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f429400a400 tx=0x7f429400d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:41.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.521+0000 7f4298ff9640 1 -- 172.21.15.6:0/3928684639 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f42900a9c10 con 0x7f429c160870 2024-05-04T00:31:41.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.525+0000 7f8d3e7fc640 1 -- 172.21.15.6:0/161527029 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d340b0070 con 0x7f8d400c5800 2024-05-04T00:31:41.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.525+0000 7f8d3e7fc640 1 -- 172.21.15.6:0/161527029 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d340ab600 con 0x7f8d400c5800 2024-05-04T00:31:41.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.525+0000 7f8d3e7fc640 1 -- 172.21.15.6:0/161527029 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d340ab9d0 con 0x7f8d400c5800 2024-05-04T00:31:41.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.525+0000 7f8d45a77640 1 -- 172.21.15.6:0/161527029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d400c5800 msgr2=0x7f8d400ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.525+0000 7f8d45a77640 1 --2- 172.21.15.6:0/161527029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d400c5800 0x7f8d400ca420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8d400746d0 tx=0x7f8d3401c540 comp rx=0 tx=0).stop 2024-05-04T00:31:41.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.525+0000 7f8d45a77640 1 -- 172.21.15.6:0/161527029 shutdown_connections 2024-05-04T00:31:41.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.525+0000 7f8d45a77640 1 --2- 172.21.15.6:0/161527029 >> v2:172.21.15.163:3300/0 conn(0x7f8d400c5c10 0x7f8d400ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.525+0000 7f8d45a77640 1 --2- 172.21.15.6:0/161527029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d400c5800 0x7f8d400ca420 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.525+0000 7f8d45a77640 1 --2- 172.21.15.6:0/161527029 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8d401541f0 0x7f8d40159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.525+0000 7f8d45a77640 1 -- 172.21.15.6:0/161527029 >> 172.21.15.6:0/161527029 conn(0x7f8d40072ce0 msgr2=0x7f8d400704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:41.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.525+0000 7f8d45a77640 1 -- 172.21.15.6:0/161527029 shutdown_connections 2024-05-04T00:31:41.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.525+0000 7f8d45a77640 1 -- 172.21.15.6:0/161527029 wait complete. 2024-05-04T00:31:41.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.529+0000 7f8d45a77640 1 Processor -- start 2024-05-04T00:31:41.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.529+0000 7f8d45a77640 1 -- start start 2024-05-04T00:31:41.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.529+0000 7f8d45a77640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d400c5800 0x7f8d4006d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.529+0000 7f8d45a77640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d400c5c10 0x7f8d4015c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.529+0000 7f8d45a77640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8d401541f0 0x7f8d40144d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.529+0000 7f8d45a77640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8d40070de0 con 0x7f8d400c5c10 2024-05-04T00:31:41.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.529+0000 7f8d45a77640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8d400cb800 con 0x7f8d400c5800 2024-05-04T00:31:41.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.529+0000 7f8d45a77640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f8d40070f60 con 0x7f8d401541f0 2024-05-04T00:31:41.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.529+0000 7f8d3effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d400c5c10 0x7f8d4015c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.529+0000 7f8d3effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d400c5c10 0x7f8d4015c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40820/0 (socket says 172.21.15.6:40820) 2024-05-04T00:31:41.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.529+0000 7f8d3effd640 1 -- 172.21.15.6:0/2699643668 learned_addr learned my addr 172.21.15.6:0/2699643668 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:41.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.537+0000 7f8d3effd640 1 -- 172.21.15.6:0/2699643668 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8d401541f0 msgr2=0x7f8d40144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.537+0000 7f8d3effd640 1 --2- 172.21.15.6:0/2699643668 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8d401541f0 0x7f8d40144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.537+0000 7f8d3effd640 1 -- 172.21.15.6:0/2699643668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d400c5800 msgr2=0x7f8d4006d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.537+0000 7f8d3effd640 1 --2- 172.21.15.6:0/2699643668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d400c5800 0x7f8d4006d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.537+0000 7f8d3effd640 1 -- 172.21.15.6:0/2699643668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4006d540 con 0x7f8d400c5c10 2024-05-04T00:31:41.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.537+0000 7f8d3effd640 1 --2- 172.21.15.6:0/2699643668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d400c5c10 0x7f8d4015c470 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8d3401cde0 tx=0x7f8d340192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:41.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.545+0000 7f8d27fff640 1 -- 172.21.15.6:0/2699643668 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d340b0050 con 0x7f8d400c5c10 2024-05-04T00:31:41.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.545+0000 7f8d27fff640 1 -- 172.21.15.6:0/2699643668 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d340ba070 con 0x7f8d400c5c10 2024-05-04T00:31:41.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.545+0000 7f8d45a77640 1 -- 172.21.15.6:0/2699643668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d400b5050 con 0x7f8d400c5c10 2024-05-04T00:31:41.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.545+0000 7f8d27fff640 1 -- 172.21.15.6:0/2699643668 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d340b49f0 con 0x7f8d400c5c10 2024-05-04T00:31:41.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.545+0000 7f8d45a77640 1 -- 172.21.15.6:0/2699643668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d400b3350 con 0x7f8d400c5c10 2024-05-04T00:31:41.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.549+0000 7f8d45a77640 1 -- 172.21.15.6:0/2699643668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d40069a50 con 0x7f8d400c5c10 2024-05-04T00:31:41.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.553+0000 7f7fb0ff9640 1 -- 172.21.15.6:0/1989758695 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7fa801a070 con 0x7f7fb4070b60 2024-05-04T00:31:41.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.557+0000 7f7fb0ff9640 1 --2- 172.21.15.6:0/1989758695 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f7fa006f450 0x7f7fa0071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.557+0000 7f7fb37fe640 1 --2- 172.21.15.6:0/1989758695 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f7fa006f450 0x7f7fa0071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.557+0000 7f7fb37fe640 1 --2- 172.21.15.6:0/1989758695 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f7fa006f450 0x7f7fa0071960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40ad000 tx=0x7f7fa4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:41.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.569+0000 7f7fb0ff9640 1 -- 172.21.15.6:0/1989758695 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f7fa8004ed0 con 0x7f7fb4070b60 2024-05-04T00:31:41.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.569+0000 7fe3fb7fe640 1 --2- 172.21.15.6:0/2208932172 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3fc06d670 0x7fe3fc1561a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe3f00097c0 tx=0x7fe3f001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e83333755238bad server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:41.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.581+0000 7f8d27fff640 1 -- 172.21.15.6:0/2699643668 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8d340b4b90 con 0x7f8d400c5c10 2024-05-04T00:31:41.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.581+0000 7f8d27fff640 1 --2- 172.21.15.6:0/2699643668 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8d2c06f400 0x7f8d2c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.581+0000 7f8d3f7fe640 1 --2- 172.21.15.6:0/2699643668 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8d2c06f400 0x7f8d2c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.581+0000 7f8d3f7fe640 1 --2- 172.21.15.6:0/2699643668 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8d2c06f400 0x7f8d2c071910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009690 tx=0x7f8d30006c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:41.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.585+0000 7f8d27fff640 1 -- 172.21.15.6:0/2699643668 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f8d340ab4e0 con 0x7f8d400c5c10 2024-05-04T00:31:41.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.593+0000 7f87d359e640 1 -- 172.21.15.6:0/532889086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f87d4050880 con 0x7f87d414ec40 2024-05-04T00:31:41.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.601+0000 7fa5a599a640 1 --2- 172.21.15.6:0/2051767490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5a0152ed0 0x7fa5a0073780 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009870 tx=0x7fa59c01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9a3fab492b4a7e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:41.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.609+0000 7f710b7fe640 1 -- 172.21.15.6:0/2432174632 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71040b2070 con 0x7f710c0c8480 2024-05-04T00:31:41.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.609+0000 7f710b7fe640 1 -- 172.21.15.6:0/2432174632 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71040a5830 con 0x7f710c0c8480 2024-05-04T00:31:41.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.609+0000 7f710b7fe640 1 -- 172.21.15.6:0/2432174632 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71040a5c00 con 0x7f710c0c8480 2024-05-04T00:31:41.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.609+0000 7f71125b1640 1 -- 172.21.15.6:0/2432174632 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f710c0c8480 msgr2=0x7f710c1647d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.609+0000 7f71125b1640 1 --2- 172.21.15.6:0/2432174632 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f710c0c8480 0x7f710c1647d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7104009d90 tx=0x7f710401c970 comp rx=0 tx=0).stop 2024-05-04T00:31:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.609+0000 7f71125b1640 1 -- 172.21.15.6:0/2432174632 shutdown_connections 2024-05-04T00:31:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.609+0000 7f71125b1640 1 --2- 172.21.15.6:0/2432174632 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f710c0c8480 0x7f710c1647d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.609+0000 7f71125b1640 1 -- 172.21.15.6:0/2432174632 >> 172.21.15.6:0/2432174632 conn(0x7f710c0ce410 msgr2=0x7f710c0ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.609+0000 7f71125b1640 1 -- 172.21.15.6:0/2432174632 shutdown_connections 2024-05-04T00:31:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.609+0000 7f71125b1640 1 -- 172.21.15.6:0/2432174632 wait complete. 2024-05-04T00:31:41.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.613+0000 7f71125b1640 1 Processor -- start 2024-05-04T00:31:41.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.613+0000 7f71125b1640 1 -- start start 2024-05-04T00:31:41.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.613+0000 7f71125b1640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f710c0c8480 0x7f710c157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.613+0000 7f71125b1640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f710c152ed0 0x7f710c1f7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.613+0000 7f71125b1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f710c1532e0 0x7f710c1517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.613+0000 7f71125b1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f710c073e90 con 0x7f710c1532e0 2024-05-04T00:31:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.613+0000 7f71125b1640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f710c0c6490 con 0x7f710c0c8480 2024-05-04T00:31:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.613+0000 7f71125b1640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f710c074010 con 0x7f710c152ed0 2024-05-04T00:31:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.613+0000 7f7fb0ff9640 1 -- 172.21.15.6:0/1989758695 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7fa8021080 con 0x7f7fb4070b60 2024-05-04T00:31:41.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.617+0000 7fe53a7fc640 1 -- 172.21.15.6:0/989471797 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c019070 con 0x7fe5440731c0 2024-05-04T00:31:41.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.617+0000 7fe53a7fc640 1 -- 172.21.15.6:0/989471797 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe53c00cba0 con 0x7fe5440731c0 2024-05-04T00:31:41.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.617+0000 7fe53a7fc640 1 -- 172.21.15.6:0/989471797 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c014440 con 0x7fe5440731c0 2024-05-04T00:31:41.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.617+0000 7fe54ac19640 1 -- 172.21.15.6:0/989471797 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5441efe90 con 0x7fe5440731c0 2024-05-04T00:31:41.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.617+0000 7f4298ff9640 1 -- 172.21.15.6:0/3928684639 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4290019ac0 con 0x7f429c160870 2024-05-04T00:31:41.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.617+0000 7fe54ac19640 1 -- 172.21.15.6:0/989471797 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5440d1000 con 0x7fe5440731c0 2024-05-04T00:31:41.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.617+0000 7fe54ac19640 1 -- 172.21.15.6:0/989471797 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5440d1240 con 0x7fe5440731c0 2024-05-04T00:31:41.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.625+0000 7fa5a4998640 1 -- 172.21.15.6:0/2051767490 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c0b0070 con 0x7fa5a0152ed0 2024-05-04T00:31:41.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.625+0000 7fa5a4998640 1 -- 172.21.15.6:0/2051767490 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa59c0ab600 con 0x7fa5a0152ed0 2024-05-04T00:31:41.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.625+0000 7fa5a4998640 1 -- 172.21.15.6:0/2051767490 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c0ab9d0 con 0x7fa5a0152ed0 2024-05-04T00:31:41.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.629+0000 7fa5a7bfe640 1 -- 172.21.15.6:0/2051767490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5a0152ed0 msgr2=0x7fa5a0073780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.629+0000 7fa5a7bfe640 1 --2- 172.21.15.6:0/2051767490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5a0152ed0 0x7fa5a0073780 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009870 tx=0x7fa59c01c560 comp rx=0 tx=0).stop 2024-05-04T00:31:41.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.629+0000 7fa5a7bfe640 1 -- 172.21.15.6:0/2051767490 shutdown_connections 2024-05-04T00:31:41.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.629+0000 7fa5a7bfe640 1 --2- 172.21.15.6:0/2051767490 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5a01532e0 0x7fa5a0073cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.629+0000 7fa5a7bfe640 1 --2- 172.21.15.6:0/2051767490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5a0152ed0 0x7fa5a0073780 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.629+0000 7fa5a7bfe640 1 -- 172.21.15.6:0/2051767490 >> 172.21.15.6:0/2051767490 conn(0x7fa5a00ce410 msgr2=0x7fa5a00ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:41.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.629+0000 7fa5a7bfe640 1 -- 172.21.15.6:0/2051767490 shutdown_connections 2024-05-04T00:31:41.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.629+0000 7fa5a7bfe640 1 -- 172.21.15.6:0/2051767490 wait complete. 2024-05-04T00:31:41.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.629+0000 7fa5a7bfe640 1 Processor -- start 2024-05-04T00:31:41.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.629+0000 7fa5a7bfe640 1 -- start start 2024-05-04T00:31:41.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.633+0000 7fa5a7bfe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5a00c7d70 0x7fa5a0162b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.633+0000 7fa5a7bfe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5a0152ed0 0x7fa5a014f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.633+0000 7fa5a7bfe640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5a01532e0 0x7fa5a00631c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.633+0000 7fa5a7bfe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a00c94a0 con 0x7fa5a0152ed0 2024-05-04T00:31:41.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.633+0000 7fa5a7bfe640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a00c9320 con 0x7fa5a01532e0 2024-05-04T00:31:41.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.633+0000 7fa5a7bfe640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a00cab10 con 0x7fa5a00c7d70 2024-05-04T00:31:41.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.641+0000 7f710bfff640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f710c0c8480 0x7f710c157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.641+0000 7f710bfff640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f710c0c8480 0x7f710c157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:55130/0 (socket says 172.21.15.6:55130) 2024-05-04T00:31:41.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.641+0000 7f710bfff640 1 -- 172.21.15.6:0/2486161398 learned_addr learned my addr 172.21.15.6:0/2486161398 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:41.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.677+0000 7f710bfff640 1 -- 172.21.15.6:0/2486161398 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f710c152ed0 msgr2=0x7f710c1f7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.677+0000 7f710bfff640 1 --2- 172.21.15.6:0/2486161398 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f710c152ed0 0x7f710c1f7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.677+0000 7f710bfff640 1 -- 172.21.15.6:0/2486161398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f710c1532e0 msgr2=0x7f710c1517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.677+0000 7f710bfff640 1 --2- 172.21.15.6:0/2486161398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f710c1532e0 0x7f710c1517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.677+0000 7f710bfff640 1 -- 172.21.15.6:0/2486161398 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c1450b0 con 0x7f710c0c8480 2024-05-04T00:31:41.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.681+0000 7f710bfff640 1 --2- 172.21.15.6:0/2486161398 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f710c0c8480 0x7f710c157320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00b3e0 tx=0x7f70fc00b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:41.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.773+0000 7f7fba4b0640 1 -- 172.21.15.6:0/1989758695 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7fb40c42d0 con 0x7f7fb4070b60 2024-05-04T00:31:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.777+0000 7f42a23cc640 1 -- 172.21.15.6:0/3928684639 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f427c005860 con 0x7f429c160870 2024-05-04T00:31:41.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.793+0000 7fe3faffd640 1 -- 172.21.15.6:0/2208932172 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f00b5070 con 0x7fe3fc06d670 2024-05-04T00:31:41.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.793+0000 7fe3faffd640 1 -- 172.21.15.6:0/2208932172 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3f00a8990 con 0x7fe3fc06d670 2024-05-04T00:31:41.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.793+0000 7fe3faffd640 1 -- 172.21.15.6:0/2208932172 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f00a8d60 con 0x7fe3fc06d670 2024-05-04T00:31:41.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.793+0000 7fe402785640 1 -- 172.21.15.6:0/2208932172 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3fc06d670 msgr2=0x7fe3fc1561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.793+0000 7fe402785640 1 --2- 172.21.15.6:0/2208932172 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3fc06d670 0x7fe3fc1561a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe3f00097c0 tx=0x7fe3f001ec90 comp rx=0 tx=0).stop 2024-05-04T00:31:41.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.793+0000 7fe402785640 1 -- 172.21.15.6:0/2208932172 shutdown_connections 2024-05-04T00:31:41.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.793+0000 7fe402785640 1 --2- 172.21.15.6:0/2208932172 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3fc0c91d0 0x7fe3fc0631c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.793+0000 7fe402785640 1 --2- 172.21.15.6:0/2208932172 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3fc06d670 0x7fe3fc1561a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.793+0000 7fe402785640 1 -- 172.21.15.6:0/2208932172 >> 172.21.15.6:0/2208932172 conn(0x7fe3fc0ce410 msgr2=0x7fe3fc0ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:41.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.793+0000 7fe402785640 1 -- 172.21.15.6:0/2208932172 shutdown_connections 2024-05-04T00:31:41.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.793+0000 7fe402785640 1 -- 172.21.15.6:0/2208932172 wait complete. 2024-05-04T00:31:41.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.793+0000 7fe402785640 1 Processor -- start 2024-05-04T00:31:41.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.793+0000 7fe402785640 1 -- start start 2024-05-04T00:31:41.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.797+0000 7fe402785640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3fc06c8a0 0x7fe3fc0cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.797+0000 7fe402785640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3fc06d670 0x7fe3fc14f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.797+0000 7fe402785640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3fc0c91d0 0x7fe3fc153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.797+0000 7fe402785640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc15fd50 con 0x7fe3fc0c91d0 2024-05-04T00:31:41.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.797+0000 7fe402785640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc15fa70 con 0x7fe3fc06c8a0 2024-05-04T00:31:41.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.797+0000 7fe402785640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe3fc0c95e0 con 0x7fe3fc06d670 2024-05-04T00:31:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.809+0000 7f71097fa640 1 -- 172.21.15.6:0/2486161398 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc015020 con 0x7f710c0c8480 2024-05-04T00:31:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.809+0000 7f71097fa640 1 -- 172.21.15.6:0/2486161398 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70fc011850 con 0x7f710c0c8480 2024-05-04T00:31:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.809+0000 7f71097fa640 1 -- 172.21.15.6:0/2486161398 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc011c40 con 0x7f710c0c8480 2024-05-04T00:31:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.809+0000 7f71125b1640 1 -- 172.21.15.6:0/2486161398 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710c157860 con 0x7f710c0c8480 2024-05-04T00:31:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.809+0000 7f71125b1640 1 -- 172.21.15.6:0/2486161398 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f710c144dd0 con 0x7f710c0c8480 2024-05-04T00:31:41.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.809+0000 7f71125b1640 1 -- 172.21.15.6:0/2486161398 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f710c069a50 con 0x7f710c0c8480 2024-05-04T00:31:41.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.817+0000 7f7fb0ff9640 1 -- 172.21.15.6:0/1989758695 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7fa805b6f0 con 0x7f7fb4070b60 2024-05-04T00:31:41.821 INFO:teuthology.orchestra.run.smithi006.stdout:64424509457 2024-05-04T00:31:41.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.821+0000 7f7fba4b0640 1 -- 172.21.15.6:0/1989758695 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f7fa006f450 msgr2=0x7f7fa0071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.821+0000 7f7fba4b0640 1 --2- 172.21.15.6:0/1989758695 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f7fa006f450 0x7f7fa0071960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40ad000 tx=0x7f7fa4008040 comp rx=0 tx=0).stop 2024-05-04T00:31:41.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.821+0000 7f7fba4b0640 1 -- 172.21.15.6:0/1989758695 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fb4070b60 msgr2=0x7f7fb415c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.821+0000 7f7fba4b0640 1 --2- 172.21.15.6:0/1989758695 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fb4070b60 0x7f7fb415c2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800c3c0 tx=0x7f7fa800c880 comp rx=0 tx=0).stop 2024-05-04T00:31:41.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.821+0000 7fe3fbfff640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3fc06c8a0 0x7fe3fc0cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.821+0000 7f7fba4b0640 1 -- 172.21.15.6:0/1989758695 shutdown_connections 2024-05-04T00:31:41.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.821+0000 7f7fba4b0640 1 --2- 172.21.15.6:0/1989758695 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f7fa006f450 0x7f7fa0071960 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.821+0000 7f7fba4b0640 1 --2- 172.21.15.6:0/1989758695 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7fb4072ea0 0x7f7fb4164e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.821+0000 7f7fba4b0640 1 --2- 172.21.15.6:0/1989758695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fb4072a90 0x7f7fb4163fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.821+0000 7f7fba4b0640 1 --2- 172.21.15.6:0/1989758695 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fb4070b60 0x7f7fb415c2f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.821+0000 7f7fba4b0640 1 -- 172.21.15.6:0/1989758695 >> 172.21.15.6:0/1989758695 conn(0x7f7fb406cf70 msgr2=0x7f7fb4166af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.821+0000 7f7fba4b0640 1 -- 172.21.15.6:0/1989758695 shutdown_connections 2024-05-04T00:31:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.821+0000 7f7fba4b0640 1 -- 172.21.15.6:0/1989758695 wait complete. 2024-05-04T00:31:41.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509457 for osd.4 2024-05-04T00:31:41.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.885+0000 7f8d27fff640 1 -- 172.21.15.6:0/2699643668 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8d34016130 con 0x7f8d400c5c10 2024-05-04T00:31:41.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.913+0000 7fe400d22640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3fc0c91d0 0x7fe3fc153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.917+0000 7f87c2ffd640 1 -- 172.21.15.6:0/532889086 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f87cc0f90a0 con 0x7f87d414ec40 2024-05-04T00:31:41.918 INFO:teuthology.orchestra.run.smithi006.stdout:64424509458 2024-05-04T00:31:41.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.917+0000 7fa5a5199640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5a0152ed0 0x7fa5a014f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.917+0000 7fa5a5199640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5a0152ed0 0x7fa5a014f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40844/0 (socket says 172.21.15.6:40844) 2024-05-04T00:31:41.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.917+0000 7fa5a5199640 1 -- 172.21.15.6:0/1754736137 learned_addr learned my addr 172.21.15.6:0/1754736137 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:41.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.917+0000 7f87d359e640 1 -- 172.21.15.6:0/532889086 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f87b406f450 msgr2=0x7f87b4071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.917+0000 7f87d359e640 1 --2- 172.21.15.6:0/532889086 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f87b406f450 0x7f87b4071960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f87c400aae0 tx=0x7f87c4008040 comp rx=0 tx=0).stop 2024-05-04T00:31:41.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.917+0000 7f87d359e640 1 -- 172.21.15.6:0/532889086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87d414ec40 msgr2=0x7f87d414d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.917+0000 7f87d359e640 1 --2- 172.21.15.6:0/532889086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87d414ec40 0x7f87d414d170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f87cc0ae000 tx=0x7f87cc01bf80 comp rx=0 tx=0).stop 2024-05-04T00:31:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.917+0000 7f87d359e640 1 -- 172.21.15.6:0/532889086 shutdown_connections 2024-05-04T00:31:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.917+0000 7f87d359e640 1 --2- 172.21.15.6:0/532889086 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87d415ba80 0x7f87d4144af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.917+0000 7f87d359e640 1 --2- 172.21.15.6:0/532889086 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f87b406f450 0x7f87b4071960 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.917+0000 7f87d359e640 1 --2- 172.21.15.6:0/532889086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87d414ec40 0x7f87d414d170 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.917+0000 7f87d359e640 1 --2- 172.21.15.6:0/532889086 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f87d406f1a0 0x7f87d41f5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.917+0000 7f87d359e640 1 -- 172.21.15.6:0/532889086 >> 172.21.15.6:0/532889086 conn(0x7f87d406cb80 msgr2=0x7f87d4073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.917+0000 7f87d359e640 1 -- 172.21.15.6:0/532889086 shutdown_connections 2024-05-04T00:31:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.917+0000 7f87d359e640 1 -- 172.21.15.6:0/532889086 wait complete. 2024-05-04T00:31:41.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.921+0000 7fe400d22640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3fc0c91d0 0x7fe3fc153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40860/0 (socket says 172.21.15.6:40860) 2024-05-04T00:31:41.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.921+0000 7fe400d22640 1 -- 172.21.15.6:0/2045607131 learned_addr learned my addr 172.21.15.6:0/2045607131 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:41.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.925+0000 7fa5a5199640 1 -- 172.21.15.6:0/1754736137 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5a00c7d70 msgr2=0x7fa5a0162b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.925+0000 7fa5a5199640 1 --2- 172.21.15.6:0/1754736137 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5a00c7d70 0x7fa5a0162b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.925+0000 7fa5a5199640 1 -- 172.21.15.6:0/1754736137 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5a01532e0 msgr2=0x7fa5a00631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.925+0000 7fa5a5199640 1 --2- 172.21.15.6:0/1754736137 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5a01532e0 0x7fa5a00631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.925+0000 7fa5a5199640 1 -- 172.21.15.6:0/1754736137 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a01630d0 con 0x7fa5a0152ed0 2024-05-04T00:31:41.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509459 got 64424509458 for osd.2 2024-05-04T00:31:41.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.949+0000 7fe53a7fc640 1 -- 172.21.15.6:0/989471797 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe53c01c070 con 0x7fe5440731c0 2024-05-04T00:31:41.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.949+0000 7fe53a7fc640 1 --2- 172.21.15.6:0/989471797 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe52806f480 0x7fe528071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:41.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.949+0000 7fe549416640 1 --2- 172.21.15.6:0/989471797 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe52806f480 0x7fe528071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:41.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.949+0000 7fe549416640 1 --2- 172.21.15.6:0/989471797 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe52806f480 0x7fe528071990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe5440768c0 tx=0x7fe540006bb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:41.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.957+0000 7fa5a5199640 1 --2- 172.21.15.6:0/1754736137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5a0152ed0 0x7fa5a014f1b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa59000b410 tx=0x7fa59000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.961+0000 7fe400d22640 1 -- 172.21.15.6:0/2045607131 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3fc06d670 msgr2=0x7fe3fc14f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.961+0000 7fe400d22640 1 --2- 172.21.15.6:0/2045607131 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3fc06d670 0x7fe3fc14f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.961+0000 7fe400d22640 1 -- 172.21.15.6:0/2045607131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3fc06c8a0 msgr2=0x7fe3fc0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.961+0000 7fe400d22640 1 --2- 172.21.15.6:0/2045607131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3fc06c8a0 0x7fe3fc0cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.961+0000 7fe400d22640 1 -- 172.21.15.6:0/2045607131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3fc155180 con 0x7fe3fc0c91d0 2024-05-04T00:31:41.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.965+0000 7fe53a7fc640 1 -- 172.21.15.6:0/989471797 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fe53c057f10 con 0x7fe5440731c0 2024-05-04T00:31:41.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.977+0000 7fa5967fc640 1 -- 172.21.15.6:0/1754736137 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa590015020 con 0x7fa5a0152ed0 2024-05-04T00:31:41.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.977+0000 7fa5967fc640 1 -- 172.21.15.6:0/1754736137 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa590011830 con 0x7fa5a0152ed0 2024-05-04T00:31:41.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.977+0000 7fa5a7bfe640 1 -- 172.21.15.6:0/1754736137 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a015a110 con 0x7fa5a0152ed0 2024-05-04T00:31:41.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.977+0000 7fa5967fc640 1 -- 172.21.15.6:0/1754736137 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa590011c20 con 0x7fa5a0152ed0 2024-05-04T00:31:41.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.977+0000 7fa5a7bfe640 1 -- 172.21.15.6:0/1754736137 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a015a3b0 con 0x7fa5a0152ed0 2024-05-04T00:31:41.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.981+0000 7fa5a7bfe640 1 -- 172.21.15.6:0/1754736137 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a0069a50 con 0x7fa5a0152ed0 2024-05-04T00:31:41.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:41.985+0000 7fe53a7fc640 1 -- 172.21.15.6:0/989471797 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe5440d1240 con 0x7fe5440731c0 2024-05-04T00:31:42.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.005+0000 7f4298ff9640 1 -- 172.21.15.6:0/3928684639 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f42900fa430 con 0x7f429c160870 2024-05-04T00:31:42.011 INFO:teuthology.orchestra.run.smithi006.stdout:64424509457 2024-05-04T00:31:42.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.009+0000 7f42a23cc640 1 -- 172.21.15.6:0/3928684639 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f428806f400 msgr2=0x7f4288071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:42.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.009+0000 7f42a23cc640 1 --2- 172.21.15.6:0/3928684639 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f428806f400 0x7f4288071910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f429400a400 tx=0x7f429400d040 comp rx=0 tx=0).stop 2024-05-04T00:31:42.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.009+0000 7f42a23cc640 1 -- 172.21.15.6:0/3928684639 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f429c160870 msgr2=0x7f429c1498e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:42.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.009+0000 7f42a23cc640 1 --2- 172.21.15.6:0/3928684639 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f429c160870 0x7f429c1498e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4290020800 tx=0x7f429001cd00 comp rx=0 tx=0).stop 2024-05-04T00:31:42.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.009+0000 7f42a23cc640 1 -- 172.21.15.6:0/3928684639 shutdown_connections 2024-05-04T00:31:42.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.009+0000 7f42a23cc640 1 --2- 172.21.15.6:0/3928684639 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f428806f400 0x7f4288071910 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.009+0000 7f42a23cc640 1 --2- 172.21.15.6:0/3928684639 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f429c160870 0x7f429c1498e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.009+0000 7f42a23cc640 1 --2- 172.21.15.6:0/3928684639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f429c158930 0x7f429c146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.009+0000 7f42a23cc640 1 --2- 172.21.15.6:0/3928684639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f429c0c8140 0x7f429c14d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.009+0000 7f42a23cc640 1 -- 172.21.15.6:0/3928684639 >> 172.21.15.6:0/3928684639 conn(0x7f429c06c780 msgr2=0x7f429c06cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:42.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.009+0000 7f42a23cc640 1 -- 172.21.15.6:0/3928684639 shutdown_connections 2024-05-04T00:31:42.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.009+0000 7f42a23cc640 1 -- 172.21.15.6:0/3928684639 wait complete. 2024-05-04T00:31:42.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509457 for osd.0 2024-05-04T00:31:42.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.061+0000 7f8d45a77640 1 -- 172.21.15.6:0/2699643668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f8d401578a0 con 0x7f8d400c5c10 2024-05-04T00:31:42.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.177+0000 7f71097fa640 1 -- 172.21.15.6:0/2486161398 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f70fc018020 con 0x7f710c0c8480 2024-05-04T00:31:42.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.177+0000 7f71097fa640 1 --2- 172.21.15.6:0/2486161398 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f70ec06f450 0x7f70ec071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:42.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.177+0000 7f7103fff640 1 --2- 172.21.15.6:0/2486161398 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f70ec06f450 0x7f70ec071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:42.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.177+0000 7f7103fff640 1 --2- 172.21.15.6:0/2486161398 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f70ec06f450 0x7f70ec071960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f70f4005890 tx=0x7f70f4007a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:42.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.189+0000 7f71097fa640 1 -- 172.21.15.6:0/2486161398 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f70fc011de0 con 0x7f710c0c8480 2024-05-04T00:31:42.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.205+0000 7fe54ac19640 1 -- 172.21.15.6:0/989471797 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe544050880 con 0x7fe5440731c0 2024-05-04T00:31:42.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.217+0000 7fe53a7fc640 1 -- 172.21.15.6:0/989471797 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe53c023020 con 0x7fe5440731c0 2024-05-04T00:31:42.221 INFO:teuthology.orchestra.run.smithi006.stdout:60129542160 2024-05-04T00:31:42.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.221+0000 7fe54ac19640 1 -- 172.21.15.6:0/989471797 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe52806f480 msgr2=0x7fe528071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:42.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.221+0000 7fe54ac19640 1 --2- 172.21.15.6:0/989471797 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe52806f480 0x7fe528071990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe5440768c0 tx=0x7fe540006bb0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.221+0000 7fe54ac19640 1 -- 172.21.15.6:0/989471797 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5440731c0 msgr2=0x7fe5440cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:42.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.221+0000 7fe54ac19640 1 --2- 172.21.15.6:0/989471797 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5440731c0 0x7fe5440cf440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00ba80 tx=0x7fe53c00bf40 comp rx=0 tx=0).stop 2024-05-04T00:31:42.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.221+0000 7fe54ac19640 1 -- 172.21.15.6:0/989471797 shutdown_connections 2024-05-04T00:31:42.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.221+0000 7fe54ac19640 1 --2- 172.21.15.6:0/989471797 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe54415fb80 0x7fe54414fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.221+0000 7fe54ac19640 1 --2- 172.21.15.6:0/989471797 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe52806f480 0x7fe528071990 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.221+0000 7fe54ac19640 1 --2- 172.21.15.6:0/989471797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5440cce50 0x7fe5441ef450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.221+0000 7fe54ac19640 1 --2- 172.21.15.6:0/989471797 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5440731c0 0x7fe5440cf440 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.221+0000 7fe54ac19640 1 -- 172.21.15.6:0/989471797 >> 172.21.15.6:0/989471797 conn(0x7fe54406cd80 msgr2=0x7fe54415b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:42.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.221+0000 7fe54ac19640 1 -- 172.21.15.6:0/989471797 shutdown_connections 2024-05-04T00:31:42.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.221+0000 7fe54ac19640 1 -- 172.21.15.6:0/989471797 wait complete. 2024-05-04T00:31:42.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.237+0000 7f71097fa640 1 -- 172.21.15.6:0/2486161398 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f70fc01f030 con 0x7f710c0c8480 2024-05-04T00:31:42.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542162 got 60129542160 for osd.7 2024-05-04T00:31:42.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.309+0000 7fe400d22640 1 --2- 172.21.15.6:0/2045607131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3fc0c91d0 0x7fe3fc153670 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400b970 tx=0x7fe3f400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:42.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.345+0000 7fa5967fc640 1 -- 172.21.15.6:0/1754736137 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa590018020 con 0x7fa5a0152ed0 2024-05-04T00:31:42.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.345+0000 7fa5967fc640 1 --2- 172.21.15.6:0/1754736137 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fa58406f400 0x7fa584071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:42.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.345+0000 7fa5a599a640 1 --2- 172.21.15.6:0/1754736137 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fa58406f400 0x7fa584071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:42.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.349+0000 7fa5a599a640 1 --2- 172.21.15.6:0/1754736137 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fa58406f400 0x7fa584071910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa59c0ad000 tx=0x7fa59c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.381+0000 7fa5967fc640 1 -- 172.21.15.6:0/1754736137 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fa590011dc0 con 0x7fa5a0152ed0 2024-05-04T00:31:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.381+0000 7fa5967fc640 1 -- 172.21.15.6:0/1754736137 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa59001f020 con 0x7fa5a0152ed0 2024-05-04T00:31:42.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.401+0000 7fe3f8ff9640 1 -- 172.21.15.6:0/2045607131 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4019070 con 0x7fe3fc0c91d0 2024-05-04T00:31:42.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.401+0000 7fe3f8ff9640 1 -- 172.21.15.6:0/2045607131 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3f400cb00 con 0x7fe3fc0c91d0 2024-05-04T00:31:42.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.401+0000 7fe3f8ff9640 1 -- 172.21.15.6:0/2045607131 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4014440 con 0x7fe3fc0c91d0 2024-05-04T00:31:42.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.401+0000 7fe402785640 1 -- 172.21.15.6:0/2045607131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3fc0ccf50 con 0x7fe3fc0c91d0 2024-05-04T00:31:42.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.401+0000 7fe402785640 1 -- 172.21.15.6:0/2045607131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3fc152960 con 0x7fe3fc0c91d0 2024-05-04T00:31:42.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.401+0000 7f8d27fff640 1 -- 172.21.15.6:0/2699643668 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8d340f6c60 con 0x7f8d400c5c10 2024-05-04T00:31:42.406 INFO:teuthology.orchestra.run.smithi006.stdout:64424509457 2024-05-04T00:31:42.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.405+0000 7fe402785640 1 -- 172.21.15.6:0/2045607131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3fc1524b0 con 0x7fe3fc0c91d0 2024-05-04T00:31:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.405+0000 7f8d45a77640 1 -- 172.21.15.6:0/2699643668 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8d2c06f400 msgr2=0x7f8d2c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.405+0000 7f8d45a77640 1 --2- 172.21.15.6:0/2699643668 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8d2c06f400 0x7f8d2c071910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009690 tx=0x7f8d30006c00 comp rx=0 tx=0).stop 2024-05-04T00:31:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.405+0000 7f8d45a77640 1 -- 172.21.15.6:0/2699643668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d400c5c10 msgr2=0x7f8d4015c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.405+0000 7f8d45a77640 1 --2- 172.21.15.6:0/2699643668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d400c5c10 0x7f8d4015c470 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8d3401cde0 tx=0x7f8d340192e0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.405+0000 7f8d45a77640 1 -- 172.21.15.6:0/2699643668 shutdown_connections 2024-05-04T00:31:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.405+0000 7f8d45a77640 1 --2- 172.21.15.6:0/2699643668 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8d2c06f400 0x7f8d2c071910 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.405+0000 7f8d45a77640 1 --2- 172.21.15.6:0/2699643668 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8d401541f0 0x7f8d40144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.405+0000 7f8d45a77640 1 --2- 172.21.15.6:0/2699643668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d400c5c10 0x7f8d4015c470 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.405+0000 7f8d45a77640 1 --2- 172.21.15.6:0/2699643668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d400c5800 0x7f8d4006d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.405+0000 7f8d45a77640 1 -- 172.21.15.6:0/2699643668 >> 172.21.15.6:0/2699643668 conn(0x7f8d40072ce0 msgr2=0x7f8d40157ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.405+0000 7f8d45a77640 1 -- 172.21.15.6:0/2699643668 shutdown_connections 2024-05-04T00:31:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.405+0000 7f8d45a77640 1 -- 172.21.15.6:0/2699643668 wait complete. 2024-05-04T00:31:42.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509457 for osd.6 2024-05-04T00:31:42.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.453+0000 7f71125b1640 1 -- 172.21.15.6:0/2486161398 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f710c1447a0 con 0x7f710c0c8480 2024-05-04T00:31:42.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.461+0000 7f71097fa640 1 -- 172.21.15.6:0/2486161398 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f70fc064030 con 0x7f710c0c8480 2024-05-04T00:31:42.466 INFO:teuthology.orchestra.run.smithi006.stdout:60129542160 2024-05-04T00:31:42.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.465+0000 7f71125b1640 1 -- 172.21.15.6:0/2486161398 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f70ec06f450 msgr2=0x7f70ec071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:42.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.465+0000 7f71125b1640 1 --2- 172.21.15.6:0/2486161398 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f70ec06f450 0x7f70ec071960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f70f4005890 tx=0x7f70f4007a30 comp rx=0 tx=0).stop 2024-05-04T00:31:42.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.465+0000 7f71125b1640 1 -- 172.21.15.6:0/2486161398 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f710c0c8480 msgr2=0x7f710c157320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:42.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.465+0000 7f71125b1640 1 --2- 172.21.15.6:0/2486161398 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f710c0c8480 0x7f710c157320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00b3e0 tx=0x7f70fc00b8a0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.465+0000 7f71125b1640 1 -- 172.21.15.6:0/2486161398 shutdown_connections 2024-05-04T00:31:42.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.465+0000 7f71125b1640 1 --2- 172.21.15.6:0/2486161398 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f70ec06f450 0x7f70ec071960 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.465+0000 7f71125b1640 1 --2- 172.21.15.6:0/2486161398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f710c1532e0 0x7f710c1517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.465+0000 7f71125b1640 1 --2- 172.21.15.6:0/2486161398 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f710c152ed0 0x7f710c1f7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.465+0000 7f71125b1640 1 --2- 172.21.15.6:0/2486161398 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f710c0c8480 0x7f710c157320 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.465+0000 7f71125b1640 1 -- 172.21.15.6:0/2486161398 >> 172.21.15.6:0/2486161398 conn(0x7f710c0ce410 msgr2=0x7f710c156190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:42.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.465+0000 7f71125b1640 1 -- 172.21.15.6:0/2486161398 shutdown_connections 2024-05-04T00:31:42.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.465+0000 7f71125b1640 1 -- 172.21.15.6:0/2486161398 wait complete. 2024-05-04T00:31:42.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542162 got 60129542160 for osd.5 2024-05-04T00:31:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.569+0000 7fa5a7bfe640 1 -- 172.21.15.6:0/1754736137 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa5a0150c50 con 0x7fa5a0152ed0 2024-05-04T00:31:42.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.737+0000 7fe3f8ff9640 1 -- 172.21.15.6:0/2045607131 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe3f401c070 con 0x7fe3fc0c91d0 2024-05-04T00:31:42.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.741+0000 7fe3f8ff9640 1 --2- 172.21.15.6:0/2045607131 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe3e806f430 0x7fe3e8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:42.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.741+0000 7fe3fbfff640 1 --2- 172.21.15.6:0/2045607131 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe3e806f430 0x7fe3e8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:42.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.741+0000 7fe3fbfff640 1 --2- 172.21.15.6:0/2045607131 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe3e806f430 0x7fe3e8071940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec000f70 tx=0x7fe3ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:42.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.777+0000 7fe3f8ff9640 1 -- 172.21.15.6:0/2045607131 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fe3f4057e80 con 0x7fe3fc0c91d0 2024-05-04T00:31:42.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.777+0000 7fe3f8ff9640 1 -- 172.21.15.6:0/2045607131 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe3f4023020 con 0x7fe3fc0c91d0 2024-05-04T00:31:42.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.797+0000 7fa5967fc640 1 -- 172.21.15.6:0/1754736137 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa59005c7a0 con 0x7fa5a0152ed0 2024-05-04T00:31:42.799 INFO:teuthology.orchestra.run.smithi006.stdout:60129542160 2024-05-04T00:31:42.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.801+0000 7fa5a7bfe640 1 -- 172.21.15.6:0/1754736137 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fa58406f400 msgr2=0x7fa584071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:42.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.801+0000 7fa5a7bfe640 1 --2- 172.21.15.6:0/1754736137 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fa58406f400 0x7fa584071910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa59c0ad000 tx=0x7fa59c008040 comp rx=0 tx=0).stop 2024-05-04T00:31:42.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.801+0000 7fa5a7bfe640 1 -- 172.21.15.6:0/1754736137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5a0152ed0 msgr2=0x7fa5a014f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:42.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.801+0000 7fa5a7bfe640 1 --2- 172.21.15.6:0/1754736137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5a0152ed0 0x7fa5a014f1b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa59000b410 tx=0x7fa59000b8d0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.801+0000 7fa5a7bfe640 1 -- 172.21.15.6:0/1754736137 shutdown_connections 2024-05-04T00:31:42.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.801+0000 7fa5a7bfe640 1 --2- 172.21.15.6:0/1754736137 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5a01532e0 0x7fa5a00631c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.801+0000 7fa5a7bfe640 1 --2- 172.21.15.6:0/1754736137 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fa58406f400 0x7fa584071910 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.801+0000 7fa5a7bfe640 1 --2- 172.21.15.6:0/1754736137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5a0152ed0 0x7fa5a014f1b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.801+0000 7fa5a7bfe640 1 --2- 172.21.15.6:0/1754736137 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5a00c7d70 0x7fa5a0162b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.801+0000 7fa5a7bfe640 1 -- 172.21.15.6:0/1754736137 >> 172.21.15.6:0/1754736137 conn(0x7fa5a00ce410 msgr2=0x7fa5a0152560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.801+0000 7fa5a7bfe640 1 -- 172.21.15.6:0/1754736137 shutdown_connections 2024-05-04T00:31:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.801+0000 7fa5a7bfe640 1 -- 172.21.15.6:0/1754736137 wait complete. 2024-05-04T00:31:42.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542162 got 60129542160 for osd.3 2024-05-04T00:31:42.842 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-04T00:31:42.950 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-04T00:31:42.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.969+0000 7fe402785640 1 -- 172.21.15.6:0/2045607131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe3fc069a50 con 0x7fe3fc0c91d0 2024-05-04T00:31:42.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.977+0000 7f08fb469640 1 Processor -- start 2024-05-04T00:31:42.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.977+0000 7f08fb469640 1 -- start start 2024-05-04T00:31:42.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.977+0000 7f08fb469640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f08f41564d0 0x7f08f40cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:42.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.977+0000 7f08fb469640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f08f415fab0 0x7f08f4166a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:42.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.977+0000 7f08fb469640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f40cd600 con 0x7f08f415f6a0 2024-05-04T00:31:42.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.977+0000 7f08fb469640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f08f40c9b90 con 0x7f08f415fab0 2024-05-04T00:31:42.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.977+0000 7f08fb469640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f08f41568e0 con 0x7f08f41564d0 2024-05-04T00:31:42.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.977+0000 7fe3f8ff9640 1 -- 172.21.15.6:0/2045607131 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe3fc155180 con 0x7fe3fc0c91d0 2024-05-04T00:31:42.980 INFO:teuthology.orchestra.run.smithi006.stdout:64424509459 2024-05-04T00:31:42.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.981+0000 7fe402785640 1 -- 172.21.15.6:0/2045607131 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe3e806f430 msgr2=0x7fe3e8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:42.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.981+0000 7fe402785640 1 --2- 172.21.15.6:0/2045607131 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe3e806f430 0x7fe3e8071940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec000f70 tx=0x7fe3ec009040 comp rx=0 tx=0).stop 2024-05-04T00:31:42.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.981+0000 7fe402785640 1 -- 172.21.15.6:0/2045607131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3fc0c91d0 msgr2=0x7fe3fc153670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:42.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.981+0000 7fe402785640 1 --2- 172.21.15.6:0/2045607131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3fc0c91d0 0x7fe3fc153670 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400b970 tx=0x7fe3f400be30 comp rx=0 tx=0).stop 2024-05-04T00:31:42.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.981+0000 7fe402785640 1 -- 172.21.15.6:0/2045607131 shutdown_connections 2024-05-04T00:31:42.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.981+0000 7fe402785640 1 --2- 172.21.15.6:0/2045607131 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe3e806f430 0x7fe3e8071940 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.981+0000 7fe402785640 1 --2- 172.21.15.6:0/2045607131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3fc0c91d0 0x7fe3fc153670 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.981+0000 7fe402785640 1 --2- 172.21.15.6:0/2045607131 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3fc06d670 0x7fe3fc14f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.981+0000 7fe402785640 1 --2- 172.21.15.6:0/2045607131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3fc06c8a0 0x7fe3fc0cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.981+0000 7fe402785640 1 -- 172.21.15.6:0/2045607131 >> 172.21.15.6:0/2045607131 conn(0x7fe3fc0ce410 msgr2=0x7fe3fc15a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:42.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.981+0000 7fe402785640 1 -- 172.21.15.6:0/2045607131 shutdown_connections 2024-05-04T00:31:42.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.981+0000 7fe402785640 1 -- 172.21.15.6:0/2045607131 wait complete. 2024-05-04T00:31:42.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.981+0000 7f08f9a06640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f08f415fab0 0x7f08f4166a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:42.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.981+0000 7f08f9a06640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f08f415fab0 0x7f08f4166a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40866/0 (socket says 172.21.15.6:40866) 2024-05-04T00:31:42.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.981+0000 7f08f9a06640 1 -- 172.21.15.6:0/791827021 learned_addr learned my addr 172.21.15.6:0/791827021 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:42.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.989+0000 7f08f9a06640 1 -- 172.21.15.6:0/791827021 >> v2:172.21.15.163:3300/0 conn(0x7f08f41564d0 msgr2=0x7f08f40cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:42.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.989+0000 7f08f9a06640 1 --2- 172.21.15.6:0/791827021 >> v2:172.21.15.163:3300/0 conn(0x7f08f41564d0 0x7f08f40cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:42.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.989+0000 7f08f9a06640 1 -- 172.21.15.6:0/791827021 >> v1:172.21.15.6:6789/0 conn(0x7f08f415f6a0 legacy=0x7f08f40cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:42.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.989+0000 7f08f9a06640 1 -- 172.21.15.6:0/791827021 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f40cd040 con 0x7f08f415fab0 2024-05-04T00:31:42.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.993+0000 7f08f9a06640 1 --2- 172.21.15.6:0/791827021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08f415fab0 0x7f08f4166a30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f08f40cea80 tx=0x7f08ec01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34a16175cbb8074 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:43.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.997+0000 7f08ebfff640 1 -- 172.21.15.6:0/791827021 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec0a5840 con 0x7f08f415fab0 2024-05-04T00:31:43.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.997+0000 7f08ebfff640 1 -- 172.21.15.6:0/791827021 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08ec0a59e0 con 0x7f08f415fab0 2024-05-04T00:31:43.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:42.997+0000 7f08ebfff640 1 -- 172.21.15.6:0/791827021 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec0a5db0 con 0x7f08f415fab0 2024-05-04T00:31:43.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.001+0000 7f08fb469640 1 -- 172.21.15.6:0/791827021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08f415fab0 msgr2=0x7f08f4166a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.001+0000 7f08fb469640 1 --2- 172.21.15.6:0/791827021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08f415fab0 0x7f08f4166a30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f08f40cea80 tx=0x7f08ec01c9c0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.001+0000 7f08fb469640 1 -- 172.21.15.6:0/791827021 shutdown_connections 2024-05-04T00:31:43.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.001+0000 7f08fb469640 1 --2- 172.21.15.6:0/791827021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08f415fab0 0x7f08f4166a30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.001+0000 7f08fb469640 1 --2- 172.21.15.6:0/791827021 >> v2:172.21.15.163:3300/0 conn(0x7f08f41564d0 0x7f08f40cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.001+0000 7f08fb469640 1 -- 172.21.15.6:0/791827021 >> 172.21.15.6:0/791827021 conn(0x7f08f406cb80 msgr2=0x7f08f406cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:43.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.001+0000 7f08fb469640 1 -- 172.21.15.6:0/791827021 shutdown_connections 2024-05-04T00:31:43.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.001+0000 7f08fb469640 1 -- 172.21.15.6:0/791827021 wait complete. 2024-05-04T00:31:43.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509459 got 64424509459 for osd.1 2024-05-04T00:31:43.005 DEBUG:teuthology.parallel:result is None 2024-05-04T00:31:43.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.001+0000 7f08fb469640 1 Processor -- start 2024-05-04T00:31:43.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.001+0000 7f08fb469640 1 -- start start 2024-05-04T00:31:43.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.005+0000 7f08fb469640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08f41564d0 0x7f08f415d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.005+0000 7f08fb469640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08f415f6a0 0x7f08f4144700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.005+0000 7f08fb469640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08f415fab0 0x7f08f40bee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.005+0000 7f08fb469640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f08f40cc710 con 0x7f08f415fab0 2024-05-04T00:31:43.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.005+0000 7f08fb469640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f08f40cca50 con 0x7f08f415f6a0 2024-05-04T00:31:43.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.005+0000 7f08fb469640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f08f40ca020 con 0x7f08f41564d0 2024-05-04T00:31:43.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.005+0000 7f08f9a06640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08f415fab0 0x7f08f40bee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:43.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.005+0000 7f08f9a06640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08f415fab0 0x7f08f40bee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40870/0 (socket says 172.21.15.6:40870) 2024-05-04T00:31:43.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.005+0000 7f08f9a06640 1 -- 172.21.15.6:0/1485140790 learned_addr learned my addr 172.21.15.6:0/1485140790 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:43.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.013+0000 7f08f9a06640 1 -- 172.21.15.6:0/1485140790 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08f41564d0 msgr2=0x7f08f415d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.013+0000 7f08f9a06640 1 --2- 172.21.15.6:0/1485140790 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08f41564d0 0x7f08f415d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.013+0000 7f08f9a06640 1 -- 172.21.15.6:0/1485140790 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08f415f6a0 msgr2=0x7f08f4144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.013+0000 7f08f9a06640 1 --2- 172.21.15.6:0/1485140790 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08f415f6a0 0x7f08f4144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.013+0000 7f08f9a06640 1 -- 172.21.15.6:0/1485140790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f415d7d0 con 0x7f08f415fab0 2024-05-04T00:31:43.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.017+0000 7f08f9a06640 1 --2- 172.21.15.6:0/1485140790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08f415fab0 0x7f08f40bee50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f08ec01d260 tx=0x7f08ec019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:43.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.021+0000 7f08e9ffb640 1 -- 172.21.15.6:0/1485140790 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec0bb020 con 0x7f08f415fab0 2024-05-04T00:31:43.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.021+0000 7f08e9ffb640 1 -- 172.21.15.6:0/1485140790 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08ec0b6890 con 0x7f08f415fab0 2024-05-04T00:31:43.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.021+0000 7f08e9ffb640 1 -- 172.21.15.6:0/1485140790 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec0b6c80 con 0x7f08f415fab0 2024-05-04T00:31:43.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.021+0000 7f08fb469640 1 -- 172.21.15.6:0/1485140790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f415f1a0 con 0x7f08f415fab0 2024-05-04T00:31:43.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.021+0000 7f08fb469640 1 -- 172.21.15.6:0/1485140790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f4154e40 con 0x7f08f415fab0 2024-05-04T00:31:43.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.021+0000 7f08fb469640 1 -- 172.21.15.6:0/1485140790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f406d710 con 0x7f08f415fab0 2024-05-04T00:31:43.036 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-04T00:31:43.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.089+0000 7f19a4422640 1 Processor -- start 2024-05-04T00:31:43.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.089+0000 7f19a4422640 1 -- start start 2024-05-04T00:31:43.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.089+0000 7f19a4422640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f199c0c91d0 0x7f199c0631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.089+0000 7f19a4422640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f199c06cda0 con 0x7f199c06c8a0 2024-05-04T00:31:43.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.089+0000 7f19a4422640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f199c06d080 con 0x7f199c06d670 2024-05-04T00:31:43.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.089+0000 7f19a4422640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f199c15f820 con 0x7f199c0c91d0 2024-05-04T00:31:43.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.089+0000 7f19a19bd640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f199c06d670 0x7f199c1561a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:52614/0 (socket says 172.21.15.6:52614) 2024-05-04T00:31:43.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.089+0000 7f19a19bd640 1 -- 172.21.15.6:0/3888456319 learned_addr learned my addr 172.21.15.6:0/3888456319 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.169+0000 7f51c01b5640 1 Processor -- start 2024-05-04T00:31:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.169+0000 7f51c01b5640 1 -- start start 2024-05-04T00:31:43.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.173+0000 7f51c01b5640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f51b806c8a0 0x7f51b815ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.173+0000 7f51c01b5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51b80c91d0 0x7f51b80631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.173+0000 7f51c01b5640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b815d1f0 con 0x7f51b806d670 2024-05-04T00:31:43.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.173+0000 7f51c01b5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f51b815f820 con 0x7f51b80c91d0 2024-05-04T00:31:43.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.173+0000 7f51c01b5640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f51b81600c0 con 0x7f51b806c8a0 2024-05-04T00:31:43.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.173+0000 7f51bdf51640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f51b806c8a0 0x7f51b815ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:43.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.173+0000 7f51bd750640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f51b806d670 0x7f51b81561a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:52620/0 (socket says 172.21.15.6:52620) 2024-05-04T00:31:43.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.173+0000 7f51bd750640 1 -- 172.21.15.6:0/2725562134 learned_addr learned my addr 172.21.15.6:0/2725562134 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:43.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.185+0000 7f51bdf51640 1 -- 172.21.15.6:0/2725562134 >> v2:172.21.15.6:3300/0 conn(0x7f51b80c91d0 msgr2=0x7f51b80631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:43.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.185+0000 7f51bdf51640 1 --2- 172.21.15.6:0/2725562134 >> v2:172.21.15.6:3300/0 conn(0x7f51b80c91d0 0x7f51b80631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.185+0000 7f51bdf51640 1 -- 172.21.15.6:0/2725562134 >> v1:172.21.15.163:6789/0 conn(0x7f51b806d670 legacy=0x7f51b81561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.185+0000 7f51bdf51640 1 -- 172.21.15.6:0/2725562134 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b806cda0 con 0x7f51b806c8a0 2024-05-04T00:31:43.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.197+0000 7f51bdf51640 1 --2- 172.21.15.6:0/2725562134 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51b806c8a0 0x7f51b815ccb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f51b40097c0 tx=0x7f51b401ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4c3c5eb0ee1d140 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:43.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.209+0000 7f51bcf4f640 1 -- 172.21.15.6:0/2725562134 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b40b5070 con 0x7f51b806c8a0 2024-05-04T00:31:43.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.209+0000 7f51bcf4f640 1 -- 172.21.15.6:0/2725562134 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b40a8950 con 0x7f51b806c8a0 2024-05-04T00:31:43.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.209+0000 7f51bcf4f640 1 -- 172.21.15.6:0/2725562134 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b40a8d20 con 0x7f51b806c8a0 2024-05-04T00:31:43.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.209+0000 7f51c01b5640 1 -- 172.21.15.6:0/2725562134 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51b806c8a0 msgr2=0x7f51b815ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.209+0000 7f51c01b5640 1 --2- 172.21.15.6:0/2725562134 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51b806c8a0 0x7f51b815ccb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f51b40097c0 tx=0x7f51b401ec50 comp rx=0 tx=0).stop 2024-05-04T00:31:43.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.209+0000 7f51c01b5640 1 -- 172.21.15.6:0/2725562134 shutdown_connections 2024-05-04T00:31:43.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.209+0000 7f51c01b5640 1 --2- 172.21.15.6:0/2725562134 >> v2:172.21.15.6:3300/0 conn(0x7f51b80c91d0 0x7f51b80631c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.209+0000 7f51c01b5640 1 --2- 172.21.15.6:0/2725562134 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51b806c8a0 0x7f51b815ccb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.209+0000 7f51c01b5640 1 -- 172.21.15.6:0/2725562134 >> 172.21.15.6:0/2725562134 conn(0x7f51b80ce410 msgr2=0x7f51b80ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:43.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.209+0000 7f51c01b5640 1 -- 172.21.15.6:0/2725562134 shutdown_connections 2024-05-04T00:31:43.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.209+0000 7f51c01b5640 1 -- 172.21.15.6:0/2725562134 wait complete. 2024-05-04T00:31:43.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.213+0000 7f51c01b5640 1 Processor -- start 2024-05-04T00:31:43.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.213+0000 7f51c01b5640 1 -- start start 2024-05-04T00:31:43.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.217+0000 7f51c01b5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51b806c8a0 0x7f51b815a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.217+0000 7f51c01b5640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51b806d670 0x7f51b8153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.217+0000 7f51c01b5640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51b80c91d0 0x7f51b8144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.217+0000 7f51c01b5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f51b815fd50 con 0x7f51b806c8a0 2024-05-04T00:31:43.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.217+0000 7f51c01b5640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f51b815fa70 con 0x7f51b806d670 2024-05-04T00:31:43.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.217+0000 7f51c01b5640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f51b80c95e0 con 0x7f51b80c91d0 2024-05-04T00:31:43.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.217+0000 7f51be752640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51b80c91d0 0x7f51b8144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:43.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.217+0000 7f51bd750640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51b806d670 0x7f51b8153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:43.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.217+0000 7f51be752640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51b80c91d0 0x7f51b8144c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38662/0 (socket says 172.21.15.6:38662) 2024-05-04T00:31:43.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.217+0000 7f51be752640 1 -- 172.21.15.6:0/1911304244 learned_addr learned my addr 172.21.15.6:0/1911304244 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:43.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.229+0000 7f51be752640 1 -- 172.21.15.6:0/1911304244 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51b806d670 msgr2=0x7f51b8153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.229+0000 7f51be752640 1 --2- 172.21.15.6:0/1911304244 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51b806d670 0x7f51b8153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.229+0000 7f51be752640 1 -- 172.21.15.6:0/1911304244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51b806c8a0 msgr2=0x7f51b815a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.229+0000 7f51be752640 1 --2- 172.21.15.6:0/1911304244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51b806c8a0 0x7f51b815a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.229+0000 7f51be752640 1 -- 172.21.15.6:0/1911304244 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b80c79d0 con 0x7f51b80c91d0 2024-05-04T00:31:43.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.237+0000 7f51be752640 1 --2- 172.21.15.6:0/1911304244 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51b80c91d0 0x7f51b8144c20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f51b000b9a0 tx=0x7f51b000be60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:43.242 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-04T00:31:43.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.249+0000 7f51ae7fc640 1 -- 172.21.15.6:0/1911304244 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b0019070 con 0x7f51b80c91d0 2024-05-04T00:31:43.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.249+0000 7f51ae7fc640 1 -- 172.21.15.6:0/1911304244 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b000cbc0 con 0x7f51b80c91d0 2024-05-04T00:31:43.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.249+0000 7f51c01b5640 1 -- 172.21.15.6:0/1911304244 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b815acb0 con 0x7f51b80c91d0 2024-05-04T00:31:43.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.249+0000 7f51c01b5640 1 -- 172.21.15.6:0/1911304244 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b8152260 con 0x7f51b80c91d0 2024-05-04T00:31:43.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.249+0000 7f51ae7fc640 1 -- 172.21.15.6:0/1911304244 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b0014440 con 0x7f51b80c91d0 2024-05-04T00:31:43.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.249+0000 7f51c01b5640 1 -- 172.21.15.6:0/1911304244 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51a00052a0 con 0x7f51b80c91d0 2024-05-04T00:31:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.333+0000 7f08e9ffb640 1 -- 172.21.15.6:0/1485140790 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f08ec0be020 con 0x7f08f415fab0 2024-05-04T00:31:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.337+0000 7f08e9ffb640 1 --2- 172.21.15.6:0/1485140790 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f08d806f480 0x7f08d8071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.337+0000 7f08f9205640 1 --2- 172.21.15.6:0/1485140790 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f08d806f480 0x7f08d8071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:43.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.337+0000 7f08f9205640 1 --2- 172.21.15.6:0/1485140790 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f08d806f480 0x7f08d8071990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009690 tx=0x7f08f0006c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:43.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.365+0000 7f08e9ffb640 1 -- 172.21.15.6:0/1485140790 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f08ec0b6e20 con 0x7f08f415fab0 2024-05-04T00:31:43.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.365+0000 7f08e9ffb640 1 -- 172.21.15.6:0/1485140790 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f08ec0165e0 con 0x7f08f415fab0 2024-05-04T00:31:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.385+0000 7f7606ba0640 1 Processor -- start 2024-05-04T00:31:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.385+0000 7f7606ba0640 1 -- start start 2024-05-04T00:31:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.385+0000 7f7606ba0640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76001541f0 0x7f7600159e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.385+0000 7f7606ba0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f76000c5800 0x7f76000ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.385+0000 7f7606ba0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f760015a6c0 con 0x7f76000c5c10 2024-05-04T00:31:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.385+0000 7f7606ba0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f76000c4db0 con 0x7f76000c5800 2024-05-04T00:31:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.385+0000 7f7606ba0640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f760015a9a0 con 0x7f76001541f0 2024-05-04T00:31:43.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.405+0000 7f19a29bf640 1 --2- 172.21.15.6:0/3888456319 >> v2:172.21.15.6:3300/0 conn(0x7f199c0c91d0 0x7f199c0631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:43.438 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-04T00:31:43.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.437+0000 7f19a29bf640 1 -- 172.21.15.6:0/3888456319 >> v1:172.21.15.163:6789/0 conn(0x7f199c06d670 legacy=0x7f199c1561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.437+0000 7f19a29bf640 1 -- 172.21.15.6:0/3888456319 >> v1:172.21.15.6:6789/0 conn(0x7f199c06c8a0 legacy=0x7f199c15ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:43.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.437+0000 7f19a29bf640 1 -- 172.21.15.6:0/3888456319 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199c15fa70 con 0x7f199c0c91d0 2024-05-04T00:31:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.441+0000 7f760513d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f76000c5c10 0x7f760015d470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58578/0 (socket says 172.21.15.6:58578) 2024-05-04T00:31:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.441+0000 7f760513d640 1 -- 172.21.15.6:0/3923074291 learned_addr learned my addr 172.21.15.6:0/3923074291 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.445+0000 7f19a29bf640 1 --2- 172.21.15.6:0/3888456319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f199c0c91d0 0x7f199c0631c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f199c15f9a0 tx=0x7f199401f140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae8917009a820b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:43.493 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-04T00:31:43.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.537+0000 7f75fffff640 1 --2- 172.21.15.6:0/3923074291 >> v2:172.21.15.6:3300/0 conn(0x7f76000c5800 0x7f76000ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.549+0000 7f75fffff640 1 -- 172.21.15.6:0/3923074291 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76001541f0 msgr2=0x7f7600159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.549+0000 7f75fffff640 1 --2- 172.21.15.6:0/3923074291 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76001541f0 0x7f7600159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.549+0000 7f75fffff640 1 -- 172.21.15.6:0/3923074291 >> v1:172.21.15.6:6789/0 conn(0x7f76000c5c10 legacy=0x7f760015d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.549+0000 7f75fffff640 1 -- 172.21.15.6:0/3923074291 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f760015ac80 con 0x7f76000c5800 2024-05-04T00:31:43.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.553+0000 7f08fb469640 1 -- 172.21.15.6:0/1485140790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f08f4069a50 con 0x7f08f415fab0 2024-05-04T00:31:43.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.565+0000 7f19a11bc640 1 -- 172.21.15.6:0/3888456319 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19940b4070 con 0x7f199c0c91d0 2024-05-04T00:31:43.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.565+0000 7f19a11bc640 1 -- 172.21.15.6:0/3888456319 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19940af600 con 0x7f199c0c91d0 2024-05-04T00:31:43.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.565+0000 7f19a11bc640 1 -- 172.21.15.6:0/3888456319 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19940af9d0 con 0x7f199c0c91d0 2024-05-04T00:31:43.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.565+0000 7f19a4422640 1 -- 172.21.15.6:0/3888456319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f199c0c91d0 msgr2=0x7f199c0631c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.565+0000 7f19a4422640 1 --2- 172.21.15.6:0/3888456319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f199c0c91d0 0x7f199c0631c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f199c15f9a0 tx=0x7f199401f140 comp rx=0 tx=0).stop 2024-05-04T00:31:43.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.565+0000 7f19a4422640 1 -- 172.21.15.6:0/3888456319 shutdown_connections 2024-05-04T00:31:43.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.565+0000 7f19a4422640 1 --2- 172.21.15.6:0/3888456319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f199c0c91d0 0x7f199c0631c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.565+0000 7f19a4422640 1 -- 172.21.15.6:0/3888456319 >> 172.21.15.6:0/3888456319 conn(0x7f199c0ce410 msgr2=0x7f199c0ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:43.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.565+0000 7f08e9ffb640 1 -- 172.21.15.6:0/1485140790 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f08ec0f7940 con 0x7f08f415fab0 2024-05-04T00:31:43.568 INFO:teuthology.orchestra.run.smithi006.stdout:64424509458 2024-05-04T00:31:43.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f19a4422640 1 -- 172.21.15.6:0/3888456319 shutdown_connections 2024-05-04T00:31:43.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f19a4422640 1 -- 172.21.15.6:0/3888456319 wait complete. 2024-05-04T00:31:43.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f75fffff640 1 --2- 172.21.15.6:0/3923074291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76000c5800 0x7f76000ca420 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0097c0 tx=0x7f75ec01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5130cb88704308d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:43.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f19a4422640 1 Processor -- start 2024-05-04T00:31:43.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f19a4422640 1 -- start start 2024-05-04T00:31:43.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f08fb469640 1 -- 172.21.15.6:0/1485140790 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f08d806f480 msgr2=0x7f08d8071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f08fb469640 1 --2- 172.21.15.6:0/1485140790 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f08d806f480 0x7f08d8071990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009690 tx=0x7f08f0006c00 comp rx=0 tx=0).stop 2024-05-04T00:31:43.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f08fb469640 1 -- 172.21.15.6:0/1485140790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08f415fab0 msgr2=0x7f08f40bee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f08fb469640 1 --2- 172.21.15.6:0/1485140790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08f415fab0 0x7f08f40bee50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f08ec01d260 tx=0x7f08ec019760 comp rx=0 tx=0).stop 2024-05-04T00:31:43.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f19a4422640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f199c06c8a0 0x7f199c0c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f19a4422640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f199c06d670 0x7f199c1554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f19a4422640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f199c0c91d0 0x7f199c14a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f08fb469640 1 -- 172.21.15.6:0/1485140790 shutdown_connections 2024-05-04T00:31:43.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f08fb469640 1 --2- 172.21.15.6:0/1485140790 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08f415f6a0 0x7f08f4144700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f08fb469640 1 --2- 172.21.15.6:0/1485140790 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f08d806f480 0x7f08d8071990 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f08fb469640 1 --2- 172.21.15.6:0/1485140790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08f415fab0 0x7f08f40bee50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f19a4422640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f199c0c95e0 con 0x7f199c0c91d0 2024-05-04T00:31:43.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f19a4422640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f199c1600c0 con 0x7f199c06c8a0 2024-05-04T00:31:43.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f19a4422640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f199c0c9760 con 0x7f199c06d670 2024-05-04T00:31:43.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f08fb469640 1 --2- 172.21.15.6:0/1485140790 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08f41564d0 0x7f08f415d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.569+0000 7f08fb469640 1 -- 172.21.15.6:0/1485140790 >> 172.21.15.6:0/1485140790 conn(0x7f08f406cb80 msgr2=0x7f08f40708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:43.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.573+0000 7f08fb469640 1 -- 172.21.15.6:0/1485140790 shutdown_connections 2024-05-04T00:31:43.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.573+0000 7f08fb469640 1 -- 172.21.15.6:0/1485140790 wait complete. 2024-05-04T00:31:43.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.577+0000 7f51ae7fc640 1 -- 172.21.15.6:0/1911304244 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f51b001c070 con 0x7f51b80c91d0 2024-05-04T00:31:43.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.577+0000 7f51ae7fc640 1 --2- 172.21.15.6:0/1911304244 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f519c06f400 0x7f519c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.577+0000 7f51bdf51640 1 --2- 172.21.15.6:0/1911304244 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f519c06f400 0x7f519c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:43.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.577+0000 7f51bdf51640 1 --2- 172.21.15.6:0/1911304244 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f519c06f400 0x7f519c071910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f51b40b2000 tx=0x7f51b4004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:43.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.585+0000 7f19a21be640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f199c06c8a0 0x7f199c0c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:43.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.589+0000 7f51ae7fc640 1 -- 172.21.15.6:0/1911304244 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f51b0057f10 con 0x7f51b80c91d0 2024-05-04T00:31:43.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.593+0000 7f19a21be640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f199c06c8a0 0x7f199c0c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:43624/0 (socket says 172.21.15.6:43624) 2024-05-04T00:31:43.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.593+0000 7f19a21be640 1 -- 172.21.15.6:0/388336757 learned_addr learned my addr 172.21.15.6:0/388336757 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:43.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509458 for osd.4 2024-05-04T00:31:43.597 DEBUG:teuthology.parallel:result is None 2024-05-04T00:31:43.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.597+0000 7f75ff7fe640 1 -- 172.21.15.6:0/3923074291 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0b0070 con 0x7f76000c5800 2024-05-04T00:31:43.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.597+0000 7f75ff7fe640 1 -- 172.21.15.6:0/3923074291 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75ec0ab600 con 0x7f76000c5800 2024-05-04T00:31:43.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.597+0000 7f75ff7fe640 1 -- 172.21.15.6:0/3923074291 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0ab9d0 con 0x7f76000c5800 2024-05-04T00:31:43.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.601+0000 7f7606ba0640 1 -- 172.21.15.6:0/3923074291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76000c5800 msgr2=0x7f76000ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.601+0000 7f7606ba0640 1 --2- 172.21.15.6:0/3923074291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76000c5800 0x7f76000ca420 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0097c0 tx=0x7f75ec01c4a0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.601+0000 7f7606ba0640 1 -- 172.21.15.6:0/3923074291 shutdown_connections 2024-05-04T00:31:43.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.601+0000 7f7606ba0640 1 --2- 172.21.15.6:0/3923074291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76000c5800 0x7f76000ca420 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.601+0000 7f7606ba0640 1 --2- 172.21.15.6:0/3923074291 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76001541f0 0x7f7600159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.601+0000 7f7606ba0640 1 -- 172.21.15.6:0/3923074291 >> 172.21.15.6:0/3923074291 conn(0x7f7600072ce0 msgr2=0x7f76000704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:43.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.601+0000 7f7606ba0640 1 -- 172.21.15.6:0/3923074291 shutdown_connections 2024-05-04T00:31:43.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.601+0000 7f7606ba0640 1 -- 172.21.15.6:0/3923074291 wait complete. 2024-05-04T00:31:43.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.601+0000 7f19a29bf640 1 --2- 172.21.15.6:0/388336757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f199c0c91d0 0x7f199c14a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:43.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.601+0000 7f7606ba0640 1 Processor -- start 2024-05-04T00:31:43.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.601+0000 7f7606ba0640 1 -- start start 2024-05-04T00:31:43.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.605+0000 7f7606ba0640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76000c5800 0x7f7600157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.605+0000 7f7606ba0640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76000c5c10 0x7f7600155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.605+0000 7f7606ba0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76001541f0 0x7f7600156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.605+0000 7f7606ba0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7600070de0 con 0x7f76001541f0 2024-05-04T00:31:43.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.605+0000 7f7606ba0640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f76000cb800 con 0x7f76000c5800 2024-05-04T00:31:43.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.605+0000 7f7606ba0640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f7600070f60 con 0x7f76000c5c10 2024-05-04T00:31:43.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.609+0000 7ff2bbcf4640 1 Processor -- start 2024-05-04T00:31:43.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.609+0000 7ff2bbcf4640 1 -- start start 2024-05-04T00:31:43.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.609+0000 7ff2bbcf4640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2b4152ed0 0x7ff2b4073780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.609+0000 7ff2bbcf4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff2b40c8480 0x7ff2b4073cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.609+0000 7ff2bbcf4640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2b4074bc0 con 0x7ff2b41532e0 2024-05-04T00:31:43.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.609+0000 7ff2bbcf4640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff2b40c5910 con 0x7ff2b40c8480 2024-05-04T00:31:43.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.609+0000 7ff2bbcf4640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b40c6490 con 0x7ff2b4152ed0 2024-05-04T00:31:43.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.613+0000 7f19a29bf640 1 -- 172.21.15.6:0/388336757 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f199c06d670 msgr2=0x7f199c1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.613+0000 7f19a29bf640 1 --2- 172.21.15.6:0/388336757 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f199c06d670 0x7f199c1554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.613+0000 7f19a29bf640 1 -- 172.21.15.6:0/388336757 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f199c06c8a0 msgr2=0x7f199c0c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.613+0000 7f19a29bf640 1 --2- 172.21.15.6:0/388336757 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f199c06c8a0 0x7f199c0c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.613+0000 7f19a29bf640 1 -- 172.21.15.6:0/388336757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199c151db0 con 0x7f199c0c91d0 2024-05-04T00:31:43.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.613+0000 7f760513d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76001541f0 0x7f7600156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:43.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.613+0000 7f760513d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76001541f0 0x7f7600156280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47098/0 (socket says 172.21.15.6:47098) 2024-05-04T00:31:43.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.613+0000 7f760513d640 1 -- 172.21.15.6:0/670072255 learned_addr learned my addr 172.21.15.6:0/670072255 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:43.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.617+0000 7f51ae7fc640 1 -- 172.21.15.6:0/1911304244 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f51b0023020 con 0x7f51b80c91d0 2024-05-04T00:31:43.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.621+0000 7ff2b928f640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7ff2b41532e0 0x7ff2b40c7d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:43616/0 (socket says 172.21.15.6:43616) 2024-05-04T00:31:43.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.621+0000 7ff2b928f640 1 -- 172.21.15.6:0/760028042 learned_addr learned my addr 172.21.15.6:0/760028042 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:43.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.621+0000 7f75fffff640 1 --2- 172.21.15.6:0/670072255 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76000c5c10 0x7f7600155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:43.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.621+0000 7f760493c640 1 --2- 172.21.15.6:0/670072255 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76000c5800 0x7f7600157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:43.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.621+0000 7f760513d640 1 -- 172.21.15.6:0/670072255 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76000c5c10 msgr2=0x7f7600155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.621+0000 7f760513d640 1 --2- 172.21.15.6:0/670072255 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76000c5c10 0x7f7600155d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.621+0000 7f760513d640 1 -- 172.21.15.6:0/670072255 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76000c5800 msgr2=0x7f7600157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.621+0000 7f760513d640 1 --2- 172.21.15.6:0/670072255 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76000c5800 0x7f7600157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.621+0000 7f760513d640 1 -- 172.21.15.6:0/670072255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7600158490 con 0x7f76001541f0 2024-05-04T00:31:43.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.625+0000 7ff2b9a90640 1 --2- 172.21.15.6:0/760028042 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2b4152ed0 0x7ff2b4073780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:43.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.625+0000 7f19a29bf640 1 --2- 172.21.15.6:0/388336757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f199c0c91d0 0x7f199c14a580 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f19940af000 tx=0x7f199401bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:43.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.629+0000 7f760513d640 1 --2- 172.21.15.6:0/670072255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76001541f0 0x7f7600156280 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f75f800cad0 tx=0x7f75f800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:43.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.633+0000 7ff2b8a8e640 1 -- 172.21.15.6:0/760028042 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3476038544 0 0) 0x7ff2b4074bc0 con 0x7ff2b41532e0 2024-05-04T00:31:43.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.633+0000 7ff2b8a8e640 1 -- 172.21.15.6:0/760028042 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2a0003530 con 0x7ff2b41532e0 2024-05-04T00:31:43.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.641+0000 7ff2b9a90640 1 -- 172.21.15.6:0/760028042 >> v2:172.21.15.6:3300/0 conn(0x7ff2b40c8480 msgr2=0x7ff2b4073cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:43.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.641+0000 7ff2b9a90640 1 --2- 172.21.15.6:0/760028042 >> v2:172.21.15.6:3300/0 conn(0x7ff2b40c8480 0x7ff2b4073cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.641+0000 7ff2b9a90640 1 -- 172.21.15.6:0/760028042 >> v1:172.21.15.163:6789/0 conn(0x7ff2b41532e0 legacy=0x7ff2b40c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.641+0000 7ff2b9a90640 1 -- 172.21.15.6:0/760028042 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b40c5b60 con 0x7ff2b4152ed0 2024-05-04T00:31:43.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.645+0000 7ff2b9a90640 1 --2- 172.21.15.6:0/760028042 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2b4152ed0 0x7ff2b4073780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00097c0 tx=0x7ff2b001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=332969d3fb20cb0f server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:43.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.657+0000 7f202c397640 1 Processor -- start 2024-05-04T00:31:43.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.657+0000 7f202c397640 1 -- start start 2024-05-04T00:31:43.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.657+0000 7f202c397640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20240c45d0 0x7f20240cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.657+0000 7f202c397640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f20240c49e0 0x7f20240cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.657+0000 7f202c397640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f202415d6d0 con 0x7f2024154050 2024-05-04T00:31:43.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.657+0000 7f202c397640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f20240cab20 con 0x7f20240c49e0 2024-05-04T00:31:43.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.657+0000 7f202c397640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f202415d970 con 0x7f20240c45d0 2024-05-04T00:31:43.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.657+0000 7f202a934640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f20240c49e0 0x7f20240cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:43.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.661+0000 7f202a934640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f20240c49e0 0x7f20240cc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:43648/0 (socket says 172.21.15.6:43648) 2024-05-04T00:31:43.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.661+0000 7f202a934640 1 -- 172.21.15.6:0/519912556 learned_addr learned my addr 172.21.15.6:0/519912556 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:43.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.669+0000 7f202a934640 1 -- 172.21.15.6:0/519912556 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20240c45d0 msgr2=0x7f20240cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:43.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.669+0000 7f202a934640 1 --2- 172.21.15.6:0/519912556 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20240c45d0 0x7f20240cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.669+0000 7f202a934640 1 -- 172.21.15.6:0/519912556 >> v1:172.21.15.6:6789/0 conn(0x7f2024154050 legacy=0x7f202415aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:43.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.669+0000 7f202a934640 1 -- 172.21.15.6:0/519912556 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202415dc50 con 0x7f20240c49e0 2024-05-04T00:31:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.673+0000 7f75fd7fa640 1 -- 172.21.15.6:0/670072255 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f8017070 con 0x7f76001541f0 2024-05-04T00:31:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.673+0000 7f75fd7fa640 1 -- 172.21.15.6:0/670072255 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f800ac30 con 0x7f76001541f0 2024-05-04T00:31:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.673+0000 7f7606ba0640 1 -- 172.21.15.6:0/670072255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f760015bf40 con 0x7f76001541f0 2024-05-04T00:31:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.673+0000 7f75fd7fa640 1 -- 172.21.15.6:0/670072255 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f8012400 con 0x7f76001541f0 2024-05-04T00:31:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.673+0000 7f7606ba0640 1 -- 172.21.15.6:0/670072255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f760015c1e0 con 0x7f76001541f0 2024-05-04T00:31:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.673+0000 7f202a934640 1 --2- 172.21.15.6:0/519912556 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20240c49e0 0x7f20240cc2e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f201c009e50 tx=0x7f201c01f210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57a51863513557c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:43.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.673+0000 7f7606ba0640 1 -- 172.21.15.6:0/670072255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f760015cd60 con 0x7f76001541f0 2024-05-04T00:31:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.677+0000 7f1992ffd640 1 -- 172.21.15.6:0/388336757 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19940b4040 con 0x7f199c0c91d0 2024-05-04T00:31:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.677+0000 7f1992ffd640 1 -- 172.21.15.6:0/388336757 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19940af400 con 0x7f199c0c91d0 2024-05-04T00:31:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.677+0000 7f1992ffd640 1 -- 172.21.15.6:0/388336757 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19940ba890 con 0x7f199c0c91d0 2024-05-04T00:31:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.677+0000 7f19a4422640 1 -- 172.21.15.6:0/388336757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f199c152090 con 0x7f199c0c91d0 2024-05-04T00:31:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.677+0000 7f19a4422640 1 -- 172.21.15.6:0/388336757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f199c152370 con 0x7f199c0c91d0 2024-05-04T00:31:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.677+0000 7f19a4422640 1 -- 172.21.15.6:0/388336757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f199c069a50 con 0x7f199c0c91d0 2024-05-04T00:31:43.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.685+0000 7f2029131640 1 -- 172.21.15.6:0/519912556 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c0b4070 con 0x7f20240c49e0 2024-05-04T00:31:43.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.685+0000 7f2029131640 1 -- 172.21.15.6:0/519912556 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f201c0af400 con 0x7f20240c49e0 2024-05-04T00:31:43.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.685+0000 7f2029131640 1 -- 172.21.15.6:0/519912556 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c0af7d0 con 0x7f20240c49e0 2024-05-04T00:31:43.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.685+0000 7f202c397640 1 -- 172.21.15.6:0/519912556 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20240c49e0 msgr2=0x7f20240cc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.685+0000 7f202c397640 1 --2- 172.21.15.6:0/519912556 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20240c49e0 0x7f20240cc2e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f201c009e50 tx=0x7f201c01f210 comp rx=0 tx=0).stop 2024-05-04T00:31:43.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.685+0000 7f202c397640 1 -- 172.21.15.6:0/519912556 shutdown_connections 2024-05-04T00:31:43.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.685+0000 7f202c397640 1 --2- 172.21.15.6:0/519912556 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20240c49e0 0x7f20240cc2e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.685+0000 7f202c397640 1 --2- 172.21.15.6:0/519912556 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20240c45d0 0x7f20240cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.685+0000 7f202c397640 1 -- 172.21.15.6:0/519912556 >> 172.21.15.6:0/519912556 conn(0x7f2024070ef0 msgr2=0x7f2024072480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:43.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.685+0000 7f202c397640 1 -- 172.21.15.6:0/519912556 shutdown_connections 2024-05-04T00:31:43.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.685+0000 7f202c397640 1 -- 172.21.15.6:0/519912556 wait complete. 2024-05-04T00:31:43.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.689+0000 7f202c397640 1 Processor -- start 2024-05-04T00:31:43.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.689+0000 7f202c397640 1 -- start start 2024-05-04T00:31:43.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.689+0000 7f202c397640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20240c45d0 0x7f20241ecca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.689+0000 7f202c397640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20240c49e0 0x7f20241f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.689+0000 7f202c397640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2024154050 0x7f2024150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.689+0000 7f202c397640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2024154460 con 0x7f20240c49e0 2024-05-04T00:31:43.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.689+0000 7f202c397640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f20240cade0 con 0x7f20240c45d0 2024-05-04T00:31:43.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.689+0000 7f202c397640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f202415e450 con 0x7f2024154050 2024-05-04T00:31:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.689+0000 7f202a133640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20240c45d0 0x7f20241ecca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.689+0000 7f202a133640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20240c45d0 0x7f20241ecca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:43658/0 (socket says 172.21.15.6:43658) 2024-05-04T00:31:43.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.689+0000 7f202a133640 1 -- 172.21.15.6:0/2154973860 learned_addr learned my addr 172.21.15.6:0/2154973860 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.701+0000 7f202a133640 1 -- 172.21.15.6:0/2154973860 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2024154050 msgr2=0x7f2024150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.701+0000 7f202a133640 1 --2- 172.21.15.6:0/2154973860 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2024154050 0x7f2024150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.701+0000 7f202a133640 1 -- 172.21.15.6:0/2154973860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20240c49e0 msgr2=0x7f20241f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.701+0000 7f202a133640 1 --2- 172.21.15.6:0/2154973860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20240c49e0 0x7f20241f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.701+0000 7f202a133640 1 -- 172.21.15.6:0/2154973860 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20241f6640 con 0x7f20240c45d0 2024-05-04T00:31:43.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.705+0000 7f202a133640 1 --2- 172.21.15.6:0/2154973860 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20240c45d0 0x7f20241ecca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f202000b3e0 tx=0x7f202000b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:43.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.709+0000 7f201affd640 1 -- 172.21.15.6:0/2154973860 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2020015020 con 0x7f20240c45d0 2024-05-04T00:31:43.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.709+0000 7f202c397640 1 -- 172.21.15.6:0/2154973860 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2024158300 con 0x7f20240c45d0 2024-05-04T00:31:43.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.709+0000 7f202c397640 1 -- 172.21.15.6:0/2154973860 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20241588c0 con 0x7f20240c45d0 2024-05-04T00:31:43.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.713+0000 7f202c397640 1 -- 172.21.15.6:0/2154973860 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2024069a50 con 0x7f20240c45d0 2024-05-04T00:31:43.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.769+0000 7ff2b8a8e640 1 -- 172.21.15.6:0/760028042 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b00b0070 con 0x7ff2b4152ed0 2024-05-04T00:31:43.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.769+0000 7ff2b8a8e640 1 -- 172.21.15.6:0/760028042 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b00ab600 con 0x7ff2b4152ed0 2024-05-04T00:31:43.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.769+0000 7ff2b8a8e640 1 -- 172.21.15.6:0/760028042 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b00ab9d0 con 0x7ff2b4152ed0 2024-05-04T00:31:43.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.769+0000 7ff2bbcf4640 1 -- 172.21.15.6:0/760028042 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2b4152ed0 msgr2=0x7ff2b4073780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.769+0000 7ff2bbcf4640 1 --2- 172.21.15.6:0/760028042 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2b4152ed0 0x7ff2b4073780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00097c0 tx=0x7ff2b001c4a0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.769+0000 7ff2bbcf4640 1 -- 172.21.15.6:0/760028042 shutdown_connections 2024-05-04T00:31:43.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.769+0000 7ff2bbcf4640 1 --2- 172.21.15.6:0/760028042 >> v2:172.21.15.6:3300/0 conn(0x7ff2b40c8480 0x7ff2b4073cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.769+0000 7ff2bbcf4640 1 --2- 172.21.15.6:0/760028042 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2b4152ed0 0x7ff2b4073780 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.769+0000 7ff2bbcf4640 1 -- 172.21.15.6:0/760028042 >> 172.21.15.6:0/760028042 conn(0x7ff2b40ce410 msgr2=0x7ff2b40ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:43.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.769+0000 7ff2bbcf4640 1 -- 172.21.15.6:0/760028042 shutdown_connections 2024-05-04T00:31:43.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.769+0000 7ff2bbcf4640 1 -- 172.21.15.6:0/760028042 wait complete. 2024-05-04T00:31:43.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.773+0000 7ff2bbcf4640 1 Processor -- start 2024-05-04T00:31:43.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.773+0000 7ff2bbcf4640 1 -- start start 2024-05-04T00:31:43.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.773+0000 7ff2bbcf4640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2b40c8480 0x7ff2b41f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.773+0000 7ff2bbcf4640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2b4152ed0 0x7ff2b40cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.773+0000 7ff2bbcf4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2b41532e0 0x7ff2b4144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.773+0000 7ff2bbcf4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b40c94a0 con 0x7ff2b41532e0 2024-05-04T00:31:43.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.773+0000 7ff2bbcf4640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b40c9320 con 0x7ff2b4152ed0 2024-05-04T00:31:43.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.773+0000 7ff2bbcf4640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b40cab10 con 0x7ff2b40c8480 2024-05-04T00:31:43.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.777+0000 7ff2b9a90640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2b40c8480 0x7ff2b41f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:43.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.777+0000 7ff2b9a90640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2b40c8480 0x7ff2b41f5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:47172/0 (socket says 172.21.15.6:47172) 2024-05-04T00:31:43.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.777+0000 7ff2b9a90640 1 -- 172.21.15.6:0/1711683894 learned_addr learned my addr 172.21.15.6:0/1711683894 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:43.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.785+0000 7ff2b9a90640 1 -- 172.21.15.6:0/1711683894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2b4152ed0 msgr2=0x7ff2b40cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.785+0000 7ff2b9a90640 1 --2- 172.21.15.6:0/1711683894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2b4152ed0 0x7ff2b40cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.785+0000 7ff2b9a90640 1 -- 172.21.15.6:0/1711683894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2b41532e0 msgr2=0x7ff2b4144770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.785+0000 7ff2b9a90640 1 --2- 172.21.15.6:0/1711683894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2b41532e0 0x7ff2b4144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.785+0000 7ff2b9a90640 1 -- 172.21.15.6:0/1711683894 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b41f6000 con 0x7ff2b40c8480 2024-05-04T00:31:43.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.789+0000 7f51c01b5640 1 -- 172.21.15.6:0/1911304244 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f51a0005860 con 0x7f51b80c91d0 2024-05-04T00:31:43.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.793+0000 7ff2b9a90640 1 --2- 172.21.15.6:0/1711683894 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2b40c8480 0x7ff2b41f5ac0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff2b001a0d0 tx=0x7ff2b0019240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:43.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.809+0000 7f51ae7fc640 1 -- 172.21.15.6:0/1911304244 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f51b80c79d0 con 0x7f51b80c91d0 2024-05-04T00:31:43.809 INFO:teuthology.orchestra.run.smithi006.stdout:64424509458 2024-05-04T00:31:43.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.809+0000 7f51c01b5640 1 -- 172.21.15.6:0/1911304244 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f519c06f400 msgr2=0x7f519c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.809+0000 7f51c01b5640 1 --2- 172.21.15.6:0/1911304244 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f519c06f400 0x7f519c071910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f51b40b2000 tx=0x7f51b4004740 comp rx=0 tx=0).stop 2024-05-04T00:31:43.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.809+0000 7f51c01b5640 1 -- 172.21.15.6:0/1911304244 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51b80c91d0 msgr2=0x7f51b8144c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:43.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.809+0000 7f51c01b5640 1 --2- 172.21.15.6:0/1911304244 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51b80c91d0 0x7f51b8144c20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f51b000b9a0 tx=0x7f51b000be60 comp rx=0 tx=0).stop 2024-05-04T00:31:43.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.809+0000 7f51c01b5640 1 -- 172.21.15.6:0/1911304244 shutdown_connections 2024-05-04T00:31:43.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.809+0000 7f51c01b5640 1 --2- 172.21.15.6:0/1911304244 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51b806d670 0x7f51b8153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.809+0000 7f51c01b5640 1 --2- 172.21.15.6:0/1911304244 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f519c06f400 0x7f519c071910 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.809+0000 7f51c01b5640 1 --2- 172.21.15.6:0/1911304244 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51b80c91d0 0x7f51b8144c20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.809+0000 7f51c01b5640 1 --2- 172.21.15.6:0/1911304244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51b806c8a0 0x7f51b815a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:43.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.809+0000 7f51c01b5640 1 -- 172.21.15.6:0/1911304244 >> 172.21.15.6:0/1911304244 conn(0x7f51b80ce410 msgr2=0x7f51b80cc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:43.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.809+0000 7f51c01b5640 1 -- 172.21.15.6:0/1911304244 shutdown_connections 2024-05-04T00:31:43.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.809+0000 7f51c01b5640 1 -- 172.21.15.6:0/1911304244 wait complete. 2024-05-04T00:31:43.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.821+0000 7ff2aa7fc640 1 -- 172.21.15.6:0/1711683894 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b00b0040 con 0x7ff2b40c8480 2024-05-04T00:31:43.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.821+0000 7ff2aa7fc640 1 -- 172.21.15.6:0/1711683894 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b00b6070 con 0x7ff2b40c8480 2024-05-04T00:31:43.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.821+0000 7ff2aa7fc640 1 -- 172.21.15.6:0/1711683894 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b00b2840 con 0x7ff2b40c8480 2024-05-04T00:31:43.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.821+0000 7ff2bbcf4640 1 -- 172.21.15.6:0/1711683894 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b41526f0 con 0x7ff2b40c8480 2024-05-04T00:31:43.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.821+0000 7ff2bbcf4640 1 -- 172.21.15.6:0/1711683894 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b415aee0 con 0x7ff2b40c8480 2024-05-04T00:31:43.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.821+0000 7ff2bbcf4640 1 -- 172.21.15.6:0/1711683894 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2b4069a50 con 0x7ff2b40c8480 2024-05-04T00:31:43.827 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-04T00:31:43.830 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509458 for osd.0 2024-05-04T00:31:43.830 DEBUG:teuthology.parallel:result is None 2024-05-04T00:31:43.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.969+0000 7f89f1634640 1 Processor -- start 2024-05-04T00:31:43.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.969+0000 7f89f1634640 1 -- start start 2024-05-04T00:31:43.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.973+0000 7f89f1634640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec0b3c60 0x7f89ec15a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.973+0000 7f89f1634640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f89ec0c8cc0 0x7f89ec164990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.973+0000 7f89f1634640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89ec1546d0 con 0x7f89ec0c88b0 2024-05-04T00:31:43.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.973+0000 7f89f1634640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f89ec0c3030 con 0x7f89ec0c8cc0 2024-05-04T00:31:43.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.973+0000 7f89f1634640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f89ec0c3310 con 0x7f89ec0b3c60 2024-05-04T00:31:43.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.981+0000 7f75fd7fa640 1 -- 172.21.15.6:0/670072255 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f75f801a070 con 0x7f76001541f0 2024-05-04T00:31:43.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.981+0000 7f75fd7fa640 1 --2- 172.21.15.6:0/670072255 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f75e406f400 0x7f75e4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:43.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.981+0000 7f760493c640 1 --2- 172.21.15.6:0/670072255 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f75e406f400 0x7f75e4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:43.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:43.985+0000 7f760493c640 1 --2- 172.21.15.6:0/670072255 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f75e406f400 0x7f75e4071910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f75f400a790 tx=0x7f75f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:44.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.009+0000 7f75fd7fa640 1 -- 172.21.15.6:0/670072255 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f75f8057ea0 con 0x7f76001541f0 2024-05-04T00:31:44.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.009+0000 7f75fd7fa640 1 -- 172.21.15.6:0/670072255 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f75f805bc10 con 0x7f76001541f0 2024-05-04T00:31:44.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.065+0000 7f201affd640 1 -- 172.21.15.6:0/2154973860 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2020011830 con 0x7f20240c45d0 2024-05-04T00:31:44.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.065+0000 7f201affd640 1 -- 172.21.15.6:0/2154973860 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20200091f0 con 0x7f20240c45d0 2024-05-04T00:31:44.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.065+0000 7f201affd640 1 -- 172.21.15.6:0/2154973860 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2020018020 con 0x7f20240c45d0 2024-05-04T00:31:44.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.065+0000 7f201affd640 1 --2- 172.21.15.6:0/2154973860 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f200806f430 0x7f2008071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.069+0000 7f2029932640 1 --2- 172.21.15.6:0/2154973860 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f200806f430 0x7f2008071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.069+0000 7f2029932640 1 --2- 172.21.15.6:0/2154973860 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f200806f430 0x7f2008071940 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f20240765c0 tx=0x7f2014006c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:44.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.081+0000 7f201affd640 1 -- 172.21.15.6:0/2154973860 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f2020058220 con 0x7f20240c45d0 2024-05-04T00:31:44.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.129+0000 7f201affd640 1 -- 172.21.15.6:0/2154973860 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f202001f020 con 0x7f20240c45d0 2024-05-04T00:31:44.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.137+0000 7f89eb7fe640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f89ec0c8cc0 0x7f89ec164990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:44.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.145+0000 7f89eb7fe640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f89ec0c8cc0 0x7f89ec164990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:43672/0 (socket says 172.21.15.6:43672) 2024-05-04T00:31:44.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.145+0000 7f89eb7fe640 1 -- 172.21.15.6:0/3542865570 learned_addr learned my addr 172.21.15.6:0/3542865570 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:44.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.149+0000 7ff2aa7fc640 1 -- 172.21.15.6:0/1711683894 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff2b00ab4c0 con 0x7ff2b40c8480 2024-05-04T00:31:44.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.149+0000 7ff2aa7fc640 1 --2- 172.21.15.6:0/1711683894 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7ff29806f430 0x7ff298071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:44.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.149+0000 7ff2b928f640 1 --2- 172.21.15.6:0/1711683894 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7ff29806f430 0x7ff298071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:44.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.149+0000 7ff2b928f640 1 --2- 172.21.15.6:0/1711683894 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7ff29806f430 0x7ff298071940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4007fd0 tx=0x7ff2a4007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:44.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.153+0000 7f89eb7fe640 1 -- 172.21.15.6:0/3542865570 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec0b3c60 msgr2=0x7f89ec15a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:44.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.153+0000 7f89eb7fe640 1 --2- 172.21.15.6:0/3542865570 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec0b3c60 0x7f89ec15a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.153+0000 7f89eb7fe640 1 -- 172.21.15.6:0/3542865570 >> v1:172.21.15.6:6789/0 conn(0x7f89ec0c88b0 legacy=0x7f89ec0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:44.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.153+0000 7f89eb7fe640 1 -- 172.21.15.6:0/3542865570 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ec0c35f0 con 0x7f89ec0c8cc0 2024-05-04T00:31:44.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.153+0000 7ff2aa7fc640 1 -- 172.21.15.6:0/1711683894 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7ff2b00f3a30 con 0x7ff2b40c8480 2024-05-04T00:31:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.161+0000 7f89eb7fe640 1 --2- 172.21.15.6:0/3542865570 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89ec0c8cc0 0x7f89ec164990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009e50 tx=0x7f89e401f030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=760f89a893f0c58d server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.165+0000 7ff2aa7fc640 1 -- 172.21.15.6:0/1711683894 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff2b00c2030 con 0x7ff2b40c8480 2024-05-04T00:31:44.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.173+0000 7f89e9ffb640 1 -- 172.21.15.6:0/3542865570 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e40a8bc0 con 0x7f89ec0c8cc0 2024-05-04T00:31:44.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.173+0000 7f89e9ffb640 1 -- 172.21.15.6:0/3542865570 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e40a8d60 con 0x7f89ec0c8cc0 2024-05-04T00:31:44.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.173+0000 7f89e9ffb640 1 -- 172.21.15.6:0/3542865570 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e40b0610 con 0x7f89ec0c8cc0 2024-05-04T00:31:44.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.173+0000 7f89f1634640 1 -- 172.21.15.6:0/3542865570 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89ec0c8cc0 msgr2=0x7f89ec164990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:44.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.173+0000 7f89f1634640 1 --2- 172.21.15.6:0/3542865570 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89ec0c8cc0 0x7f89ec164990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009e50 tx=0x7f89e401f030 comp rx=0 tx=0).stop 2024-05-04T00:31:44.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.173+0000 7f89f1634640 1 -- 172.21.15.6:0/3542865570 shutdown_connections 2024-05-04T00:31:44.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.173+0000 7f89f1634640 1 --2- 172.21.15.6:0/3542865570 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89ec0c8cc0 0x7f89ec164990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.173+0000 7f89f1634640 1 --2- 172.21.15.6:0/3542865570 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec0b3c60 0x7f89ec15a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.173+0000 7f89f1634640 1 -- 172.21.15.6:0/3542865570 >> 172.21.15.6:0/3542865570 conn(0x7f89ec070d60 msgr2=0x7f89ec0711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:44.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.173+0000 7f89f1634640 1 -- 172.21.15.6:0/3542865570 shutdown_connections 2024-05-04T00:31:44.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.173+0000 7f89f1634640 1 -- 172.21.15.6:0/3542865570 wait complete. 2024-05-04T00:31:44.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.177+0000 7f89f1634640 1 Processor -- start 2024-05-04T00:31:44.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.177+0000 7f89f1634640 1 -- start start 2024-05-04T00:31:44.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.177+0000 7f89f1634640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec0b3c60 0x7f89ec14fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:44.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.177+0000 7f89f1634640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89ec0c88b0 0x7f89ec1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:44.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.177+0000 7f89f1634640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89ec0c8cc0 0x7f89ec0c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:44.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.177+0000 7f89f1634640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f89ec0c38d0 con 0x7f89ec0c88b0 2024-05-04T00:31:44.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.177+0000 7f89f1634640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f89ec15a400 con 0x7f89ec0c8cc0 2024-05-04T00:31:44.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.177+0000 7f89f1634640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f89ec15ae60 con 0x7f89ec0b3c60 2024-05-04T00:31:44.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.177+0000 7f89eaffd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec0b3c60 0x7f89ec14fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:44.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.177+0000 7f89eb7fe640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89ec0c8cc0 0x7f89ec0c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:44.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.177+0000 7f89eaffd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec0b3c60 0x7f89ec14fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:47190/0 (socket says 172.21.15.6:47190) 2024-05-04T00:31:44.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.177+0000 7f89eaffd640 1 -- 172.21.15.6:0/2987473220 learned_addr learned my addr 172.21.15.6:0/2987473220 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:44.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.185+0000 7f89eaffd640 1 -- 172.21.15.6:0/2987473220 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89ec0c8cc0 msgr2=0x7f89ec0c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:44.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.185+0000 7f89eaffd640 1 --2- 172.21.15.6:0/2987473220 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89ec0c8cc0 0x7f89ec0c50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.185+0000 7f89eaffd640 1 -- 172.21.15.6:0/2987473220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89ec0c88b0 msgr2=0x7f89ec1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:44.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.185+0000 7f89eaffd640 1 --2- 172.21.15.6:0/2987473220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89ec0c88b0 0x7f89ec1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.185+0000 7f89eaffd640 1 -- 172.21.15.6:0/2987473220 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ec159c10 con 0x7f89ec0b3c60 2024-05-04T00:31:44.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.189+0000 7f89eaffd640 1 --2- 172.21.15.6:0/2987473220 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec0b3c60 0x7f89ec14fd20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00b470 tx=0x7f89dc00b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:44.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.193+0000 7f89d37fe640 1 -- 172.21.15.6:0/2987473220 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc015020 con 0x7f89ec0b3c60 2024-05-04T00:31:44.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.193+0000 7f89d37fe640 1 -- 172.21.15.6:0/2987473220 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89dc011830 con 0x7f89ec0b3c60 2024-05-04T00:31:44.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.193+0000 7f89f1634640 1 -- 172.21.15.6:0/2987473220 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89ec1f3410 con 0x7f89ec0b3c60 2024-05-04T00:31:44.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.193+0000 7f89d37fe640 1 -- 172.21.15.6:0/2987473220 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc011c20 con 0x7f89ec0b3c60 2024-05-04T00:31:44.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.193+0000 7f89f1634640 1 -- 172.21.15.6:0/2987473220 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f89ec1f39d0 con 0x7f89ec0b3c60 2024-05-04T00:31:44.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.193+0000 7f89f1634640 1 -- 172.21.15.6:0/2987473220 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89ec069a50 con 0x7f89ec0b3c60 2024-05-04T00:31:44.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.197+0000 7f7606ba0640 1 -- 172.21.15.6:0/670072255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f760015bd30 con 0x7f76001541f0 2024-05-04T00:31:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.221+0000 7f89d37fe640 1 -- 172.21.15.6:0/2987473220 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f89dc018020 con 0x7f89ec0b3c60 2024-05-04T00:31:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.221+0000 7f89d37fe640 1 --2- 172.21.15.6:0/2987473220 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f89d806f480 0x7f89d8071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:44.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.221+0000 7f89ea7fc640 1 --2- 172.21.15.6:0/2987473220 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f89d806f480 0x7f89d8071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:44.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.221+0000 7f89ea7fc640 1 --2- 172.21.15.6:0/2987473220 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f89d806f480 0x7f89d8071990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f89ec149220 tx=0x7f89e0006bb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:44.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.225+0000 7f89d37fe640 1 -- 172.21.15.6:0/2987473220 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f89dc011dc0 con 0x7f89ec0b3c60 2024-05-04T00:31:44.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.333+0000 7f202c397640 1 -- 172.21.15.6:0/2154973860 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2024157c90 con 0x7f20240c45d0 2024-05-04T00:31:44.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.341+0000 7f1992ffd640 1 -- 172.21.15.6:0/388336757 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f19940c4020 con 0x7f199c0c91d0 2024-05-04T00:31:44.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.341+0000 7f1992ffd640 1 --2- 172.21.15.6:0/388336757 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f198006f480 0x7f1980071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:44.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.341+0000 7f19a21be640 1 --2- 172.21.15.6:0/388336757 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f198006f480 0x7f1980071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:44.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.341+0000 7f19a21be640 1 --2- 172.21.15.6:0/388336757 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f198006f480 0x7f1980071990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f19980099a0 tx=0x7f19980090e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:44.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.349+0000 7f201affd640 1 -- 172.21.15.6:0/2154973860 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f202005c690 con 0x7f20240c45d0 2024-05-04T00:31:44.351 INFO:teuthology.orchestra.run.smithi006.stdout:60129542162 2024-05-04T00:31:44.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.349+0000 7f202c397640 1 -- 172.21.15.6:0/2154973860 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f200806f430 msgr2=0x7f2008071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:44.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.349+0000 7f202c397640 1 --2- 172.21.15.6:0/2154973860 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f200806f430 0x7f2008071940 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f20240765c0 tx=0x7f2014006c00 comp rx=0 tx=0).stop 2024-05-04T00:31:44.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.349+0000 7f202c397640 1 -- 172.21.15.6:0/2154973860 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20240c45d0 msgr2=0x7f20241ecca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:44.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.349+0000 7f202c397640 1 --2- 172.21.15.6:0/2154973860 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20240c45d0 0x7f20241ecca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f202000b3e0 tx=0x7f202000b8a0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.349+0000 7f202c397640 1 -- 172.21.15.6:0/2154973860 shutdown_connections 2024-05-04T00:31:44.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.349+0000 7f202c397640 1 --2- 172.21.15.6:0/2154973860 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f200806f430 0x7f2008071940 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.349+0000 7f202c397640 1 --2- 172.21.15.6:0/2154973860 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2024154050 0x7f2024150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.349+0000 7f202c397640 1 --2- 172.21.15.6:0/2154973860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20240c49e0 0x7f20241f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.349+0000 7f202c397640 1 --2- 172.21.15.6:0/2154973860 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20240c45d0 0x7f20241ecca0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.349+0000 7f202c397640 1 -- 172.21.15.6:0/2154973860 >> 172.21.15.6:0/2154973860 conn(0x7f2024070ef0 msgr2=0x7f20240cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:44.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.349+0000 7f202c397640 1 -- 172.21.15.6:0/2154973860 shutdown_connections 2024-05-04T00:31:44.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.349+0000 7f202c397640 1 -- 172.21.15.6:0/2154973860 wait complete. 2024-05-04T00:31:44.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.361+0000 7ff2bbcf4640 1 -- 172.21.15.6:0/1711683894 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff2b414cff0 con 0x7ff2b40c8480 2024-05-04T00:31:44.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542162 got 60129542162 for osd.5 2024-05-04T00:31:44.371 DEBUG:teuthology.parallel:result is None 2024-05-04T00:31:44.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.373+0000 7f1992ffd640 1 -- 172.21.15.6:0/388336757 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f19940af5b0 con 0x7f199c0c91d0 2024-05-04T00:31:44.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.373+0000 7f1992ffd640 1 -- 172.21.15.6:0/388336757 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f19940cb020 con 0x7f199c0c91d0 2024-05-04T00:31:44.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.381+0000 7f75fd7fa640 1 -- 172.21.15.6:0/670072255 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f75f805ff10 con 0x7f76001541f0 2024-05-04T00:31:44.383 INFO:teuthology.orchestra.run.smithi006.stdout:60129542162 2024-05-04T00:31:44.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.385+0000 7f7606ba0640 1 -- 172.21.15.6:0/670072255 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f75e406f400 msgr2=0x7f75e4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:44.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.385+0000 7f7606ba0640 1 --2- 172.21.15.6:0/670072255 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f75e406f400 0x7f75e4071910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f75f400a790 tx=0x7f75f4008040 comp rx=0 tx=0).stop 2024-05-04T00:31:44.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.385+0000 7f7606ba0640 1 -- 172.21.15.6:0/670072255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76001541f0 msgr2=0x7f7600156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:44.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.385+0000 7f7606ba0640 1 --2- 172.21.15.6:0/670072255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76001541f0 0x7f7600156280 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f75f800cad0 tx=0x7f75f800cf90 comp rx=0 tx=0).stop 2024-05-04T00:31:44.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.385+0000 7f7606ba0640 1 -- 172.21.15.6:0/670072255 shutdown_connections 2024-05-04T00:31:44.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.385+0000 7f7606ba0640 1 --2- 172.21.15.6:0/670072255 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f75e406f400 0x7f75e4071910 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.385+0000 7f7606ba0640 1 --2- 172.21.15.6:0/670072255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76001541f0 0x7f7600156280 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.385+0000 7f7606ba0640 1 --2- 172.21.15.6:0/670072255 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76000c5c10 0x7f7600155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.385+0000 7f7606ba0640 1 --2- 172.21.15.6:0/670072255 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76000c5800 0x7f7600157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.385+0000 7f7606ba0640 1 -- 172.21.15.6:0/670072255 >> 172.21.15.6:0/670072255 conn(0x7f7600072ce0 msgr2=0x7f76000cba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:44.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.385+0000 7f7606ba0640 1 -- 172.21.15.6:0/670072255 shutdown_connections 2024-05-04T00:31:44.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.385+0000 7f7606ba0640 1 -- 172.21.15.6:0/670072255 wait complete. 2024-05-04T00:31:44.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542162 got 60129542162 for osd.7 2024-05-04T00:31:44.408 DEBUG:teuthology.parallel:result is None 2024-05-04T00:31:44.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.541+0000 7f19a4422640 1 -- 172.21.15.6:0/388336757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f199c14fe70 con 0x7f199c0c91d0 2024-05-04T00:31:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.553+0000 7f89d37fe640 1 -- 172.21.15.6:0/2987473220 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f89dc01f020 con 0x7f89ec0b3c60 2024-05-04T00:31:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.557+0000 7ff2aa7fc640 1 -- 172.21.15.6:0/1711683894 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff2b0016090 con 0x7ff2b40c8480 2024-05-04T00:31:44.558 INFO:teuthology.orchestra.run.smithi006.stdout:64424509458 2024-05-04T00:31:44.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.557+0000 7f1992ffd640 1 -- 172.21.15.6:0/388336757 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1994018ca0 con 0x7f199c0c91d0 2024-05-04T00:31:44.560 INFO:teuthology.orchestra.run.smithi006.stdout:64424509459 2024-05-04T00:31:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7ff2bbcf4640 1 -- 172.21.15.6:0/1711683894 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7ff29806f430 msgr2=0x7ff298071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7ff2bbcf4640 1 --2- 172.21.15.6:0/1711683894 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7ff29806f430 0x7ff298071940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4007fd0 tx=0x7ff2a4007900 comp rx=0 tx=0).stop 2024-05-04T00:31:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7ff2bbcf4640 1 -- 172.21.15.6:0/1711683894 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2b40c8480 msgr2=0x7ff2b41f5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7ff2bbcf4640 1 --2- 172.21.15.6:0/1711683894 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2b40c8480 0x7ff2b41f5ac0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff2b001a0d0 tx=0x7ff2b0019240 comp rx=0 tx=0).stop 2024-05-04T00:31:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7ff2bbcf4640 1 -- 172.21.15.6:0/1711683894 shutdown_connections 2024-05-04T00:31:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7ff2bbcf4640 1 --2- 172.21.15.6:0/1711683894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2b4152ed0 0x7ff2b40cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7ff2bbcf4640 1 --2- 172.21.15.6:0/1711683894 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7ff29806f430 0x7ff298071940 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7ff2bbcf4640 1 --2- 172.21.15.6:0/1711683894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2b41532e0 0x7ff2b4144770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7ff2bbcf4640 1 --2- 172.21.15.6:0/1711683894 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2b40c8480 0x7ff2b41f5ac0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7ff2bbcf4640 1 -- 172.21.15.6:0/1711683894 >> 172.21.15.6:0/1711683894 conn(0x7ff2b40ce410 msgr2=0x7ff2b414f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7ff2bbcf4640 1 -- 172.21.15.6:0/1711683894 shutdown_connections 2024-05-04T00:31:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7ff2bbcf4640 1 -- 172.21.15.6:0/1711683894 wait complete. 2024-05-04T00:31:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7f19a4422640 1 -- 172.21.15.6:0/388336757 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f198006f480 msgr2=0x7f1980071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7f19a4422640 1 --2- 172.21.15.6:0/388336757 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f198006f480 0x7f1980071990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f19980099a0 tx=0x7f19980090e0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7f19a4422640 1 -- 172.21.15.6:0/388336757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f199c0c91d0 msgr2=0x7f199c14a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7f19a4422640 1 --2- 172.21.15.6:0/388336757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f199c0c91d0 0x7f199c14a580 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f19940af000 tx=0x7f199401bee0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7f19a4422640 1 -- 172.21.15.6:0/388336757 shutdown_connections 2024-05-04T00:31:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7f19a4422640 1 --2- 172.21.15.6:0/388336757 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f198006f480 0x7f1980071990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7f19a4422640 1 --2- 172.21.15.6:0/388336757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f199c0c91d0 0x7f199c14a580 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7f19a4422640 1 --2- 172.21.15.6:0/388336757 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f199c06d670 0x7f199c1554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7f19a4422640 1 --2- 172.21.15.6:0/388336757 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f199c06c8a0 0x7f199c0c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7f19a4422640 1 -- 172.21.15.6:0/388336757 >> 172.21.15.6:0/388336757 conn(0x7f199c0ce410 msgr2=0x7f199c14b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:44.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7f19a4422640 1 -- 172.21.15.6:0/388336757 shutdown_connections 2024-05-04T00:31:44.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.561+0000 7f19a4422640 1 -- 172.21.15.6:0/388336757 wait complete. 2024-05-04T00:31:44.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509459 got 64424509459 for osd.2 2024-05-04T00:31:44.591 DEBUG:teuthology.parallel:result is None 2024-05-04T00:31:44.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509458 for osd.6 2024-05-04T00:31:44.595 DEBUG:teuthology.parallel:result is None 2024-05-04T00:31:44.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.737+0000 7f89f1634640 1 -- 172.21.15.6:0/2987473220 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f89ec157f60 con 0x7f89ec0b3c60 2024-05-04T00:31:44.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.745+0000 7f89d37fe640 1 -- 172.21.15.6:0/2987473220 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f89dc05c640 con 0x7f89ec0b3c60 2024-05-04T00:31:44.748 INFO:teuthology.orchestra.run.smithi006.stdout:60129542162 2024-05-04T00:31:44.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.749+0000 7f89f1634640 1 -- 172.21.15.6:0/2987473220 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f89d806f480 msgr2=0x7f89d8071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:44.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.749+0000 7f89f1634640 1 --2- 172.21.15.6:0/2987473220 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f89d806f480 0x7f89d8071990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f89ec149220 tx=0x7f89e0006bb0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.749+0000 7f89f1634640 1 -- 172.21.15.6:0/2987473220 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec0b3c60 msgr2=0x7f89ec14fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:44.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.749+0000 7f89f1634640 1 --2- 172.21.15.6:0/2987473220 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec0b3c60 0x7f89ec14fd20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00b470 tx=0x7f89dc00b930 comp rx=0 tx=0).stop 2024-05-04T00:31:44.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.749+0000 7f89f1634640 1 -- 172.21.15.6:0/2987473220 shutdown_connections 2024-05-04T00:31:44.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.749+0000 7f89f1634640 1 --2- 172.21.15.6:0/2987473220 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89ec0c8cc0 0x7f89ec0c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.749+0000 7f89f1634640 1 --2- 172.21.15.6:0/2987473220 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f89d806f480 0x7f89d8071990 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.749+0000 7f89f1634640 1 --2- 172.21.15.6:0/2987473220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89ec0c88b0 0x7f89ec1591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.749+0000 7f89f1634640 1 --2- 172.21.15.6:0/2987473220 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec0b3c60 0x7f89ec14fd20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.749+0000 7f89f1634640 1 -- 172.21.15.6:0/2987473220 >> 172.21.15.6:0/2987473220 conn(0x7f89ec070d60 msgr2=0x7f89ec075cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:44.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.749+0000 7f89f1634640 1 -- 172.21.15.6:0/2987473220 shutdown_connections 2024-05-04T00:31:44.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.749+0000 7f89f1634640 1 -- 172.21.15.6:0/2987473220 wait complete. 2024-05-04T00:31:44.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542162 got 60129542162 for osd.3 2024-05-04T00:31:44.770 DEBUG:teuthology.parallel:result is None 2024-05-04T00:31:44.770 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-04T00:31:44.771 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T00:31:44.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.917+0000 7fe7365ef640 1 Processor -- start 2024-05-04T00:31:44.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.921+0000 7fe7365ef640 1 -- start start 2024-05-04T00:31:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.921+0000 7fe7365ef640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe7300c5800 0x7fe7300ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.921+0000 7fe7365ef640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe7300c5c10 0x7fe7300ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.921+0000 7fe7365ef640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe73015a6c0 con 0x7fe7301541f0 2024-05-04T00:31:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.921+0000 7fe7365ef640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fe7300c4db0 con 0x7fe7300c5c10 2024-05-04T00:31:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.921+0000 7fe7365ef640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe73015a9a0 con 0x7fe7300c5800 2024-05-04T00:31:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.921+0000 7fe72ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe7301541f0 0x7fe730159e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39598/0 (socket says 172.21.15.6:39598) 2024-05-04T00:31:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.921+0000 7fe72ffff640 1 -- 172.21.15.6:0/2892941154 learned_addr learned my addr 172.21.15.6:0/2892941154 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.925+0000 7fe72effd640 1 -- 172.21.15.6:0/2892941154 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 265230329 0 0) 0x7fe73015a6c0 con 0x7fe7301541f0 2024-05-04T00:31:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.925+0000 7fe72effd640 1 -- 172.21.15.6:0/2892941154 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe718003530 con 0x7fe7301541f0 2024-05-04T00:31:44.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.929+0000 7fe72effd640 1 -- 172.21.15.6:0/2892941154 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3708998929 0 0) 0x7fe718003530 con 0x7fe7301541f0 2024-05-04T00:31:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.929+0000 7fe72effd640 1 -- 172.21.15.6:0/2892941154 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe7300c5800 msgr2=0x7fe7300ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.929+0000 7fe72effd640 1 --2- 172.21.15.6:0/2892941154 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe7300c5800 0x7fe7300ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.929+0000 7fe72effd640 1 -- 172.21.15.6:0/2892941154 >> v2:172.21.15.163:3300/0 conn(0x7fe7300c5c10 msgr2=0x7fe7300ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.929+0000 7fe72effd640 1 --2- 172.21.15.6:0/2892941154 >> v2:172.21.15.163:3300/0 conn(0x7fe7300c5c10 0x7fe7300ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.929+0000 7fe72effd640 1 -- 172.21.15.6:0/2892941154 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73015ac80 con 0x7fe7301541f0 2024-05-04T00:31:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.929+0000 7fe72effd640 1 -- 172.21.15.6:0/2892941154 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 557976392 0 0) 0x7fe728001a80 con 0x7fe7301541f0 2024-05-04T00:31:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.929+0000 7fe72effd640 1 -- 172.21.15.6:0/2892941154 >> v1:172.21.15.6:6789/0 conn(0x7fe7301541f0 legacy=0x7fe730159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.929+0000 7fe72effd640 1 --2- 172.21.15.6:0/2892941154 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe718003a60 0x7fe718003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.929+0000 7fe72effd640 1 --2- 172.21.15.6:0/2892941154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe718004810 0x7fe718004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.929+0000 7fe72effd640 1 --2- 172.21.15.6:0/2892941154 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe7300c5800 0x7fe71800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.929+0000 7fe72effd640 1 -- 172.21.15.6:0/2892941154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe7300c4db0 con 0x7fe718004810 2024-05-04T00:31:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.929+0000 7fe72effd640 1 -- 172.21.15.6:0/2892941154 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe73015a9a0 con 0x7fe718003a60 2024-05-04T00:31:44.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.929+0000 7fe72effd640 1 -- 172.21.15.6:0/2892941154 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe71800bf10 con 0x7fe7300c5800 2024-05-04T00:31:44.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.933+0000 7fe72f7fe640 1 --2- 172.21.15.6:0/2892941154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe718004810 0x7fe718004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:44.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.941+0000 7fe734b8c640 1 --2- 172.21.15.6:0/2892941154 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe7300c5800 0x7fe71800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:44.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.941+0000 7fe72ffff640 1 --2- 172.21.15.6:0/2892941154 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe718003a60 0x7fe718003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:44.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.949+0000 7fe734b8c640 1 -- 172.21.15.6:0/2892941154 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe718003a60 msgr2=0x7fe718003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:44.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.949+0000 7fe734b8c640 1 --2- 172.21.15.6:0/2892941154 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe718003a60 0x7fe718003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.949+0000 7fe734b8c640 1 -- 172.21.15.6:0/2892941154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe718004810 msgr2=0x7fe718004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:44.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.949+0000 7fe734b8c640 1 --2- 172.21.15.6:0/2892941154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe718004810 0x7fe718004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.949+0000 7fe734b8c640 1 -- 172.21.15.6:0/2892941154 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe718003530 con 0x7fe7300c5800 2024-05-04T00:31:44.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.953+0000 7fe734b8c640 1 --2- 172.21.15.6:0/2892941154 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe7300c5800 0x7fe71800b9d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe730072440 tx=0x7fe72001c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bd67bb8ed512556 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:44.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.965+0000 7fe72effd640 1 -- 172.21.15.6:0/2892941154 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7200b0070 con 0x7fe7300c5800 2024-05-04T00:31:44.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.965+0000 7fe72effd640 1 -- 172.21.15.6:0/2892941154 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7200ab620 con 0x7fe7300c5800 2024-05-04T00:31:44.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.965+0000 7fe72effd640 1 -- 172.21.15.6:0/2892941154 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe720009460 con 0x7fe7300c5800 2024-05-04T00:31:44.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.965+0000 7fe7365ef640 1 -- 172.21.15.6:0/2892941154 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe7300c5800 msgr2=0x7fe71800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:44.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.965+0000 7fe7365ef640 1 --2- 172.21.15.6:0/2892941154 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe7300c5800 0x7fe71800b9d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe730072440 tx=0x7fe72001c360 comp rx=0 tx=0).stop 2024-05-04T00:31:44.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.965+0000 7fe734b8c640 1 -- 172.21.15.6:0/2892941154 reap_dead start 2024-05-04T00:31:44.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.965+0000 7fe7365ef640 1 -- 172.21.15.6:0/2892941154 shutdown_connections 2024-05-04T00:31:44.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.965+0000 7fe7365ef640 1 -- 172.21.15.6:0/2892941154 >> 172.21.15.6:0/2892941154 conn(0x7fe730072ce0 msgr2=0x7fe7300704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:44.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.965+0000 7fe7365ef640 1 -- 172.21.15.6:0/2892941154 shutdown_connections 2024-05-04T00:31:44.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.965+0000 7fe7365ef640 1 -- 172.21.15.6:0/2892941154 wait complete. 2024-05-04T00:31:44.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.969+0000 7fe7365ef640 1 Processor -- start 2024-05-04T00:31:44.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.969+0000 7fe7365ef640 1 -- start start 2024-05-04T00:31:44.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.973+0000 7fe7365ef640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe7300c5800 0x7fe7301f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:44.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.973+0000 7fe7365ef640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe730156350 0x7fe730154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:44.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.973+0000 7fe7365ef640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe730146e60 0x7fe730147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:44.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.973+0000 7fe7365ef640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe730070f60 con 0x7fe730156350 2024-05-04T00:31:44.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.973+0000 7fe7365ef640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe730070de0 con 0x7fe7300c5800 2024-05-04T00:31:44.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.973+0000 7fe7365ef640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe730165010 con 0x7fe730146e60 2024-05-04T00:31:44.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.973+0000 7fe72f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe730156350 0x7fe730154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:44.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.973+0000 7fe72ffff640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe7300c5800 0x7fe7301f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:44.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.973+0000 7fe72f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe730156350 0x7fe730154920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47142/0 (socket says 172.21.15.6:47142) 2024-05-04T00:31:44.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.973+0000 7fe72f7fe640 1 -- 172.21.15.6:0/2536106747 learned_addr learned my addr 172.21.15.6:0/2536106747 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:44.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.973+0000 7fe734b8c640 1 --2- 172.21.15.6:0/2536106747 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe730146e60 0x7fe730147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:44.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.977+0000 7fe72f7fe640 1 -- 172.21.15.6:0/2536106747 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe730146e60 msgr2=0x7fe730147270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:44.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.977+0000 7fe72f7fe640 1 --2- 172.21.15.6:0/2536106747 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe730146e60 0x7fe730147270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.977+0000 7fe72f7fe640 1 -- 172.21.15.6:0/2536106747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe7300c5800 msgr2=0x7fe7301f42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:44.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.977+0000 7fe72f7fe640 1 --2- 172.21.15.6:0/2536106747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe7300c5800 0x7fe7301f42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:44.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.977+0000 7fe72f7fe640 1 -- 172.21.15.6:0/2536106747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7301f3800 con 0x7fe730156350 2024-05-04T00:31:44.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.981+0000 7fe72f7fe640 1 --2- 172.21.15.6:0/2536106747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe730156350 0x7fe730154920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe72400e8a0 tx=0x7fe72400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:44.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.985+0000 7fe72cff9640 1 -- 172.21.15.6:0/2536106747 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe724017070 con 0x7fe730156350 2024-05-04T00:31:44.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.985+0000 7fe72cff9640 1 -- 172.21.15.6:0/2536106747 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe72400ee90 con 0x7fe730156350 2024-05-04T00:31:44.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.985+0000 7fe72cff9640 1 -- 172.21.15.6:0/2536106747 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72400cb60 con 0x7fe730156350 2024-05-04T00:31:44.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.985+0000 7fe7365ef640 1 -- 172.21.15.6:0/2536106747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe730157290 con 0x7fe730156350 2024-05-04T00:31:44.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.985+0000 7fe7365ef640 1 -- 172.21.15.6:0/2536106747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe73014f630 con 0x7fe730156350 2024-05-04T00:31:44.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:44.985+0000 7fe7365ef640 1 -- 172.21.15.6:0/2536106747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe730069a50 con 0x7fe730156350 2024-05-04T00:31:45.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.009+0000 7fe72cff9640 1 -- 172.21.15.6:0/2536106747 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe72401a070 con 0x7fe730156350 2024-05-04T00:31:45.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.009+0000 7fe72cff9640 1 --2- 172.21.15.6:0/2536106747 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe71c06f450 0x7fe71c071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:45.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.009+0000 7fe72ffff640 1 --2- 172.21.15.6:0/2536106747 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe71c06f450 0x7fe71c071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:45.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.009+0000 7fe72ffff640 1 --2- 172.21.15.6:0/2536106747 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe71c06f450 0x7fe71c071960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe728004d50 tx=0x7fe728006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:45.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.013+0000 7fe72cff9640 1 -- 172.21.15.6:0/2536106747 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fe724058390 con 0x7fe730156350 2024-05-04T00:31:45.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.313+0000 7fe72cff9640 1 -- 172.21.15.6:0/2536106747 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe72405c100 con 0x7fe730156350 2024-05-04T00:31:45.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.509+0000 7fe7365ef640 1 -- 172.21.15.6:0/2536106747 --> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe7300ca940 con 0x7fe71c06f450 2024-05-04T00:31:45.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.529+0000 7fe72cff9640 1 -- 172.21.15.6:0/2536106747 <== mgr.4103 v2:172.21.15.163:6800/2152694980 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251886 (secure 0 0 0) 0x7fe7300ca940 con 0x7fe71c06f450 2024-05-04T00:31:45.535 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:31:45.536 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-04T00:31:45.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.533+0000 7fe7365ef640 1 -- 172.21.15.6:0/2536106747 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe71c06f450 msgr2=0x7fe71c071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.533+0000 7fe7365ef640 1 --2- 172.21.15.6:0/2536106747 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe71c06f450 0x7fe71c071960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe728004d50 tx=0x7fe728006040 comp rx=0 tx=0).stop 2024-05-04T00:31:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.533+0000 7fe7365ef640 1 -- 172.21.15.6:0/2536106747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe730156350 msgr2=0x7fe730154920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.533+0000 7fe7365ef640 1 --2- 172.21.15.6:0/2536106747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe730156350 0x7fe730154920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe72400e8a0 tx=0x7fe72400ed60 comp rx=0 tx=0).stop 2024-05-04T00:31:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.533+0000 7fe7365ef640 1 -- 172.21.15.6:0/2536106747 shutdown_connections 2024-05-04T00:31:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.533+0000 7fe7365ef640 1 --2- 172.21.15.6:0/2536106747 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fe71c06f450 0x7fe71c071960 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.533+0000 7fe7365ef640 1 --2- 172.21.15.6:0/2536106747 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe730146e60 0x7fe730147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.533+0000 7fe7365ef640 1 --2- 172.21.15.6:0/2536106747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe730156350 0x7fe730154920 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.533+0000 7fe7365ef640 1 --2- 172.21.15.6:0/2536106747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe7300c5800 0x7fe7301f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.533+0000 7fe7365ef640 1 -- 172.21.15.6:0/2536106747 >> 172.21.15.6:0/2536106747 conn(0x7fe730072ce0 msgr2=0x7fe7300704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.533+0000 7fe7365ef640 1 -- 172.21.15.6:0/2536106747 shutdown_connections 2024-05-04T00:31:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.533+0000 7fe7365ef640 1 -- 172.21.15.6:0/2536106747 wait complete. 2024-05-04T00:31:45.563 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-05-04T00:31:43.565354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595590,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":226,"num_write_kb":1666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":181,"ondisk_log_size":181,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3514368,"data_stored":1988644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2812,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004775"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334539+0000","last_change":"2024-05-04T00:31:21.410516+0000","last_active":"2024-05-04T00:31:26.334539+0000","last_peered":"2024-05-04T00:31:26.334539+0000","last_clean":"2024-05-04T00:31:26.334539+0000","last_became_active":"2024-05-04T00:31:21.409386+0000","last_became_peered":"2024-05-04T00:31:21.409386+0000","last_unstale":"2024-05-04T00:31:26.334539+0000","last_undegraded":"2024-05-04T00:31:26.334539+0000","last_fullsized":"2024-05-04T00:31:26.334539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:09:40.562107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336298+0000","last_change":"2024-05-04T00:31:21.397440+0000","last_active":"2024-05-04T00:31:26.336298+0000","last_peered":"2024-05-04T00:31:26.336298+0000","last_clean":"2024-05-04T00:31:26.336298+0000","last_became_active":"2024-05-04T00:31:21.396255+0000","last_became_peered":"2024-05-04T00:31:21.396255+0000","last_unstale":"2024-05-04T00:31:26.336298+0000","last_undegraded":"2024-05-04T00:31:26.336298+0000","last_fullsized":"2024-05-04T00:31:26.336298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:07.460897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336101+0000","last_change":"2024-05-04T00:31:21.442932+0000","last_active":"2024-05-04T00:31:26.336101+0000","last_peered":"2024-05-04T00:31:26.336101+0000","last_clean":"2024-05-04T00:31:26.336101+0000","last_became_active":"2024-05-04T00:31:21.442507+0000","last_became_peered":"2024-05-04T00:31:21.442507+0000","last_unstale":"2024-05-04T00:31:26.336101+0000","last_undegraded":"2024-05-04T00:31:26.336101+0000","last_fullsized":"2024-05-04T00:31:26.336101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:52:48.345813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333683+0000","last_change":"2024-05-04T00:31:21.442087+0000","last_active":"2024-05-04T00:31:26.333683+0000","last_peered":"2024-05-04T00:31:26.333683+0000","last_clean":"2024-05-04T00:31:26.333683+0000","last_became_active":"2024-05-04T00:31:21.440935+0000","last_became_peered":"2024-05-04T00:31:21.440935+0000","last_unstale":"2024-05-04T00:31:26.333683+0000","last_undegraded":"2024-05-04T00:31:26.333683+0000","last_fullsized":"2024-05-04T00:31:26.333683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:02:02.166274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334582+0000","last_change":"2024-05-04T00:31:21.408892+0000","last_active":"2024-05-04T00:31:26.334582+0000","last_peered":"2024-05-04T00:31:26.334582+0000","last_clean":"2024-05-04T00:31:26.334582+0000","last_became_active":"2024-05-04T00:31:21.402554+0000","last_became_peered":"2024-05-04T00:31:21.402554+0000","last_unstale":"2024-05-04T00:31:26.334582+0000","last_undegraded":"2024-05-04T00:31:26.334582+0000","last_fullsized":"2024-05-04T00:31:26.334582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:07.135906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333117+0000","last_change":"2024-05-04T00:31:21.442773+0000","last_active":"2024-05-04T00:31:26.333117+0000","last_peered":"2024-05-04T00:31:26.333117+0000","last_clean":"2024-05-04T00:31:26.333117+0000","last_became_active":"2024-05-04T00:31:21.441082+0000","last_became_peered":"2024-05-04T00:31:21.441082+0000","last_unstale":"2024-05-04T00:31:26.333117+0000","last_undegraded":"2024-05-04T00:31:26.333117+0000","last_fullsized":"2024-05-04T00:31:26.333117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:54.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333801+0000","last_change":"2024-05-04T00:31:21.441617+0000","last_active":"2024-05-04T00:31:26.333801+0000","last_peered":"2024-05-04T00:31:26.333801+0000","last_clean":"2024-05-04T00:31:26.333801+0000","last_became_active":"2024-05-04T00:31:21.440766+0000","last_became_peered":"2024-05-04T00:31:21.440766+0000","last_unstale":"2024-05-04T00:31:26.333801+0000","last_undegraded":"2024-05-04T00:31:26.333801+0000","last_fullsized":"2024-05-04T00:31:26.333801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:28:07.779536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335122+0000","last_change":"2024-05-04T00:31:21.408515+0000","last_active":"2024-05-04T00:31:26.335122+0000","last_peered":"2024-05-04T00:31:26.335122+0000","last_clean":"2024-05-04T00:31:26.335122+0000","last_became_active":"2024-05-04T00:31:21.407785+0000","last_became_peered":"2024-05-04T00:31:21.407785+0000","last_unstale":"2024-05-04T00:31:26.335122+0000","last_undegraded":"2024-05-04T00:31:26.335122+0000","last_fullsized":"2024-05-04T00:31:26.335122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:42.617159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333247+0000","last_change":"2024-05-04T00:31:21.400836+0000","last_active":"2024-05-04T00:31:26.333247+0000","last_peered":"2024-05-04T00:31:26.333247+0000","last_clean":"2024-05-04T00:31:26.333247+0000","last_became_active":"2024-05-04T00:31:21.400001+0000","last_became_peered":"2024-05-04T00:31:21.400001+0000","last_unstale":"2024-05-04T00:31:26.333247+0000","last_undegraded":"2024-05-04T00:31:26.333247+0000","last_fullsized":"2024-05-04T00:31:26.333247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:56.687510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334788+0000","last_change":"2024-05-04T00:31:21.391806+0000","last_active":"2024-05-04T00:31:26.334788+0000","last_peered":"2024-05-04T00:31:26.334788+0000","last_clean":"2024-05-04T00:31:26.334788+0000","last_became_active":"2024-05-04T00:31:21.389347+0000","last_became_peered":"2024-05-04T00:31:21.389347+0000","last_unstale":"2024-05-04T00:31:26.334788+0000","last_undegraded":"2024-05-04T00:31:26.334788+0000","last_fullsized":"2024-05-04T00:31:26.334788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:40:12.379274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334569+0000","last_change":"2024-05-04T00:31:21.396045+0000","last_active":"2024-05-04T00:31:26.334569+0000","last_peered":"2024-05-04T00:31:26.334569+0000","last_clean":"2024-05-04T00:31:26.334569+0000","last_became_active":"2024-05-04T00:31:21.385949+0000","last_became_peered":"2024-05-04T00:31:21.385949+0000","last_unstale":"2024-05-04T00:31:26.334569+0000","last_undegraded":"2024-05-04T00:31:26.334569+0000","last_fullsized":"2024-05-04T00:31:26.334569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:33.187636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334211+0000","last_change":"2024-05-04T00:31:21.407987+0000","last_active":"2024-05-04T00:31:26.334211+0000","last_peered":"2024-05-04T00:31:26.334211+0000","last_clean":"2024-05-04T00:31:26.334211+0000","last_became_active":"2024-05-04T00:31:21.404557+0000","last_became_peered":"2024-05-04T00:31:21.404557+0000","last_unstale":"2024-05-04T00:31:26.334211+0000","last_undegraded":"2024-05-04T00:31:26.334211+0000","last_fullsized":"2024-05-04T00:31:26.334211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:00:51.313452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049847+0000","last_change":"2024-05-04T00:31:21.389251+0000","last_active":"2024-05-04T00:31:26.049847+0000","last_peered":"2024-05-04T00:31:26.049847+0000","last_clean":"2024-05-04T00:31:26.049847+0000","last_became_active":"2024-05-04T00:31:21.387958+0000","last_became_peered":"2024-05-04T00:31:21.387958+0000","last_unstale":"2024-05-04T00:31:26.049847+0000","last_undegraded":"2024-05-04T00:31:26.049847+0000","last_fullsized":"2024-05-04T00:31:26.049847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:31.926158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049567+0000","last_change":"2024-05-04T00:31:21.402284+0000","last_active":"2024-05-04T00:31:26.049567+0000","last_peered":"2024-05-04T00:31:26.049567+0000","last_clean":"2024-05-04T00:31:26.049567+0000","last_became_active":"2024-05-04T00:31:21.401495+0000","last_became_peered":"2024-05-04T00:31:21.401495+0000","last_unstale":"2024-05-04T00:31:26.049567+0000","last_undegraded":"2024-05-04T00:31:26.049567+0000","last_fullsized":"2024-05-04T00:31:26.049567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:09.622538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335160+0000","last_change":"2024-05-04T00:31:21.410958+0000","last_active":"2024-05-04T00:31:26.335160+0000","last_peered":"2024-05-04T00:31:26.335160+0000","last_clean":"2024-05-04T00:31:26.335160+0000","last_became_active":"2024-05-04T00:31:21.410489+0000","last_became_peered":"2024-05-04T00:31:21.410489+0000","last_unstale":"2024-05-04T00:31:26.335160+0000","last_undegraded":"2024-05-04T00:31:26.335160+0000","last_fullsized":"2024-05-04T00:31:26.335160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:05:47.448392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977378+0000","last_change":"2024-05-04T00:31:21.187055+0000","last_active":"2024-05-04T00:31:25.977378+0000","last_peered":"2024-05-04T00:31:25.977378+0000","last_clean":"2024-05-04T00:31:25.977378+0000","last_became_active":"2024-05-04T00:31:21.186141+0000","last_became_peered":"2024-05-04T00:31:21.186141+0000","last_unstale":"2024-05-04T00:31:25.977378+0000","last_undegraded":"2024-05-04T00:31:25.977378+0000","last_fullsized":"2024-05-04T00:31:25.977378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:53:13.451818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978989+0000","last_change":"2024-05-04T00:31:21.406402+0000","last_active":"2024-05-04T00:31:25.978989+0000","last_peered":"2024-05-04T00:31:25.978989+0000","last_clean":"2024-05-04T00:31:25.978989+0000","last_became_active":"2024-05-04T00:31:21.389108+0000","last_became_peered":"2024-05-04T00:31:21.389108+0000","last_unstale":"2024-05-04T00:31:25.978989+0000","last_undegraded":"2024-05-04T00:31:25.978989+0000","last_fullsized":"2024-05-04T00:31:25.978989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:11:03.598993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334910+0000","last_change":"2024-05-04T00:31:21.418601+0000","last_active":"2024-05-04T00:31:26.334910+0000","last_peered":"2024-05-04T00:31:26.334910+0000","last_clean":"2024-05-04T00:31:26.334910+0000","last_became_active":"2024-05-04T00:31:21.417914+0000","last_became_peered":"2024-05-04T00:31:21.417914+0000","last_unstale":"2024-05-04T00:31:26.334910+0000","last_undegraded":"2024-05-04T00:31:26.334910+0000","last_fullsized":"2024-05-04T00:31:26.334910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:23:35.270037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978633+0000","last_change":"2024-05-04T00:31:21.441868+0000","last_active":"2024-05-04T00:31:25.978633+0000","last_peered":"2024-05-04T00:31:25.978633+0000","last_clean":"2024-05-04T00:31:25.978633+0000","last_became_active":"2024-05-04T00:31:21.440945+0000","last_became_peered":"2024-05-04T00:31:21.440945+0000","last_unstale":"2024-05-04T00:31:25.978633+0000","last_undegraded":"2024-05-04T00:31:25.978633+0000","last_fullsized":"2024-05-04T00:31:25.978633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:47:43.629512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334519+0000","last_change":"2024-05-04T00:31:21.395356+0000","last_active":"2024-05-04T00:31:26.334519+0000","last_peered":"2024-05-04T00:31:26.334519+0000","last_clean":"2024-05-04T00:31:26.334519+0000","last_became_active":"2024-05-04T00:31:21.394461+0000","last_became_peered":"2024-05-04T00:31:21.394461+0000","last_unstale":"2024-05-04T00:31:26.334519+0000","last_undegraded":"2024-05-04T00:31:26.334519+0000","last_fullsized":"2024-05-04T00:31:26.334519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:42:31.303120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088316+0000","last_change":"2024-05-04T00:31:21.446878+0000","last_active":"2024-05-04T00:31:26.088316+0000","last_peered":"2024-05-04T00:31:26.088316+0000","last_clean":"2024-05-04T00:31:26.088316+0000","last_became_active":"2024-05-04T00:31:21.446250+0000","last_became_peered":"2024-05-04T00:31:21.446250+0000","last_unstale":"2024-05-04T00:31:26.088316+0000","last_undegraded":"2024-05-04T00:31:26.088316+0000","last_fullsized":"2024-05-04T00:31:26.088316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:42.617159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333229+0000","last_change":"2024-05-04T00:31:21.414182+0000","last_active":"2024-05-04T00:31:26.333229+0000","last_peered":"2024-05-04T00:31:26.333229+0000","last_clean":"2024-05-04T00:31:26.333229+0000","last_became_active":"2024-05-04T00:31:21.413073+0000","last_became_peered":"2024-05-04T00:31:21.413073+0000","last_unstale":"2024-05-04T00:31:26.333229+0000","last_undegraded":"2024-05-04T00:31:26.333229+0000","last_fullsized":"2024-05-04T00:31:26.333229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:23.471892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335510+0000","last_change":"2024-05-04T00:31:21.403827+0000","last_active":"2024-05-04T00:31:26.335510+0000","last_peered":"2024-05-04T00:31:26.335510+0000","last_clean":"2024-05-04T00:31:26.335510+0000","last_became_active":"2024-05-04T00:31:21.402985+0000","last_became_peered":"2024-05-04T00:31:21.402985+0000","last_unstale":"2024-05-04T00:31:26.335510+0000","last_undegraded":"2024-05-04T00:31:26.335510+0000","last_fullsized":"2024-05-04T00:31:26.335510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:43:15.203235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977429+0000","last_change":"2024-05-04T00:31:21.393270+0000","last_active":"2024-05-04T00:31:25.977429+0000","last_peered":"2024-05-04T00:31:25.977429+0000","last_clean":"2024-05-04T00:31:25.977429+0000","last_became_active":"2024-05-04T00:31:21.392368+0000","last_became_peered":"2024-05-04T00:31:21.392368+0000","last_unstale":"2024-05-04T00:31:25.977429+0000","last_undegraded":"2024-05-04T00:31:25.977429+0000","last_fullsized":"2024-05-04T00:31:25.977429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:49:22.354637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336437+0000","last_change":"2024-05-04T00:31:21.416800+0000","last_active":"2024-05-04T00:31:26.336437+0000","last_peered":"2024-05-04T00:31:26.336437+0000","last_clean":"2024-05-04T00:31:26.336437+0000","last_became_active":"2024-05-04T00:31:21.415540+0000","last_became_peered":"2024-05-04T00:31:21.415540+0000","last_unstale":"2024-05-04T00:31:26.336437+0000","last_undegraded":"2024-05-04T00:31:26.336437+0000","last_fullsized":"2024-05-04T00:31:26.336437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:00:51.313452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335047+0000","last_change":"2024-05-04T00:31:21.188504+0000","last_active":"2024-05-04T00:31:26.335047+0000","last_peered":"2024-05-04T00:31:26.335047+0000","last_clean":"2024-05-04T00:31:26.335047+0000","last_became_active":"2024-05-04T00:31:21.187877+0000","last_became_peered":"2024-05-04T00:31:21.187877+0000","last_unstale":"2024-05-04T00:31:26.335047+0000","last_undegraded":"2024-05-04T00:31:26.335047+0000","last_fullsized":"2024-05-04T00:31:26.335047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:48:39.671984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.050292+0000","last_change":"2024-05-04T00:31:21.393500+0000","last_active":"2024-05-04T00:31:26.050292+0000","last_peered":"2024-05-04T00:31:26.050292+0000","last_clean":"2024-05-04T00:31:26.050292+0000","last_became_active":"2024-05-04T00:31:21.392579+0000","last_became_peered":"2024-05-04T00:31:21.392579+0000","last_unstale":"2024-05-04T00:31:26.050292+0000","last_undegraded":"2024-05-04T00:31:26.050292+0000","last_fullsized":"2024-05-04T00:31:26.050292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:16.804136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049793+0000","last_change":"2024-05-04T00:31:21.395778+0000","last_active":"2024-05-04T00:31:26.049793+0000","last_peered":"2024-05-04T00:31:26.049793+0000","last_clean":"2024-05-04T00:31:26.049793+0000","last_became_active":"2024-05-04T00:31:21.394966+0000","last_became_peered":"2024-05-04T00:31:21.394966+0000","last_unstale":"2024-05-04T00:31:26.049793+0000","last_undegraded":"2024-05-04T00:31:26.049793+0000","last_fullsized":"2024-05-04T00:31:26.049793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:53:28.166224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335626+0000","last_change":"2024-05-04T00:31:21.405250+0000","last_active":"2024-05-04T00:31:26.335626+0000","last_peered":"2024-05-04T00:31:26.335626+0000","last_clean":"2024-05-04T00:31:26.335626+0000","last_became_active":"2024-05-04T00:31:21.403779+0000","last_became_peered":"2024-05-04T00:31:21.403779+0000","last_unstale":"2024-05-04T00:31:26.335626+0000","last_undegraded":"2024-05-04T00:31:26.335626+0000","last_fullsized":"2024-05-04T00:31:26.335626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:33.187636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977754+0000","last_change":"2024-05-04T00:31:21.399896+0000","last_active":"2024-05-04T00:31:25.977754+0000","last_peered":"2024-05-04T00:31:25.977754+0000","last_clean":"2024-05-04T00:31:25.977754+0000","last_became_active":"2024-05-04T00:31:21.398994+0000","last_became_peered":"2024-05-04T00:31:21.398994+0000","last_unstale":"2024-05-04T00:31:25.977754+0000","last_undegraded":"2024-05-04T00:31:25.977754+0000","last_fullsized":"2024-05-04T00:31:25.977754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:32:42.591423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334354+0000","last_change":"2024-05-04T00:31:21.416130+0000","last_active":"2024-05-04T00:31:26.334354+0000","last_peered":"2024-05-04T00:31:26.334354+0000","last_clean":"2024-05-04T00:31:26.334354+0000","last_became_active":"2024-05-04T00:31:21.415395+0000","last_became_peered":"2024-05-04T00:31:21.415395+0000","last_unstale":"2024-05-04T00:31:26.334354+0000","last_undegraded":"2024-05-04T00:31:26.334354+0000","last_fullsized":"2024-05-04T00:31:26.334354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:33:22.819977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.332079+0000","last_change":"2024-05-04T00:31:21.342105+0000","last_active":"2024-05-04T00:31:26.332079+0000","last_peered":"2024-05-04T00:31:26.332079+0000","last_clean":"2024-05-04T00:31:26.332079+0000","last_became_active":"2024-05-04T00:31:21.341333+0000","last_became_peered":"2024-05-04T00:31:21.341333+0000","last_unstale":"2024-05-04T00:31:26.332079+0000","last_undegraded":"2024-05-04T00:31:26.332079+0000","last_fullsized":"2024-05-04T00:31:26.332079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:23.471892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333474+0000","last_change":"2024-05-04T00:31:21.405647+0000","last_active":"2024-05-04T00:31:26.333474+0000","last_peered":"2024-05-04T00:31:26.333474+0000","last_clean":"2024-05-04T00:31:26.333474+0000","last_became_active":"2024-05-04T00:31:21.403998+0000","last_became_peered":"2024-05-04T00:31:21.403998+0000","last_unstale":"2024-05-04T00:31:26.333474+0000","last_undegraded":"2024-05-04T00:31:26.333474+0000","last_fullsized":"2024-05-04T00:31:26.333474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:54.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.681469+0000","last_change":"2024-05-04T00:31:19.185018+0000","last_active":"2024-05-04T00:31:31.681469+0000","last_peered":"2024-05-04T00:31:31.681469+0000","last_clean":"2024-05-04T00:31:31.681469+0000","last_became_active":"2024-05-04T00:31:19.181107+0000","last_became_peered":"2024-05-04T00:31:19.181107+0000","last_unstale":"2024-05-04T00:31:31.681469+0000","last_undegraded":"2024-05-04T00:31:31.681469+0000","last_fullsized":"2024-05-04T00:31:31.681469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:14.453153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088596+0000","last_change":"2024-05-04T00:31:21.446209+0000","last_active":"2024-05-04T00:31:26.088596+0000","last_peered":"2024-05-04T00:31:26.088596+0000","last_clean":"2024-05-04T00:31:26.088596+0000","last_became_active":"2024-05-04T00:31:21.445793+0000","last_became_peered":"2024-05-04T00:31:21.445793+0000","last_unstale":"2024-05-04T00:31:26.088596+0000","last_undegraded":"2024-05-04T00:31:26.088596+0000","last_fullsized":"2024-05-04T00:31:26.088596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:54:48.084884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.417524+0000","last_change":"2024-05-04T00:31:19.185102+0000","last_active":"2024-05-04T00:31:35.417524+0000","last_peered":"2024-05-04T00:31:35.417524+0000","last_clean":"2024-05-04T00:31:35.417524+0000","last_became_active":"2024-05-04T00:31:19.183394+0000","last_became_peered":"2024-05-04T00:31:19.183394+0000","last_unstale":"2024-05-04T00:31:35.417524+0000","last_undegraded":"2024-05-04T00:31:35.417524+0000","last_fullsized":"2024-05-04T00:31:35.417524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:36:38.420366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.401984+0000","last_change":"2024-05-04T00:31:19.158945+0000","last_active":"2024-05-04T00:31:35.401984+0000","last_peered":"2024-05-04T00:31:35.401984+0000","last_clean":"2024-05-04T00:31:35.401984+0000","last_became_active":"2024-05-04T00:31:19.158152+0000","last_became_peered":"2024-05-04T00:31:19.158152+0000","last_unstale":"2024-05-04T00:31:35.401984+0000","last_undegraded":"2024-05-04T00:31:35.401984+0000","last_fullsized":"2024-05-04T00:31:35.401984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:52.040804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335758+0000","last_change":"2024-05-04T00:31:21.397183+0000","last_active":"2024-05-04T00:31:26.335758+0000","last_peered":"2024-05-04T00:31:26.335758+0000","last_clean":"2024-05-04T00:31:26.335758+0000","last_became_active":"2024-05-04T00:31:21.393014+0000","last_became_peered":"2024-05-04T00:31:21.393014+0000","last_unstale":"2024-05-04T00:31:26.335758+0000","last_undegraded":"2024-05-04T00:31:26.335758+0000","last_fullsized":"2024-05-04T00:31:26.335758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:40:12.379274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977589+0000","last_change":"2024-05-04T00:31:19.186007+0000","last_active":"2024-05-04T00:31:25.977589+0000","last_peered":"2024-05-04T00:31:25.977589+0000","last_clean":"2024-05-04T00:31:25.977589+0000","last_became_active":"2024-05-04T00:31:19.184526+0000","last_became_peered":"2024-05-04T00:31:19.184526+0000","last_unstale":"2024-05-04T00:31:25.977589+0000","last_undegraded":"2024-05-04T00:31:25.977589+0000","last_fullsized":"2024-05-04T00:31:25.977589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:01:33.042606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088155+0000","last_change":"2024-05-04T00:31:21.447258+0000","last_active":"2024-05-04T00:31:26.088155+0000","last_peered":"2024-05-04T00:31:26.088155+0000","last_clean":"2024-05-04T00:31:26.088155+0000","last_became_active":"2024-05-04T00:31:21.446842+0000","last_became_peered":"2024-05-04T00:31:21.446842+0000","last_unstale":"2024-05-04T00:31:26.088155+0000","last_undegraded":"2024-05-04T00:31:26.088155+0000","last_fullsized":"2024-05-04T00:31:26.088155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:10:57.675700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.719730+0000","last_change":"2024-05-04T00:31:19.190422+0000","last_active":"2024-05-04T00:31:31.719730+0000","last_peered":"2024-05-04T00:31:31.719730+0000","last_clean":"2024-05-04T00:31:31.719730+0000","last_became_active":"2024-05-04T00:31:19.189517+0000","last_became_peered":"2024-05-04T00:31:19.189517+0000","last_unstale":"2024-05-04T00:31:31.719730+0000","last_undegraded":"2024-05-04T00:31:31.719730+0000","last_fullsized":"2024-05-04T00:31:31.719730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:16:41.367677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334482+0000","last_change":"2024-05-04T00:31:21.184586+0000","last_active":"2024-05-04T00:31:26.334482+0000","last_peered":"2024-05-04T00:31:26.334482+0000","last_clean":"2024-05-04T00:31:26.334482+0000","last_became_active":"2024-05-04T00:31:21.183698+0000","last_became_peered":"2024-05-04T00:31:21.183698+0000","last_unstale":"2024-05-04T00:31:26.334482+0000","last_undegraded":"2024-05-04T00:31:26.334482+0000","last_fullsized":"2024-05-04T00:31:26.334482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:47:25.699731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.679301+0000","last_change":"2024-05-04T00:31:19.186623+0000","last_active":"2024-05-04T00:31:31.679301+0000","last_peered":"2024-05-04T00:31:31.679301+0000","last_clean":"2024-05-04T00:31:31.679301+0000","last_became_active":"2024-05-04T00:31:19.185633+0000","last_became_peered":"2024-05-04T00:31:19.185633+0000","last_unstale":"2024-05-04T00:31:31.679301+0000","last_undegraded":"2024-05-04T00:31:31.679301+0000","last_fullsized":"2024-05-04T00:31:31.679301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:10:55.324717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336711+0000","last_change":"2024-05-04T00:31:21.410329+0000","last_active":"2024-05-04T00:31:26.336711+0000","last_peered":"2024-05-04T00:31:26.336711+0000","last_clean":"2024-05-04T00:31:26.336711+0000","last_became_active":"2024-05-04T00:31:21.409655+0000","last_became_peered":"2024-05-04T00:31:21.409655+0000","last_unstale":"2024-05-04T00:31:26.336711+0000","last_undegraded":"2024-05-04T00:31:26.336711+0000","last_fullsized":"2024-05-04T00:31:26.336711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:09:40.562107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334997+0000","last_change":"2024-05-04T00:31:19.178130+0000","last_active":"2024-05-04T00:31:26.334997+0000","last_peered":"2024-05-04T00:31:26.334997+0000","last_clean":"2024-05-04T00:31:26.334997+0000","last_became_active":"2024-05-04T00:31:19.177283+0000","last_became_peered":"2024-05-04T00:31:19.177283+0000","last_unstale":"2024-05-04T00:31:26.334997+0000","last_undegraded":"2024-05-04T00:31:26.334997+0000","last_fullsized":"2024-05-04T00:31:26.334997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:42:41.790988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978336+0000","last_change":"2024-05-04T00:31:21.187102+0000","last_active":"2024-05-04T00:31:25.978336+0000","last_peered":"2024-05-04T00:31:25.978336+0000","last_clean":"2024-05-04T00:31:25.978336+0000","last_became_active":"2024-05-04T00:31:21.186167+0000","last_became_peered":"2024-05-04T00:31:21.186167+0000","last_unstale":"2024-05-04T00:31:25.978336+0000","last_undegraded":"2024-05-04T00:31:25.978336+0000","last_fullsized":"2024-05-04T00:31:25.978336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:05:04.013367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"26'8","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.701064+0000","last_change":"2024-05-04T00:31:19.251247+0000","last_active":"2024-05-04T00:31:31.701064+0000","last_peered":"2024-05-04T00:31:31.701064+0000","last_clean":"2024-05-04T00:31:31.701064+0000","last_became_active":"2024-05-04T00:31:19.250003+0000","last_became_peered":"2024-05-04T00:31:19.250003+0000","last_unstale":"2024-05-04T00:31:31.701064+0000","last_undegraded":"2024-05-04T00:31:31.701064+0000","last_fullsized":"2024-05-04T00:31:31.701064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:40:06.774090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334818+0000","last_change":"2024-05-04T00:31:21.401432+0000","last_active":"2024-05-04T00:31:26.334818+0000","last_peered":"2024-05-04T00:31:26.334818+0000","last_clean":"2024-05-04T00:31:26.334818+0000","last_became_active":"2024-05-04T00:31:21.397220+0000","last_became_peered":"2024-05-04T00:31:21.397220+0000","last_unstale":"2024-05-04T00:31:26.334818+0000","last_undegraded":"2024-05-04T00:31:26.334818+0000","last_fullsized":"2024-05-04T00:31:26.334818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:07.460897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.308011+0000","last_change":"2024-05-04T00:31:19.183674+0000","last_active":"2024-05-04T00:31:35.308011+0000","last_peered":"2024-05-04T00:31:35.308011+0000","last_clean":"2024-05-04T00:31:35.308011+0000","last_became_active":"2024-05-04T00:31:19.183331+0000","last_became_peered":"2024-05-04T00:31:19.183331+0000","last_unstale":"2024-05-04T00:31:35.308011+0000","last_undegraded":"2024-05-04T00:31:35.308011+0000","last_fullsized":"2024-05-04T00:31:35.308011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:13:52.447627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049560+0000","last_change":"2024-05-04T00:31:21.342578+0000","last_active":"2024-05-04T00:31:26.049560+0000","last_peered":"2024-05-04T00:31:26.049560+0000","last_clean":"2024-05-04T00:31:26.049560+0000","last_became_active":"2024-05-04T00:31:21.342064+0000","last_became_peered":"2024-05-04T00:31:21.342064+0000","last_unstale":"2024-05-04T00:31:26.049560+0000","last_undegraded":"2024-05-04T00:31:26.049560+0000","last_fullsized":"2024-05-04T00:31:26.049560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:35.377002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.655969+0000","last_change":"2024-05-04T00:31:19.184166+0000","last_active":"2024-05-04T00:31:31.655969+0000","last_peered":"2024-05-04T00:31:31.655969+0000","last_clean":"2024-05-04T00:31:31.655969+0000","last_became_active":"2024-05-04T00:31:19.181304+0000","last_became_peered":"2024-05-04T00:31:19.181304+0000","last_unstale":"2024-05-04T00:31:31.655969+0000","last_undegraded":"2024-05-04T00:31:31.655969+0000","last_fullsized":"2024-05-04T00:31:31.655969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:49:04.376111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978217+0000","last_change":"2024-05-04T00:31:21.390252+0000","last_active":"2024-05-04T00:31:25.978217+0000","last_peered":"2024-05-04T00:31:25.978217+0000","last_clean":"2024-05-04T00:31:25.978217+0000","last_became_active":"2024-05-04T00:31:21.389360+0000","last_became_peered":"2024-05-04T00:31:21.389360+0000","last_unstale":"2024-05-04T00:31:25.978217+0000","last_undegraded":"2024-05-04T00:31:25.978217+0000","last_fullsized":"2024-05-04T00:31:25.978217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:45:23.177550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.224290+0000","last_change":"2024-05-04T00:31:19.176756+0000","last_active":"2024-05-04T00:31:35.224290+0000","last_peered":"2024-05-04T00:31:35.224290+0000","last_clean":"2024-05-04T00:31:35.224290+0000","last_became_active":"2024-05-04T00:31:19.175779+0000","last_became_peered":"2024-05-04T00:31:19.175779+0000","last_unstale":"2024-05-04T00:31:35.224290+0000","last_undegraded":"2024-05-04T00:31:35.224290+0000","last_fullsized":"2024-05-04T00:31:35.224290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:14.453153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.332161+0000","last_change":"2024-05-04T00:31:21.397306+0000","last_active":"2024-05-04T00:31:26.332161+0000","last_peered":"2024-05-04T00:31:26.332161+0000","last_clean":"2024-05-04T00:31:26.332161+0000","last_became_active":"2024-05-04T00:31:21.394863+0000","last_became_peered":"2024-05-04T00:31:21.394863+0000","last_unstale":"2024-05-04T00:31:26.332161+0000","last_undegraded":"2024-05-04T00:31:26.332161+0000","last_fullsized":"2024-05-04T00:31:26.332161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:46:38.463068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.210796+0000","last_change":"2024-05-04T00:31:19.177402+0000","last_active":"2024-05-04T00:31:35.210796+0000","last_peered":"2024-05-04T00:31:35.210796+0000","last_clean":"2024-05-04T00:31:35.210796+0000","last_became_active":"2024-05-04T00:31:19.176805+0000","last_became_peered":"2024-05-04T00:31:19.176805+0000","last_unstale":"2024-05-04T00:31:35.210796+0000","last_undegraded":"2024-05-04T00:31:35.210796+0000","last_fullsized":"2024-05-04T00:31:35.210796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:31.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977565+0000","last_change":"2024-05-04T00:31:21.188457+0000","last_active":"2024-05-04T00:31:25.977565+0000","last_peered":"2024-05-04T00:31:25.977565+0000","last_clean":"2024-05-04T00:31:25.977565+0000","last_became_active":"2024-05-04T00:31:21.187554+0000","last_became_peered":"2024-05-04T00:31:21.187554+0000","last_unstale":"2024-05-04T00:31:25.977565+0000","last_undegraded":"2024-05-04T00:31:25.977565+0000","last_fullsized":"2024-05-04T00:31:25.977565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:31:55.671261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335354+0000","last_change":"2024-05-04T00:31:19.176641+0000","last_active":"2024-05-04T00:31:26.335354+0000","last_peered":"2024-05-04T00:31:26.335354+0000","last_clean":"2024-05-04T00:31:26.335354+0000","last_became_active":"2024-05-04T00:31:19.175715+0000","last_became_peered":"2024-05-04T00:31:19.175715+0000","last_unstale":"2024-05-04T00:31:26.335354+0000","last_undegraded":"2024-05-04T00:31:26.335354+0000","last_fullsized":"2024-05-04T00:31:26.335354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:05:45.097410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334791+0000","last_change":"2024-05-04T00:31:21.407554+0000","last_active":"2024-05-04T00:31:26.334791+0000","last_peered":"2024-05-04T00:31:26.334791+0000","last_clean":"2024-05-04T00:31:26.334791+0000","last_became_active":"2024-05-04T00:31:21.403004+0000","last_became_peered":"2024-05-04T00:31:21.403004+0000","last_unstale":"2024-05-04T00:31:26.334791+0000","last_undegraded":"2024-05-04T00:31:26.334791+0000","last_fullsized":"2024-05-04T00:31:26.334791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:33.938895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088847+0000","last_change":"2024-05-04T00:31:19.187116+0000","last_active":"2024-05-04T00:31:26.088847+0000","last_peered":"2024-05-04T00:31:26.088847+0000","last_clean":"2024-05-04T00:31:26.088847+0000","last_became_active":"2024-05-04T00:31:19.186540+0000","last_became_peered":"2024-05-04T00:31:19.186540+0000","last_unstale":"2024-05-04T00:31:26.088847+0000","last_undegraded":"2024-05-04T00:31:26.088847+0000","last_fullsized":"2024-05-04T00:31:26.088847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:08.420067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334905+0000","last_change":"2024-05-04T00:31:21.407986+0000","last_active":"2024-05-04T00:31:26.334905+0000","last_peered":"2024-05-04T00:31:26.334905+0000","last_clean":"2024-05-04T00:31:26.334905+0000","last_became_active":"2024-05-04T00:31:21.404350+0000","last_became_peered":"2024-05-04T00:31:21.404350+0000","last_unstale":"2024-05-04T00:31:26.334905+0000","last_undegraded":"2024-05-04T00:31:26.334905+0000","last_fullsized":"2024-05-04T00:31:26.334905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:12:34.898595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336199+0000","last_change":"2024-05-04T00:31:19.190045+0000","last_active":"2024-05-04T00:31:26.336199+0000","last_peered":"2024-05-04T00:31:26.336199+0000","last_clean":"2024-05-04T00:31:26.336199+0000","last_became_active":"2024-05-04T00:31:19.189166+0000","last_became_peered":"2024-05-04T00:31:19.189166+0000","last_unstale":"2024-05-04T00:31:26.336199+0000","last_undegraded":"2024-05-04T00:31:26.336199+0000","last_fullsized":"2024-05-04T00:31:26.336199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:31.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334803+0000","last_change":"2024-05-04T00:31:21.402171+0000","last_active":"2024-05-04T00:31:26.334803+0000","last_peered":"2024-05-04T00:31:26.334803+0000","last_clean":"2024-05-04T00:31:26.334803+0000","last_became_active":"2024-05-04T00:31:21.401467+0000","last_became_peered":"2024-05-04T00:31:21.401467+0000","last_unstale":"2024-05-04T00:31:26.334803+0000","last_undegraded":"2024-05-04T00:31:26.334803+0000","last_fullsized":"2024-05-04T00:31:26.334803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:34:25.722557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.404498+0000","last_change":"2024-05-04T00:31:19.155210+0000","last_active":"2024-05-04T00:31:35.404498+0000","last_peered":"2024-05-04T00:31:35.404498+0000","last_clean":"2024-05-04T00:31:35.404498+0000","last_became_active":"2024-05-04T00:31:19.154504+0000","last_became_peered":"2024-05-04T00:31:19.154504+0000","last_unstale":"2024-05-04T00:31:35.404498+0000","last_undegraded":"2024-05-04T00:31:35.404498+0000","last_fullsized":"2024-05-04T00:31:35.404498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:47:23.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978511+0000","last_change":"2024-05-04T00:31:21.406273+0000","last_active":"2024-05-04T00:31:25.978511+0000","last_peered":"2024-05-04T00:31:25.978511+0000","last_clean":"2024-05-04T00:31:25.978511+0000","last_became_active":"2024-05-04T00:31:21.405283+0000","last_became_peered":"2024-05-04T00:31:21.405283+0000","last_unstale":"2024-05-04T00:31:25.978511+0000","last_undegraded":"2024-05-04T00:31:25.978511+0000","last_fullsized":"2024-05-04T00:31:25.978511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:20:31.795673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":117,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.332489+0000","last_change":"2024-05-04T00:30:40.841283+0000","last_active":"2024-05-04T00:31:26.332489+0000","last_peered":"2024-05-04T00:31:26.332489+0000","last_clean":"2024-05-04T00:31:26.332489+0000","last_became_active":"2024-05-04T00:30:40.838353+0000","last_became_peered":"2024-05-04T00:30:40.838353+0000","last_unstale":"2024-05-04T00:31:26.332489+0000","last_undegraded":"2024-05-04T00:31:26.332489+0000","last_fullsized":"2024-05-04T00:31:26.332489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:30:37.159356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:30:37.159356+0000","last_clean_scrub_stamp":"2024-05-04T00:30:37.159356+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:30:10.374994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.656668+0000","last_change":"2024-05-04T00:31:19.248691+0000","last_active":"2024-05-04T00:31:31.656668+0000","last_peered":"2024-05-04T00:31:31.656668+0000","last_clean":"2024-05-04T00:31:31.656668+0000","last_became_active":"2024-05-04T00:31:19.247815+0000","last_became_peered":"2024-05-04T00:31:19.247815+0000","last_unstale":"2024-05-04T00:31:31.656668+0000","last_undegraded":"2024-05-04T00:31:31.656668+0000","last_fullsized":"2024-05-04T00:31:31.656668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:46:05.720208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088363+0000","last_change":"2024-05-04T00:31:21.446500+0000","last_active":"2024-05-04T00:31:26.088363+0000","last_peered":"2024-05-04T00:31:26.088363+0000","last_clean":"2024-05-04T00:31:26.088363+0000","last_became_active":"2024-05-04T00:31:21.446100+0000","last_became_peered":"2024-05-04T00:31:21.446100+0000","last_unstale":"2024-05-04T00:31:26.088363+0000","last_undegraded":"2024-05-04T00:31:26.088363+0000","last_fullsized":"2024-05-04T00:31:26.088363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:06.542614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.418363+0000","last_change":"2024-05-04T00:31:19.184044+0000","last_active":"2024-05-04T00:31:35.418363+0000","last_peered":"2024-05-04T00:31:35.418363+0000","last_clean":"2024-05-04T00:31:35.418363+0000","last_became_active":"2024-05-04T00:31:19.181956+0000","last_became_peered":"2024-05-04T00:31:19.181956+0000","last_unstale":"2024-05-04T00:31:35.418363+0000","last_undegraded":"2024-05-04T00:31:35.418363+0000","last_fullsized":"2024-05-04T00:31:35.418363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:09:33.607433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049528+0000","last_change":"2024-05-04T00:31:21.343953+0000","last_active":"2024-05-04T00:31:26.049528+0000","last_peered":"2024-05-04T00:31:26.049528+0000","last_clean":"2024-05-04T00:31:26.049528+0000","last_became_active":"2024-05-04T00:31:21.343499+0000","last_became_peered":"2024-05-04T00:31:21.343499+0000","last_unstale":"2024-05-04T00:31:26.049528+0000","last_undegraded":"2024-05-04T00:31:26.049528+0000","last_fullsized":"2024-05-04T00:31:26.049528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:33.938895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.311044+0000","last_change":"2024-05-04T00:31:19.184947+0000","last_active":"2024-05-04T00:31:35.311044+0000","last_peered":"2024-05-04T00:31:35.311044+0000","last_clean":"2024-05-04T00:31:35.311044+0000","last_became_active":"2024-05-04T00:31:19.184606+0000","last_became_peered":"2024-05-04T00:31:19.184606+0000","last_unstale":"2024-05-04T00:31:35.311044+0000","last_undegraded":"2024-05-04T00:31:35.311044+0000","last_fullsized":"2024-05-04T00:31:35.311044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:07:49.638230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335413+0000","last_change":"2024-05-04T00:31:21.402799+0000","last_active":"2024-05-04T00:31:26.335413+0000","last_peered":"2024-05-04T00:31:26.335413+0000","last_clean":"2024-05-04T00:31:26.335413+0000","last_became_active":"2024-05-04T00:31:21.401591+0000","last_became_peered":"2024-05-04T00:31:21.401591+0000","last_unstale":"2024-05-04T00:31:26.335413+0000","last_undegraded":"2024-05-04T00:31:26.335413+0000","last_fullsized":"2024-05-04T00:31:26.335413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:28:07.779536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978310+0000","last_change":"2024-05-04T00:31:19.182214+0000","last_active":"2024-05-04T00:31:25.978310+0000","last_peered":"2024-05-04T00:31:25.978310+0000","last_clean":"2024-05-04T00:31:25.978310+0000","last_became_active":"2024-05-04T00:31:19.180317+0000","last_became_peered":"2024-05-04T00:31:19.180317+0000","last_unstale":"2024-05-04T00:31:25.978310+0000","last_undegraded":"2024-05-04T00:31:25.978310+0000","last_fullsized":"2024-05-04T00:31:25.978310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:44.678316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334340+0000","last_change":"2024-05-04T00:31:21.401965+0000","last_active":"2024-05-04T00:31:26.334340+0000","last_peered":"2024-05-04T00:31:26.334340+0000","last_clean":"2024-05-04T00:31:26.334340+0000","last_became_active":"2024-05-04T00:31:21.389808+0000","last_became_peered":"2024-05-04T00:31:21.389808+0000","last_unstale":"2024-05-04T00:31:26.334340+0000","last_undegraded":"2024-05-04T00:31:26.334340+0000","last_fullsized":"2024-05-04T00:31:26.334340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:52:48.345813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336089+0000","last_change":"2024-05-04T00:31:19.183991+0000","last_active":"2024-05-04T00:31:26.336089+0000","last_peered":"2024-05-04T00:31:26.336089+0000","last_clean":"2024-05-04T00:31:26.336089+0000","last_became_active":"2024-05-04T00:31:19.179785+0000","last_became_peered":"2024-05-04T00:31:19.179785+0000","last_unstale":"2024-05-04T00:31:26.336089+0000","last_undegraded":"2024-05-04T00:31:26.336089+0000","last_fullsized":"2024-05-04T00:31:26.336089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:29.575176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333549+0000","last_change":"2024-05-04T00:31:21.342687+0000","last_active":"2024-05-04T00:31:26.333549+0000","last_peered":"2024-05-04T00:31:26.333549+0000","last_clean":"2024-05-04T00:31:26.333549+0000","last_became_active":"2024-05-04T00:31:21.341702+0000","last_became_peered":"2024-05-04T00:31:21.341702+0000","last_unstale":"2024-05-04T00:31:26.333549+0000","last_undegraded":"2024-05-04T00:31:26.333549+0000","last_fullsized":"2024-05-04T00:31:26.333549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:56.687510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978903+0000","last_change":"2024-05-04T00:31:19.176663+0000","last_active":"2024-05-04T00:31:25.978903+0000","last_peered":"2024-05-04T00:31:25.978903+0000","last_clean":"2024-05-04T00:31:25.978903+0000","last_became_active":"2024-05-04T00:31:19.175616+0000","last_became_peered":"2024-05-04T00:31:19.175616+0000","last_unstale":"2024-05-04T00:31:25.978903+0000","last_undegraded":"2024-05-04T00:31:25.978903+0000","last_fullsized":"2024-05-04T00:31:25.978903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:24:47.124717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.050096+0000","last_change":"2024-05-04T00:31:21.403129+0000","last_active":"2024-05-04T00:31:26.050096+0000","last_peered":"2024-05-04T00:31:26.050096+0000","last_clean":"2024-05-04T00:31:26.050096+0000","last_became_active":"2024-05-04T00:31:21.402248+0000","last_became_peered":"2024-05-04T00:31:21.402248+0000","last_unstale":"2024-05-04T00:31:26.050096+0000","last_undegraded":"2024-05-04T00:31:26.050096+0000","last_fullsized":"2024-05-04T00:31:26.050096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:10.771050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.202466+0000","last_change":"2024-05-04T00:31:19.155903+0000","last_active":"2024-05-04T00:31:35.202466+0000","last_peered":"2024-05-04T00:31:35.202466+0000","last_clean":"2024-05-04T00:31:35.202466+0000","last_became_active":"2024-05-04T00:31:19.154909+0000","last_became_peered":"2024-05-04T00:31:19.154909+0000","last_unstale":"2024-05-04T00:31:35.202466+0000","last_undegraded":"2024-05-04T00:31:35.202466+0000","last_fullsized":"2024-05-04T00:31:35.202466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:53:25.815241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088979+0000","last_change":"2024-05-04T00:31:21.445396+0000","last_active":"2024-05-04T00:31:26.088979+0000","last_peered":"2024-05-04T00:31:26.088979+0000","last_clean":"2024-05-04T00:31:26.088979+0000","last_became_active":"2024-05-04T00:31:21.444934+0000","last_became_peered":"2024-05-04T00:31:21.444934+0000","last_unstale":"2024-05-04T00:31:26.088979+0000","last_undegraded":"2024-05-04T00:31:26.088979+0000","last_fullsized":"2024-05-04T00:31:26.088979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:23:02.407000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.645726+0000","last_change":"2024-05-04T00:31:19.182946+0000","last_active":"2024-05-04T00:31:31.645726+0000","last_peered":"2024-05-04T00:31:31.645726+0000","last_clean":"2024-05-04T00:31:31.645726+0000","last_became_active":"2024-05-04T00:31:19.182050+0000","last_became_peered":"2024-05-04T00:31:19.182050+0000","last_unstale":"2024-05-04T00:31:31.645726+0000","last_undegraded":"2024-05-04T00:31:31.645726+0000","last_fullsized":"2024-05-04T00:31:31.645726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:55:12.448558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088626+0000","last_change":"2024-05-04T00:31:21.443100+0000","last_active":"2024-05-04T00:31:26.088626+0000","last_peered":"2024-05-04T00:31:26.088626+0000","last_clean":"2024-05-04T00:31:26.088626+0000","last_became_active":"2024-05-04T00:31:21.442602+0000","last_became_peered":"2024-05-04T00:31:21.442602+0000","last_unstale":"2024-05-04T00:31:26.088626+0000","last_undegraded":"2024-05-04T00:31:26.088626+0000","last_fullsized":"2024-05-04T00:31:26.088626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:16:45.807230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.680264+0000","last_change":"2024-05-04T00:31:19.248358+0000","last_active":"2024-05-04T00:31:31.680264+0000","last_peered":"2024-05-04T00:31:31.680264+0000","last_clean":"2024-05-04T00:31:31.680264+0000","last_became_active":"2024-05-04T00:31:19.247822+0000","last_became_peered":"2024-05-04T00:31:19.247822+0000","last_unstale":"2024-05-04T00:31:31.680264+0000","last_undegraded":"2024-05-04T00:31:31.680264+0000","last_fullsized":"2024-05-04T00:31:31.680264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:04.191631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977590+0000","last_change":"2024-05-04T00:31:21.441959+0000","last_active":"2024-05-04T00:31:25.977590+0000","last_peered":"2024-05-04T00:31:25.977590+0000","last_clean":"2024-05-04T00:31:25.977590+0000","last_became_active":"2024-05-04T00:31:21.441015+0000","last_became_peered":"2024-05-04T00:31:21.441015+0000","last_unstale":"2024-05-04T00:31:25.977590+0000","last_undegraded":"2024-05-04T00:31:25.977590+0000","last_fullsized":"2024-05-04T00:31:25.977590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:54:30.187813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.492350+0000","last_change":"2024-05-04T00:31:19.159146+0000","last_active":"2024-05-04T00:31:31.492350+0000","last_peered":"2024-05-04T00:31:31.492350+0000","last_clean":"2024-05-04T00:31:31.492350+0000","last_became_active":"2024-05-04T00:31:19.158366+0000","last_became_peered":"2024-05-04T00:31:19.158366+0000","last_unstale":"2024-05-04T00:31:31.492350+0000","last_undegraded":"2024-05-04T00:31:31.492350+0000","last_fullsized":"2024-05-04T00:31:31.492350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:07.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088049+0000","last_change":"2024-05-04T00:31:21.441521+0000","last_active":"2024-05-04T00:31:26.088049+0000","last_peered":"2024-05-04T00:31:26.088049+0000","last_clean":"2024-05-04T00:31:26.088049+0000","last_became_active":"2024-05-04T00:31:21.441074+0000","last_became_peered":"2024-05-04T00:31:21.441074+0000","last_unstale":"2024-05-04T00:31:26.088049+0000","last_undegraded":"2024-05-04T00:31:26.088049+0000","last_fullsized":"2024-05-04T00:31:26.088049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:31.926158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.050129+0000","last_change":"2024-05-04T00:31:19.174493+0000","last_active":"2024-05-04T00:31:26.050129+0000","last_peered":"2024-05-04T00:31:26.050129+0000","last_clean":"2024-05-04T00:31:26.050129+0000","last_became_active":"2024-05-04T00:31:19.174113+0000","last_became_peered":"2024-05-04T00:31:19.174113+0000","last_unstale":"2024-05-04T00:31:26.050129+0000","last_undegraded":"2024-05-04T00:31:26.050129+0000","last_fullsized":"2024-05-04T00:31:26.050129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:54.336528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334858+0000","last_change":"2024-05-04T00:31:21.406782+0000","last_active":"2024-05-04T00:31:26.334858+0000","last_peered":"2024-05-04T00:31:26.334858+0000","last_clean":"2024-05-04T00:31:26.334858+0000","last_became_active":"2024-05-04T00:31:21.406008+0000","last_became_peered":"2024-05-04T00:31:21.406008+0000","last_unstale":"2024-05-04T00:31:26.334858+0000","last_undegraded":"2024-05-04T00:31:26.334858+0000","last_fullsized":"2024-05-04T00:31:26.334858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:24:01.565048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.645923+0000","last_change":"2024-05-04T00:31:19.248682+0000","last_active":"2024-05-04T00:31:31.645923+0000","last_peered":"2024-05-04T00:31:31.645923+0000","last_clean":"2024-05-04T00:31:31.645923+0000","last_became_active":"2024-05-04T00:31:19.247736+0000","last_became_peered":"2024-05-04T00:31:19.247736+0000","last_unstale":"2024-05-04T00:31:31.645923+0000","last_undegraded":"2024-05-04T00:31:31.645923+0000","last_fullsized":"2024-05-04T00:31:31.645923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:42:59.459764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977927+0000","last_change":"2024-05-04T00:31:21.401858+0000","last_active":"2024-05-04T00:31:25.977927+0000","last_peered":"2024-05-04T00:31:25.977927+0000","last_clean":"2024-05-04T00:31:25.977927+0000","last_became_active":"2024-05-04T00:31:21.400935+0000","last_became_peered":"2024-05-04T00:31:21.400935+0000","last_unstale":"2024-05-04T00:31:25.977927+0000","last_undegraded":"2024-05-04T00:31:25.977927+0000","last_fullsized":"2024-05-04T00:31:25.977927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:50:11.762845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978424+0000","last_change":"2024-05-04T00:31:21.392918+0000","last_active":"2024-05-04T00:31:25.978424+0000","last_peered":"2024-05-04T00:31:25.978424+0000","last_clean":"2024-05-04T00:31:25.978424+0000","last_became_active":"2024-05-04T00:31:21.392020+0000","last_became_peered":"2024-05-04T00:31:21.392020+0000","last_unstale":"2024-05-04T00:31:25.978424+0000","last_undegraded":"2024-05-04T00:31:25.978424+0000","last_fullsized":"2024-05-04T00:31:25.978424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:19:30.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334811+0000","last_change":"2024-05-04T00:31:19.187930+0000","last_active":"2024-05-04T00:31:26.334811+0000","last_peered":"2024-05-04T00:31:26.334811+0000","last_clean":"2024-05-04T00:31:26.334811+0000","last_became_active":"2024-05-04T00:31:19.185156+0000","last_became_peered":"2024-05-04T00:31:19.185156+0000","last_unstale":"2024-05-04T00:31:26.334811+0000","last_undegraded":"2024-05-04T00:31:26.334811+0000","last_fullsized":"2024-05-04T00:31:26.334811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:40.266177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.332539+0000","last_change":"2024-05-04T00:31:21.397596+0000","last_active":"2024-05-04T00:31:26.332539+0000","last_peered":"2024-05-04T00:31:26.332539+0000","last_clean":"2024-05-04T00:31:26.332539+0000","last_became_active":"2024-05-04T00:31:21.396023+0000","last_became_peered":"2024-05-04T00:31:21.396023+0000","last_unstale":"2024-05-04T00:31:26.332539+0000","last_undegraded":"2024-05-04T00:31:26.332539+0000","last_fullsized":"2024-05-04T00:31:26.332539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:02:02.166274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.218942+0000","last_change":"2024-05-04T00:31:19.189413+0000","last_active":"2024-05-04T00:31:35.218942+0000","last_peered":"2024-05-04T00:31:35.218942+0000","last_clean":"2024-05-04T00:31:35.218942+0000","last_became_active":"2024-05-04T00:31:19.188359+0000","last_became_peered":"2024-05-04T00:31:19.188359+0000","last_unstale":"2024-05-04T00:31:35.218942+0000","last_undegraded":"2024-05-04T00:31:35.218942+0000","last_fullsized":"2024-05-04T00:31:35.218942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:16:43.456248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336512+0000","last_change":"2024-05-04T00:31:21.417364+0000","last_active":"2024-05-04T00:31:26.336512+0000","last_peered":"2024-05-04T00:31:26.336512+0000","last_clean":"2024-05-04T00:31:26.336512+0000","last_became_active":"2024-05-04T00:31:21.416267+0000","last_became_peered":"2024-05-04T00:31:21.416267+0000","last_unstale":"2024-05-04T00:31:26.336512+0000","last_undegraded":"2024-05-04T00:31:26.336512+0000","last_fullsized":"2024-05-04T00:31:26.336512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:42:31.303120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336815+0000","last_change":"2024-05-04T00:31:19.187081+0000","last_active":"2024-05-04T00:31:26.336815+0000","last_peered":"2024-05-04T00:31:26.336815+0000","last_clean":"2024-05-04T00:31:26.336815+0000","last_became_active":"2024-05-04T00:31:19.186483+0000","last_became_peered":"2024-05-04T00:31:19.186483+0000","last_unstale":"2024-05-04T00:31:26.336815+0000","last_undegraded":"2024-05-04T00:31:26.336815+0000","last_fullsized":"2024-05-04T00:31:26.336815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:07.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336315+0000","last_change":"2024-05-04T00:31:21.414034+0000","last_active":"2024-05-04T00:31:26.336315+0000","last_peered":"2024-05-04T00:31:26.336315+0000","last_clean":"2024-05-04T00:31:26.336315+0000","last_became_active":"2024-05-04T00:31:21.413330+0000","last_became_peered":"2024-05-04T00:31:21.413330+0000","last_unstale":"2024-05-04T00:31:26.336315+0000","last_undegraded":"2024-05-04T00:31:26.336315+0000","last_fullsized":"2024-05-04T00:31:26.336315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:07.135906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"26'9","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.210221+0000","last_change":"2024-05-04T00:31:19.175936+0000","last_active":"2024-05-04T00:31:35.210221+0000","last_peered":"2024-05-04T00:31:35.210221+0000","last_clean":"2024-05-04T00:31:35.210221+0000","last_became_active":"2024-05-04T00:31:19.175356+0000","last_became_peered":"2024-05-04T00:31:19.175356+0000","last_unstale":"2024-05-04T00:31:35.210221+0000","last_undegraded":"2024-05-04T00:31:35.210221+0000","last_fullsized":"2024-05-04T00:31:35.210221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:33.026019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5222,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":10444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":100887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":102863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":101329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":872448,"data_stored":690211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":100999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":100591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":884736,"data_stored":690855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":100909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T00:31:45.567 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T00:31:45.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.757+0000 7f4902d5f640 1 Processor -- start 2024-05-04T00:31:45.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.757+0000 7f4902d5f640 1 -- start start 2024-05-04T00:31:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.757+0000 7f4902d5f640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f48fc0c4890 0x7f48fc1541a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.757+0000 7f4902d5f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48fc06f860 0x7f48fc06fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.757+0000 7f4902d5f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48fc15aac0 con 0x7f48fc0709d0 2024-05-04T00:31:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.757+0000 7f4902d5f640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f48fc0c81e0 con 0x7f48fc0c4890 2024-05-04T00:31:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.757+0000 7f4902d5f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f48fc0c7b90 con 0x7f48fc06f860 2024-05-04T00:31:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.761+0000 7f48fbfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f48fc0709d0 0x7f48fc0c8670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39608/0 (socket says 172.21.15.6:39608) 2024-05-04T00:31:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.761+0000 7f48fbfff640 1 -- 172.21.15.6:0/2659551969 learned_addr learned my addr 172.21.15.6:0/2659551969 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.761+0000 7f4900afb640 1 --2- 172.21.15.6:0/2659551969 >> v2:172.21.15.163:3300/0 conn(0x7f48fc0c4890 0x7f48fc1541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.765+0000 7f48fb7fe640 1 -- 172.21.15.6:0/2659551969 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4058220190 0 0) 0x7f48fc15aac0 con 0x7f48fc0709d0 2024-05-04T00:31:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.765+0000 7f48fb7fe640 1 -- 172.21.15.6:0/2659551969 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48e4003530 con 0x7f48fc0709d0 2024-05-04T00:31:45.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.765+0000 7f49012fc640 1 --2- 172.21.15.6:0/2659551969 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48fc06f860 0x7f48fc06fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:45.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.769+0000 7f4900afb640 1 -- 172.21.15.6:0/2659551969 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48fc06f860 msgr2=0x7f48fc06fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:45.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.769+0000 7f4900afb640 1 --2- 172.21.15.6:0/2659551969 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48fc06f860 0x7f48fc06fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:45.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.769+0000 7f4900afb640 1 -- 172.21.15.6:0/2659551969 >> v1:172.21.15.6:6789/0 conn(0x7f48fc0709d0 legacy=0x7f48fc0c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:45.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.769+0000 7f4900afb640 1 -- 172.21.15.6:0/2659551969 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48fc0c7e70 con 0x7f48fc0c4890 2024-05-04T00:31:45.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.777+0000 7f4900afb640 1 --2- 172.21.15.6:0/2659551969 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48fc0c4890 0x7f48fc1541a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48ec0097c0 tx=0x7f48ec01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=538ae6d7ba489ebb server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:45.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.785+0000 7f48fb7fe640 1 -- 172.21.15.6:0/2659551969 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec0b0070 con 0x7f48fc0c4890 2024-05-04T00:31:45.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.785+0000 7f48fb7fe640 1 -- 172.21.15.6:0/2659551969 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ec0ab600 con 0x7f48fc0c4890 2024-05-04T00:31:45.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.785+0000 7f48fb7fe640 1 -- 172.21.15.6:0/2659551969 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec0ab9d0 con 0x7f48fc0c4890 2024-05-04T00:31:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.789+0000 7f4902d5f640 1 -- 172.21.15.6:0/2659551969 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48fc0c4890 msgr2=0x7f48fc1541a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.789+0000 7f4902d5f640 1 --2- 172.21.15.6:0/2659551969 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48fc0c4890 0x7f48fc1541a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48ec0097c0 tx=0x7f48ec01c380 comp rx=0 tx=0).stop 2024-05-04T00:31:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.789+0000 7f4902d5f640 1 -- 172.21.15.6:0/2659551969 shutdown_connections 2024-05-04T00:31:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.789+0000 7f4902d5f640 1 --2- 172.21.15.6:0/2659551969 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48fc06f860 0x7f48fc06fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.789+0000 7f4902d5f640 1 --2- 172.21.15.6:0/2659551969 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48fc0c4890 0x7f48fc1541a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.789+0000 7f4902d5f640 1 -- 172.21.15.6:0/2659551969 >> 172.21.15.6:0/2659551969 conn(0x7f48fc06cf70 msgr2=0x7f48fc0c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.789+0000 7f4902d5f640 1 -- 172.21.15.6:0/2659551969 shutdown_connections 2024-05-04T00:31:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.789+0000 7f4902d5f640 1 -- 172.21.15.6:0/2659551969 wait complete. 2024-05-04T00:31:45.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.789+0000 7f4902d5f640 1 Processor -- start 2024-05-04T00:31:45.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.789+0000 7f4902d5f640 1 -- start start 2024-05-04T00:31:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.793+0000 7f4902d5f640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48fc06f860 0x7f48fc1571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.793+0000 7f4902d5f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48fc0709d0 0x7f48fc1f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.793+0000 7f4902d5f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48fc0c4890 0x7f48fc1437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.793+0000 7f4902d5f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc1671c0 con 0x7f48fc0c4890 2024-05-04T00:31:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.793+0000 7f4902d5f640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc167040 con 0x7f48fc06f860 2024-05-04T00:31:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.793+0000 7f4902d5f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f48fc167340 con 0x7f48fc0709d0 2024-05-04T00:31:45.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.793+0000 7f48fbfff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48fc0709d0 0x7f48fc1f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.793+0000 7f4900afb640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48fc06f860 0x7f48fc1571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.793+0000 7f48fbfff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48fc0709d0 0x7f48fc1f5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:47232/0 (socket says 172.21.15.6:47232) 2024-05-04T00:31:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.793+0000 7f48fbfff640 1 -- 172.21.15.6:0/2451229689 learned_addr learned my addr 172.21.15.6:0/2451229689 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.805+0000 7f48fbfff640 1 -- 172.21.15.6:0/2451229689 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48fc06f860 msgr2=0x7f48fc1571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.805+0000 7f48fbfff640 1 --2- 172.21.15.6:0/2451229689 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48fc06f860 0x7f48fc1571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.805+0000 7f48fbfff640 1 -- 172.21.15.6:0/2451229689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48fc0c4890 msgr2=0x7f48fc1437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.805+0000 7f48fbfff640 1 --2- 172.21.15.6:0/2451229689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48fc0c4890 0x7f48fc1437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.805+0000 7f48fbfff640 1 -- 172.21.15.6:0/2451229689 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48fc1f6100 con 0x7f48fc0709d0 2024-05-04T00:31:45.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.813+0000 7f48fbfff640 1 --2- 172.21.15.6:0/2451229689 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48fc0709d0 0x7f48fc1f5bc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f48f000c400 tx=0x7f48f000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:45.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.821+0000 7f48f97fa640 1 -- 172.21.15.6:0/2451229689 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f0017070 con 0x7f48fc0709d0 2024-05-04T00:31:45.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.821+0000 7f48f97fa640 1 -- 172.21.15.6:0/2451229689 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f0005cf0 con 0x7f48fc0709d0 2024-05-04T00:31:45.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.821+0000 7f48f97fa640 1 -- 172.21.15.6:0/2451229689 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f00072f0 con 0x7f48fc0709d0 2024-05-04T00:31:45.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.821+0000 7f4902d5f640 1 -- 172.21.15.6:0/2451229689 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48fc1645b0 con 0x7f48fc0709d0 2024-05-04T00:31:45.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.821+0000 7f4902d5f640 1 -- 172.21.15.6:0/2451229689 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f48fc073df0 con 0x7f48fc0709d0 2024-05-04T00:31:45.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:45.825+0000 7f4902d5f640 1 -- 172.21.15.6:0/2451229689 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48fc0c4250 con 0x7f48fc0709d0 2024-05-04T00:31:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.189+0000 7f48f97fa640 1 -- 172.21.15.6:0/2451229689 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f48f001a070 con 0x7f48fc0709d0 2024-05-04T00:31:46.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.189+0000 7f48f97fa640 1 --2- 172.21.15.6:0/2451229689 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f48e806f450 0x7f48e8071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:46.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.189+0000 7f4900afb640 1 --2- 172.21.15.6:0/2451229689 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f48e806f450 0x7f48e8071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:46.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.189+0000 7f4900afb640 1 --2- 172.21.15.6:0/2451229689 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f48e806f450 0x7f48e8071960 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f48ec0ad000 tx=0x7f48ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:46.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.261+0000 7f48f97fa640 1 -- 172.21.15.6:0/2451229689 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f48f0057550 con 0x7f48fc0709d0 2024-05-04T00:31:46.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.301+0000 7f48f97fa640 1 -- 172.21.15.6:0/2451229689 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f48f0021020 con 0x7f48fc0709d0 2024-05-04T00:31:46.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.477+0000 7f4902d5f640 1 -- 172.21.15.6:0/2451229689 --> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f48fc1576f0 con 0x7f48e806f450 2024-05-04T00:31:46.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.497+0000 7f48f97fa640 1 -- 172.21.15.6:0/2451229689 <== mgr.4103 v2:172.21.15.163:6800/2152694980 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251886 (secure 0 0 0) 0x7f48fc1576f0 con 0x7f48e806f450 2024-05-04T00:31:46.500 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:31:46.502 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-04T00:31:46.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.501+0000 7f4902d5f640 1 -- 172.21.15.6:0/2451229689 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f48e806f450 msgr2=0x7f48e8071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:46.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.501+0000 7f4902d5f640 1 --2- 172.21.15.6:0/2451229689 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f48e806f450 0x7f48e8071960 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f48ec0ad000 tx=0x7f48ec008040 comp rx=0 tx=0).stop 2024-05-04T00:31:46.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.501+0000 7f4902d5f640 1 -- 172.21.15.6:0/2451229689 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48fc0709d0 msgr2=0x7f48fc1f5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:46.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.501+0000 7f4902d5f640 1 --2- 172.21.15.6:0/2451229689 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48fc0709d0 0x7f48fc1f5bc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f48f000c400 tx=0x7f48f000c8c0 comp rx=0 tx=0).stop 2024-05-04T00:31:46.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.501+0000 7f4902d5f640 1 -- 172.21.15.6:0/2451229689 shutdown_connections 2024-05-04T00:31:46.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.501+0000 7f4902d5f640 1 --2- 172.21.15.6:0/2451229689 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f48e806f450 0x7f48e8071960 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:46.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.501+0000 7f4902d5f640 1 --2- 172.21.15.6:0/2451229689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48fc0c4890 0x7f48fc1437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:46.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.501+0000 7f4902d5f640 1 --2- 172.21.15.6:0/2451229689 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48fc0709d0 0x7f48fc1f5bc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:46.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.501+0000 7f4902d5f640 1 --2- 172.21.15.6:0/2451229689 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48fc06f860 0x7f48fc1571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:46.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.501+0000 7f4902d5f640 1 -- 172.21.15.6:0/2451229689 >> 172.21.15.6:0/2451229689 conn(0x7f48fc06cf70 msgr2=0x7f48fc1533d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:46.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.501+0000 7f4902d5f640 1 -- 172.21.15.6:0/2451229689 shutdown_connections 2024-05-04T00:31:46.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.501+0000 7f4902d5f640 1 -- 172.21.15.6:0/2451229689 wait complete. 2024-05-04T00:31:46.523 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-05-04T00:31:45.566232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595590,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":226,"num_write_kb":1666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":181,"ondisk_log_size":181,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3514368,"data_stored":1988644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2632,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004686"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334539+0000","last_change":"2024-05-04T00:31:21.410516+0000","last_active":"2024-05-04T00:31:26.334539+0000","last_peered":"2024-05-04T00:31:26.334539+0000","last_clean":"2024-05-04T00:31:26.334539+0000","last_became_active":"2024-05-04T00:31:21.409386+0000","last_became_peered":"2024-05-04T00:31:21.409386+0000","last_unstale":"2024-05-04T00:31:26.334539+0000","last_undegraded":"2024-05-04T00:31:26.334539+0000","last_fullsized":"2024-05-04T00:31:26.334539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:09:40.562107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336298+0000","last_change":"2024-05-04T00:31:21.397440+0000","last_active":"2024-05-04T00:31:26.336298+0000","last_peered":"2024-05-04T00:31:26.336298+0000","last_clean":"2024-05-04T00:31:26.336298+0000","last_became_active":"2024-05-04T00:31:21.396255+0000","last_became_peered":"2024-05-04T00:31:21.396255+0000","last_unstale":"2024-05-04T00:31:26.336298+0000","last_undegraded":"2024-05-04T00:31:26.336298+0000","last_fullsized":"2024-05-04T00:31:26.336298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:07.460897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336101+0000","last_change":"2024-05-04T00:31:21.442932+0000","last_active":"2024-05-04T00:31:26.336101+0000","last_peered":"2024-05-04T00:31:26.336101+0000","last_clean":"2024-05-04T00:31:26.336101+0000","last_became_active":"2024-05-04T00:31:21.442507+0000","last_became_peered":"2024-05-04T00:31:21.442507+0000","last_unstale":"2024-05-04T00:31:26.336101+0000","last_undegraded":"2024-05-04T00:31:26.336101+0000","last_fullsized":"2024-05-04T00:31:26.336101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:52:48.345813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333683+0000","last_change":"2024-05-04T00:31:21.442087+0000","last_active":"2024-05-04T00:31:26.333683+0000","last_peered":"2024-05-04T00:31:26.333683+0000","last_clean":"2024-05-04T00:31:26.333683+0000","last_became_active":"2024-05-04T00:31:21.440935+0000","last_became_peered":"2024-05-04T00:31:21.440935+0000","last_unstale":"2024-05-04T00:31:26.333683+0000","last_undegraded":"2024-05-04T00:31:26.333683+0000","last_fullsized":"2024-05-04T00:31:26.333683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:02:02.166274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334582+0000","last_change":"2024-05-04T00:31:21.408892+0000","last_active":"2024-05-04T00:31:26.334582+0000","last_peered":"2024-05-04T00:31:26.334582+0000","last_clean":"2024-05-04T00:31:26.334582+0000","last_became_active":"2024-05-04T00:31:21.402554+0000","last_became_peered":"2024-05-04T00:31:21.402554+0000","last_unstale":"2024-05-04T00:31:26.334582+0000","last_undegraded":"2024-05-04T00:31:26.334582+0000","last_fullsized":"2024-05-04T00:31:26.334582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:07.135906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333117+0000","last_change":"2024-05-04T00:31:21.442773+0000","last_active":"2024-05-04T00:31:26.333117+0000","last_peered":"2024-05-04T00:31:26.333117+0000","last_clean":"2024-05-04T00:31:26.333117+0000","last_became_active":"2024-05-04T00:31:21.441082+0000","last_became_peered":"2024-05-04T00:31:21.441082+0000","last_unstale":"2024-05-04T00:31:26.333117+0000","last_undegraded":"2024-05-04T00:31:26.333117+0000","last_fullsized":"2024-05-04T00:31:26.333117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:54.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333801+0000","last_change":"2024-05-04T00:31:21.441617+0000","last_active":"2024-05-04T00:31:26.333801+0000","last_peered":"2024-05-04T00:31:26.333801+0000","last_clean":"2024-05-04T00:31:26.333801+0000","last_became_active":"2024-05-04T00:31:21.440766+0000","last_became_peered":"2024-05-04T00:31:21.440766+0000","last_unstale":"2024-05-04T00:31:26.333801+0000","last_undegraded":"2024-05-04T00:31:26.333801+0000","last_fullsized":"2024-05-04T00:31:26.333801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:28:07.779536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335122+0000","last_change":"2024-05-04T00:31:21.408515+0000","last_active":"2024-05-04T00:31:26.335122+0000","last_peered":"2024-05-04T00:31:26.335122+0000","last_clean":"2024-05-04T00:31:26.335122+0000","last_became_active":"2024-05-04T00:31:21.407785+0000","last_became_peered":"2024-05-04T00:31:21.407785+0000","last_unstale":"2024-05-04T00:31:26.335122+0000","last_undegraded":"2024-05-04T00:31:26.335122+0000","last_fullsized":"2024-05-04T00:31:26.335122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:42.617159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333247+0000","last_change":"2024-05-04T00:31:21.400836+0000","last_active":"2024-05-04T00:31:26.333247+0000","last_peered":"2024-05-04T00:31:26.333247+0000","last_clean":"2024-05-04T00:31:26.333247+0000","last_became_active":"2024-05-04T00:31:21.400001+0000","last_became_peered":"2024-05-04T00:31:21.400001+0000","last_unstale":"2024-05-04T00:31:26.333247+0000","last_undegraded":"2024-05-04T00:31:26.333247+0000","last_fullsized":"2024-05-04T00:31:26.333247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:56.687510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334788+0000","last_change":"2024-05-04T00:31:21.391806+0000","last_active":"2024-05-04T00:31:26.334788+0000","last_peered":"2024-05-04T00:31:26.334788+0000","last_clean":"2024-05-04T00:31:26.334788+0000","last_became_active":"2024-05-04T00:31:21.389347+0000","last_became_peered":"2024-05-04T00:31:21.389347+0000","last_unstale":"2024-05-04T00:31:26.334788+0000","last_undegraded":"2024-05-04T00:31:26.334788+0000","last_fullsized":"2024-05-04T00:31:26.334788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:40:12.379274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334569+0000","last_change":"2024-05-04T00:31:21.396045+0000","last_active":"2024-05-04T00:31:26.334569+0000","last_peered":"2024-05-04T00:31:26.334569+0000","last_clean":"2024-05-04T00:31:26.334569+0000","last_became_active":"2024-05-04T00:31:21.385949+0000","last_became_peered":"2024-05-04T00:31:21.385949+0000","last_unstale":"2024-05-04T00:31:26.334569+0000","last_undegraded":"2024-05-04T00:31:26.334569+0000","last_fullsized":"2024-05-04T00:31:26.334569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:33.187636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334211+0000","last_change":"2024-05-04T00:31:21.407987+0000","last_active":"2024-05-04T00:31:26.334211+0000","last_peered":"2024-05-04T00:31:26.334211+0000","last_clean":"2024-05-04T00:31:26.334211+0000","last_became_active":"2024-05-04T00:31:21.404557+0000","last_became_peered":"2024-05-04T00:31:21.404557+0000","last_unstale":"2024-05-04T00:31:26.334211+0000","last_undegraded":"2024-05-04T00:31:26.334211+0000","last_fullsized":"2024-05-04T00:31:26.334211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:00:51.313452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049847+0000","last_change":"2024-05-04T00:31:21.389251+0000","last_active":"2024-05-04T00:31:26.049847+0000","last_peered":"2024-05-04T00:31:26.049847+0000","last_clean":"2024-05-04T00:31:26.049847+0000","last_became_active":"2024-05-04T00:31:21.387958+0000","last_became_peered":"2024-05-04T00:31:21.387958+0000","last_unstale":"2024-05-04T00:31:26.049847+0000","last_undegraded":"2024-05-04T00:31:26.049847+0000","last_fullsized":"2024-05-04T00:31:26.049847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:31.926158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049567+0000","last_change":"2024-05-04T00:31:21.402284+0000","last_active":"2024-05-04T00:31:26.049567+0000","last_peered":"2024-05-04T00:31:26.049567+0000","last_clean":"2024-05-04T00:31:26.049567+0000","last_became_active":"2024-05-04T00:31:21.401495+0000","last_became_peered":"2024-05-04T00:31:21.401495+0000","last_unstale":"2024-05-04T00:31:26.049567+0000","last_undegraded":"2024-05-04T00:31:26.049567+0000","last_fullsized":"2024-05-04T00:31:26.049567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:09.622538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335160+0000","last_change":"2024-05-04T00:31:21.410958+0000","last_active":"2024-05-04T00:31:26.335160+0000","last_peered":"2024-05-04T00:31:26.335160+0000","last_clean":"2024-05-04T00:31:26.335160+0000","last_became_active":"2024-05-04T00:31:21.410489+0000","last_became_peered":"2024-05-04T00:31:21.410489+0000","last_unstale":"2024-05-04T00:31:26.335160+0000","last_undegraded":"2024-05-04T00:31:26.335160+0000","last_fullsized":"2024-05-04T00:31:26.335160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:05:47.448392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977378+0000","last_change":"2024-05-04T00:31:21.187055+0000","last_active":"2024-05-04T00:31:25.977378+0000","last_peered":"2024-05-04T00:31:25.977378+0000","last_clean":"2024-05-04T00:31:25.977378+0000","last_became_active":"2024-05-04T00:31:21.186141+0000","last_became_peered":"2024-05-04T00:31:21.186141+0000","last_unstale":"2024-05-04T00:31:25.977378+0000","last_undegraded":"2024-05-04T00:31:25.977378+0000","last_fullsized":"2024-05-04T00:31:25.977378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:53:13.451818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978989+0000","last_change":"2024-05-04T00:31:21.406402+0000","last_active":"2024-05-04T00:31:25.978989+0000","last_peered":"2024-05-04T00:31:25.978989+0000","last_clean":"2024-05-04T00:31:25.978989+0000","last_became_active":"2024-05-04T00:31:21.389108+0000","last_became_peered":"2024-05-04T00:31:21.389108+0000","last_unstale":"2024-05-04T00:31:25.978989+0000","last_undegraded":"2024-05-04T00:31:25.978989+0000","last_fullsized":"2024-05-04T00:31:25.978989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:11:03.598993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334910+0000","last_change":"2024-05-04T00:31:21.418601+0000","last_active":"2024-05-04T00:31:26.334910+0000","last_peered":"2024-05-04T00:31:26.334910+0000","last_clean":"2024-05-04T00:31:26.334910+0000","last_became_active":"2024-05-04T00:31:21.417914+0000","last_became_peered":"2024-05-04T00:31:21.417914+0000","last_unstale":"2024-05-04T00:31:26.334910+0000","last_undegraded":"2024-05-04T00:31:26.334910+0000","last_fullsized":"2024-05-04T00:31:26.334910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:23:35.270037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978633+0000","last_change":"2024-05-04T00:31:21.441868+0000","last_active":"2024-05-04T00:31:25.978633+0000","last_peered":"2024-05-04T00:31:25.978633+0000","last_clean":"2024-05-04T00:31:25.978633+0000","last_became_active":"2024-05-04T00:31:21.440945+0000","last_became_peered":"2024-05-04T00:31:21.440945+0000","last_unstale":"2024-05-04T00:31:25.978633+0000","last_undegraded":"2024-05-04T00:31:25.978633+0000","last_fullsized":"2024-05-04T00:31:25.978633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:47:43.629512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334519+0000","last_change":"2024-05-04T00:31:21.395356+0000","last_active":"2024-05-04T00:31:26.334519+0000","last_peered":"2024-05-04T00:31:26.334519+0000","last_clean":"2024-05-04T00:31:26.334519+0000","last_became_active":"2024-05-04T00:31:21.394461+0000","last_became_peered":"2024-05-04T00:31:21.394461+0000","last_unstale":"2024-05-04T00:31:26.334519+0000","last_undegraded":"2024-05-04T00:31:26.334519+0000","last_fullsized":"2024-05-04T00:31:26.334519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:42:31.303120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088316+0000","last_change":"2024-05-04T00:31:21.446878+0000","last_active":"2024-05-04T00:31:26.088316+0000","last_peered":"2024-05-04T00:31:26.088316+0000","last_clean":"2024-05-04T00:31:26.088316+0000","last_became_active":"2024-05-04T00:31:21.446250+0000","last_became_peered":"2024-05-04T00:31:21.446250+0000","last_unstale":"2024-05-04T00:31:26.088316+0000","last_undegraded":"2024-05-04T00:31:26.088316+0000","last_fullsized":"2024-05-04T00:31:26.088316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:42.617159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333229+0000","last_change":"2024-05-04T00:31:21.414182+0000","last_active":"2024-05-04T00:31:26.333229+0000","last_peered":"2024-05-04T00:31:26.333229+0000","last_clean":"2024-05-04T00:31:26.333229+0000","last_became_active":"2024-05-04T00:31:21.413073+0000","last_became_peered":"2024-05-04T00:31:21.413073+0000","last_unstale":"2024-05-04T00:31:26.333229+0000","last_undegraded":"2024-05-04T00:31:26.333229+0000","last_fullsized":"2024-05-04T00:31:26.333229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:23.471892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335510+0000","last_change":"2024-05-04T00:31:21.403827+0000","last_active":"2024-05-04T00:31:26.335510+0000","last_peered":"2024-05-04T00:31:26.335510+0000","last_clean":"2024-05-04T00:31:26.335510+0000","last_became_active":"2024-05-04T00:31:21.402985+0000","last_became_peered":"2024-05-04T00:31:21.402985+0000","last_unstale":"2024-05-04T00:31:26.335510+0000","last_undegraded":"2024-05-04T00:31:26.335510+0000","last_fullsized":"2024-05-04T00:31:26.335510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:43:15.203235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977429+0000","last_change":"2024-05-04T00:31:21.393270+0000","last_active":"2024-05-04T00:31:25.977429+0000","last_peered":"2024-05-04T00:31:25.977429+0000","last_clean":"2024-05-04T00:31:25.977429+0000","last_became_active":"2024-05-04T00:31:21.392368+0000","last_became_peered":"2024-05-04T00:31:21.392368+0000","last_unstale":"2024-05-04T00:31:25.977429+0000","last_undegraded":"2024-05-04T00:31:25.977429+0000","last_fullsized":"2024-05-04T00:31:25.977429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:49:22.354637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336437+0000","last_change":"2024-05-04T00:31:21.416800+0000","last_active":"2024-05-04T00:31:26.336437+0000","last_peered":"2024-05-04T00:31:26.336437+0000","last_clean":"2024-05-04T00:31:26.336437+0000","last_became_active":"2024-05-04T00:31:21.415540+0000","last_became_peered":"2024-05-04T00:31:21.415540+0000","last_unstale":"2024-05-04T00:31:26.336437+0000","last_undegraded":"2024-05-04T00:31:26.336437+0000","last_fullsized":"2024-05-04T00:31:26.336437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:00:51.313452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335047+0000","last_change":"2024-05-04T00:31:21.188504+0000","last_active":"2024-05-04T00:31:26.335047+0000","last_peered":"2024-05-04T00:31:26.335047+0000","last_clean":"2024-05-04T00:31:26.335047+0000","last_became_active":"2024-05-04T00:31:21.187877+0000","last_became_peered":"2024-05-04T00:31:21.187877+0000","last_unstale":"2024-05-04T00:31:26.335047+0000","last_undegraded":"2024-05-04T00:31:26.335047+0000","last_fullsized":"2024-05-04T00:31:26.335047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:48:39.671984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.050292+0000","last_change":"2024-05-04T00:31:21.393500+0000","last_active":"2024-05-04T00:31:26.050292+0000","last_peered":"2024-05-04T00:31:26.050292+0000","last_clean":"2024-05-04T00:31:26.050292+0000","last_became_active":"2024-05-04T00:31:21.392579+0000","last_became_peered":"2024-05-04T00:31:21.392579+0000","last_unstale":"2024-05-04T00:31:26.050292+0000","last_undegraded":"2024-05-04T00:31:26.050292+0000","last_fullsized":"2024-05-04T00:31:26.050292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:16.804136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049793+0000","last_change":"2024-05-04T00:31:21.395778+0000","last_active":"2024-05-04T00:31:26.049793+0000","last_peered":"2024-05-04T00:31:26.049793+0000","last_clean":"2024-05-04T00:31:26.049793+0000","last_became_active":"2024-05-04T00:31:21.394966+0000","last_became_peered":"2024-05-04T00:31:21.394966+0000","last_unstale":"2024-05-04T00:31:26.049793+0000","last_undegraded":"2024-05-04T00:31:26.049793+0000","last_fullsized":"2024-05-04T00:31:26.049793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:53:28.166224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335626+0000","last_change":"2024-05-04T00:31:21.405250+0000","last_active":"2024-05-04T00:31:26.335626+0000","last_peered":"2024-05-04T00:31:26.335626+0000","last_clean":"2024-05-04T00:31:26.335626+0000","last_became_active":"2024-05-04T00:31:21.403779+0000","last_became_peered":"2024-05-04T00:31:21.403779+0000","last_unstale":"2024-05-04T00:31:26.335626+0000","last_undegraded":"2024-05-04T00:31:26.335626+0000","last_fullsized":"2024-05-04T00:31:26.335626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:33.187636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977754+0000","last_change":"2024-05-04T00:31:21.399896+0000","last_active":"2024-05-04T00:31:25.977754+0000","last_peered":"2024-05-04T00:31:25.977754+0000","last_clean":"2024-05-04T00:31:25.977754+0000","last_became_active":"2024-05-04T00:31:21.398994+0000","last_became_peered":"2024-05-04T00:31:21.398994+0000","last_unstale":"2024-05-04T00:31:25.977754+0000","last_undegraded":"2024-05-04T00:31:25.977754+0000","last_fullsized":"2024-05-04T00:31:25.977754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:32:42.591423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334354+0000","last_change":"2024-05-04T00:31:21.416130+0000","last_active":"2024-05-04T00:31:26.334354+0000","last_peered":"2024-05-04T00:31:26.334354+0000","last_clean":"2024-05-04T00:31:26.334354+0000","last_became_active":"2024-05-04T00:31:21.415395+0000","last_became_peered":"2024-05-04T00:31:21.415395+0000","last_unstale":"2024-05-04T00:31:26.334354+0000","last_undegraded":"2024-05-04T00:31:26.334354+0000","last_fullsized":"2024-05-04T00:31:26.334354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:33:22.819977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.332079+0000","last_change":"2024-05-04T00:31:21.342105+0000","last_active":"2024-05-04T00:31:26.332079+0000","last_peered":"2024-05-04T00:31:26.332079+0000","last_clean":"2024-05-04T00:31:26.332079+0000","last_became_active":"2024-05-04T00:31:21.341333+0000","last_became_peered":"2024-05-04T00:31:21.341333+0000","last_unstale":"2024-05-04T00:31:26.332079+0000","last_undegraded":"2024-05-04T00:31:26.332079+0000","last_fullsized":"2024-05-04T00:31:26.332079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:23.471892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333474+0000","last_change":"2024-05-04T00:31:21.405647+0000","last_active":"2024-05-04T00:31:26.333474+0000","last_peered":"2024-05-04T00:31:26.333474+0000","last_clean":"2024-05-04T00:31:26.333474+0000","last_became_active":"2024-05-04T00:31:21.403998+0000","last_became_peered":"2024-05-04T00:31:21.403998+0000","last_unstale":"2024-05-04T00:31:26.333474+0000","last_undegraded":"2024-05-04T00:31:26.333474+0000","last_fullsized":"2024-05-04T00:31:26.333474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:54.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.681469+0000","last_change":"2024-05-04T00:31:19.185018+0000","last_active":"2024-05-04T00:31:31.681469+0000","last_peered":"2024-05-04T00:31:31.681469+0000","last_clean":"2024-05-04T00:31:31.681469+0000","last_became_active":"2024-05-04T00:31:19.181107+0000","last_became_peered":"2024-05-04T00:31:19.181107+0000","last_unstale":"2024-05-04T00:31:31.681469+0000","last_undegraded":"2024-05-04T00:31:31.681469+0000","last_fullsized":"2024-05-04T00:31:31.681469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:14.453153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088596+0000","last_change":"2024-05-04T00:31:21.446209+0000","last_active":"2024-05-04T00:31:26.088596+0000","last_peered":"2024-05-04T00:31:26.088596+0000","last_clean":"2024-05-04T00:31:26.088596+0000","last_became_active":"2024-05-04T00:31:21.445793+0000","last_became_peered":"2024-05-04T00:31:21.445793+0000","last_unstale":"2024-05-04T00:31:26.088596+0000","last_undegraded":"2024-05-04T00:31:26.088596+0000","last_fullsized":"2024-05-04T00:31:26.088596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:54:48.084884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.417524+0000","last_change":"2024-05-04T00:31:19.185102+0000","last_active":"2024-05-04T00:31:35.417524+0000","last_peered":"2024-05-04T00:31:35.417524+0000","last_clean":"2024-05-04T00:31:35.417524+0000","last_became_active":"2024-05-04T00:31:19.183394+0000","last_became_peered":"2024-05-04T00:31:19.183394+0000","last_unstale":"2024-05-04T00:31:35.417524+0000","last_undegraded":"2024-05-04T00:31:35.417524+0000","last_fullsized":"2024-05-04T00:31:35.417524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:36:38.420366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.401984+0000","last_change":"2024-05-04T00:31:19.158945+0000","last_active":"2024-05-04T00:31:35.401984+0000","last_peered":"2024-05-04T00:31:35.401984+0000","last_clean":"2024-05-04T00:31:35.401984+0000","last_became_active":"2024-05-04T00:31:19.158152+0000","last_became_peered":"2024-05-04T00:31:19.158152+0000","last_unstale":"2024-05-04T00:31:35.401984+0000","last_undegraded":"2024-05-04T00:31:35.401984+0000","last_fullsized":"2024-05-04T00:31:35.401984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:52.040804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335758+0000","last_change":"2024-05-04T00:31:21.397183+0000","last_active":"2024-05-04T00:31:26.335758+0000","last_peered":"2024-05-04T00:31:26.335758+0000","last_clean":"2024-05-04T00:31:26.335758+0000","last_became_active":"2024-05-04T00:31:21.393014+0000","last_became_peered":"2024-05-04T00:31:21.393014+0000","last_unstale":"2024-05-04T00:31:26.335758+0000","last_undegraded":"2024-05-04T00:31:26.335758+0000","last_fullsized":"2024-05-04T00:31:26.335758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:40:12.379274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977589+0000","last_change":"2024-05-04T00:31:19.186007+0000","last_active":"2024-05-04T00:31:25.977589+0000","last_peered":"2024-05-04T00:31:25.977589+0000","last_clean":"2024-05-04T00:31:25.977589+0000","last_became_active":"2024-05-04T00:31:19.184526+0000","last_became_peered":"2024-05-04T00:31:19.184526+0000","last_unstale":"2024-05-04T00:31:25.977589+0000","last_undegraded":"2024-05-04T00:31:25.977589+0000","last_fullsized":"2024-05-04T00:31:25.977589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:01:33.042606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088155+0000","last_change":"2024-05-04T00:31:21.447258+0000","last_active":"2024-05-04T00:31:26.088155+0000","last_peered":"2024-05-04T00:31:26.088155+0000","last_clean":"2024-05-04T00:31:26.088155+0000","last_became_active":"2024-05-04T00:31:21.446842+0000","last_became_peered":"2024-05-04T00:31:21.446842+0000","last_unstale":"2024-05-04T00:31:26.088155+0000","last_undegraded":"2024-05-04T00:31:26.088155+0000","last_fullsized":"2024-05-04T00:31:26.088155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:10:57.675700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.719730+0000","last_change":"2024-05-04T00:31:19.190422+0000","last_active":"2024-05-04T00:31:31.719730+0000","last_peered":"2024-05-04T00:31:31.719730+0000","last_clean":"2024-05-04T00:31:31.719730+0000","last_became_active":"2024-05-04T00:31:19.189517+0000","last_became_peered":"2024-05-04T00:31:19.189517+0000","last_unstale":"2024-05-04T00:31:31.719730+0000","last_undegraded":"2024-05-04T00:31:31.719730+0000","last_fullsized":"2024-05-04T00:31:31.719730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:16:41.367677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334482+0000","last_change":"2024-05-04T00:31:21.184586+0000","last_active":"2024-05-04T00:31:26.334482+0000","last_peered":"2024-05-04T00:31:26.334482+0000","last_clean":"2024-05-04T00:31:26.334482+0000","last_became_active":"2024-05-04T00:31:21.183698+0000","last_became_peered":"2024-05-04T00:31:21.183698+0000","last_unstale":"2024-05-04T00:31:26.334482+0000","last_undegraded":"2024-05-04T00:31:26.334482+0000","last_fullsized":"2024-05-04T00:31:26.334482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:47:25.699731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.679301+0000","last_change":"2024-05-04T00:31:19.186623+0000","last_active":"2024-05-04T00:31:31.679301+0000","last_peered":"2024-05-04T00:31:31.679301+0000","last_clean":"2024-05-04T00:31:31.679301+0000","last_became_active":"2024-05-04T00:31:19.185633+0000","last_became_peered":"2024-05-04T00:31:19.185633+0000","last_unstale":"2024-05-04T00:31:31.679301+0000","last_undegraded":"2024-05-04T00:31:31.679301+0000","last_fullsized":"2024-05-04T00:31:31.679301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:10:55.324717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336711+0000","last_change":"2024-05-04T00:31:21.410329+0000","last_active":"2024-05-04T00:31:26.336711+0000","last_peered":"2024-05-04T00:31:26.336711+0000","last_clean":"2024-05-04T00:31:26.336711+0000","last_became_active":"2024-05-04T00:31:21.409655+0000","last_became_peered":"2024-05-04T00:31:21.409655+0000","last_unstale":"2024-05-04T00:31:26.336711+0000","last_undegraded":"2024-05-04T00:31:26.336711+0000","last_fullsized":"2024-05-04T00:31:26.336711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:09:40.562107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334997+0000","last_change":"2024-05-04T00:31:19.178130+0000","last_active":"2024-05-04T00:31:26.334997+0000","last_peered":"2024-05-04T00:31:26.334997+0000","last_clean":"2024-05-04T00:31:26.334997+0000","last_became_active":"2024-05-04T00:31:19.177283+0000","last_became_peered":"2024-05-04T00:31:19.177283+0000","last_unstale":"2024-05-04T00:31:26.334997+0000","last_undegraded":"2024-05-04T00:31:26.334997+0000","last_fullsized":"2024-05-04T00:31:26.334997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:42:41.790988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978336+0000","last_change":"2024-05-04T00:31:21.187102+0000","last_active":"2024-05-04T00:31:25.978336+0000","last_peered":"2024-05-04T00:31:25.978336+0000","last_clean":"2024-05-04T00:31:25.978336+0000","last_became_active":"2024-05-04T00:31:21.186167+0000","last_became_peered":"2024-05-04T00:31:21.186167+0000","last_unstale":"2024-05-04T00:31:25.978336+0000","last_undegraded":"2024-05-04T00:31:25.978336+0000","last_fullsized":"2024-05-04T00:31:25.978336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:05:04.013367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"26'8","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.701064+0000","last_change":"2024-05-04T00:31:19.251247+0000","last_active":"2024-05-04T00:31:31.701064+0000","last_peered":"2024-05-04T00:31:31.701064+0000","last_clean":"2024-05-04T00:31:31.701064+0000","last_became_active":"2024-05-04T00:31:19.250003+0000","last_became_peered":"2024-05-04T00:31:19.250003+0000","last_unstale":"2024-05-04T00:31:31.701064+0000","last_undegraded":"2024-05-04T00:31:31.701064+0000","last_fullsized":"2024-05-04T00:31:31.701064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:40:06.774090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334818+0000","last_change":"2024-05-04T00:31:21.401432+0000","last_active":"2024-05-04T00:31:26.334818+0000","last_peered":"2024-05-04T00:31:26.334818+0000","last_clean":"2024-05-04T00:31:26.334818+0000","last_became_active":"2024-05-04T00:31:21.397220+0000","last_became_peered":"2024-05-04T00:31:21.397220+0000","last_unstale":"2024-05-04T00:31:26.334818+0000","last_undegraded":"2024-05-04T00:31:26.334818+0000","last_fullsized":"2024-05-04T00:31:26.334818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:07.460897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.308011+0000","last_change":"2024-05-04T00:31:19.183674+0000","last_active":"2024-05-04T00:31:35.308011+0000","last_peered":"2024-05-04T00:31:35.308011+0000","last_clean":"2024-05-04T00:31:35.308011+0000","last_became_active":"2024-05-04T00:31:19.183331+0000","last_became_peered":"2024-05-04T00:31:19.183331+0000","last_unstale":"2024-05-04T00:31:35.308011+0000","last_undegraded":"2024-05-04T00:31:35.308011+0000","last_fullsized":"2024-05-04T00:31:35.308011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:13:52.447627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049560+0000","last_change":"2024-05-04T00:31:21.342578+0000","last_active":"2024-05-04T00:31:26.049560+0000","last_peered":"2024-05-04T00:31:26.049560+0000","last_clean":"2024-05-04T00:31:26.049560+0000","last_became_active":"2024-05-04T00:31:21.342064+0000","last_became_peered":"2024-05-04T00:31:21.342064+0000","last_unstale":"2024-05-04T00:31:26.049560+0000","last_undegraded":"2024-05-04T00:31:26.049560+0000","last_fullsized":"2024-05-04T00:31:26.049560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:35.377002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.655969+0000","last_change":"2024-05-04T00:31:19.184166+0000","last_active":"2024-05-04T00:31:31.655969+0000","last_peered":"2024-05-04T00:31:31.655969+0000","last_clean":"2024-05-04T00:31:31.655969+0000","last_became_active":"2024-05-04T00:31:19.181304+0000","last_became_peered":"2024-05-04T00:31:19.181304+0000","last_unstale":"2024-05-04T00:31:31.655969+0000","last_undegraded":"2024-05-04T00:31:31.655969+0000","last_fullsized":"2024-05-04T00:31:31.655969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:49:04.376111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978217+0000","last_change":"2024-05-04T00:31:21.390252+0000","last_active":"2024-05-04T00:31:25.978217+0000","last_peered":"2024-05-04T00:31:25.978217+0000","last_clean":"2024-05-04T00:31:25.978217+0000","last_became_active":"2024-05-04T00:31:21.389360+0000","last_became_peered":"2024-05-04T00:31:21.389360+0000","last_unstale":"2024-05-04T00:31:25.978217+0000","last_undegraded":"2024-05-04T00:31:25.978217+0000","last_fullsized":"2024-05-04T00:31:25.978217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:45:23.177550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.224290+0000","last_change":"2024-05-04T00:31:19.176756+0000","last_active":"2024-05-04T00:31:35.224290+0000","last_peered":"2024-05-04T00:31:35.224290+0000","last_clean":"2024-05-04T00:31:35.224290+0000","last_became_active":"2024-05-04T00:31:19.175779+0000","last_became_peered":"2024-05-04T00:31:19.175779+0000","last_unstale":"2024-05-04T00:31:35.224290+0000","last_undegraded":"2024-05-04T00:31:35.224290+0000","last_fullsized":"2024-05-04T00:31:35.224290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:14.453153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.332161+0000","last_change":"2024-05-04T00:31:21.397306+0000","last_active":"2024-05-04T00:31:26.332161+0000","last_peered":"2024-05-04T00:31:26.332161+0000","last_clean":"2024-05-04T00:31:26.332161+0000","last_became_active":"2024-05-04T00:31:21.394863+0000","last_became_peered":"2024-05-04T00:31:21.394863+0000","last_unstale":"2024-05-04T00:31:26.332161+0000","last_undegraded":"2024-05-04T00:31:26.332161+0000","last_fullsized":"2024-05-04T00:31:26.332161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:46:38.463068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.210796+0000","last_change":"2024-05-04T00:31:19.177402+0000","last_active":"2024-05-04T00:31:35.210796+0000","last_peered":"2024-05-04T00:31:35.210796+0000","last_clean":"2024-05-04T00:31:35.210796+0000","last_became_active":"2024-05-04T00:31:19.176805+0000","last_became_peered":"2024-05-04T00:31:19.176805+0000","last_unstale":"2024-05-04T00:31:35.210796+0000","last_undegraded":"2024-05-04T00:31:35.210796+0000","last_fullsized":"2024-05-04T00:31:35.210796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:31.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977565+0000","last_change":"2024-05-04T00:31:21.188457+0000","last_active":"2024-05-04T00:31:25.977565+0000","last_peered":"2024-05-04T00:31:25.977565+0000","last_clean":"2024-05-04T00:31:25.977565+0000","last_became_active":"2024-05-04T00:31:21.187554+0000","last_became_peered":"2024-05-04T00:31:21.187554+0000","last_unstale":"2024-05-04T00:31:25.977565+0000","last_undegraded":"2024-05-04T00:31:25.977565+0000","last_fullsized":"2024-05-04T00:31:25.977565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:31:55.671261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335354+0000","last_change":"2024-05-04T00:31:19.176641+0000","last_active":"2024-05-04T00:31:26.335354+0000","last_peered":"2024-05-04T00:31:26.335354+0000","last_clean":"2024-05-04T00:31:26.335354+0000","last_became_active":"2024-05-04T00:31:19.175715+0000","last_became_peered":"2024-05-04T00:31:19.175715+0000","last_unstale":"2024-05-04T00:31:26.335354+0000","last_undegraded":"2024-05-04T00:31:26.335354+0000","last_fullsized":"2024-05-04T00:31:26.335354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:05:45.097410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334791+0000","last_change":"2024-05-04T00:31:21.407554+0000","last_active":"2024-05-04T00:31:26.334791+0000","last_peered":"2024-05-04T00:31:26.334791+0000","last_clean":"2024-05-04T00:31:26.334791+0000","last_became_active":"2024-05-04T00:31:21.403004+0000","last_became_peered":"2024-05-04T00:31:21.403004+0000","last_unstale":"2024-05-04T00:31:26.334791+0000","last_undegraded":"2024-05-04T00:31:26.334791+0000","last_fullsized":"2024-05-04T00:31:26.334791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:33.938895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088847+0000","last_change":"2024-05-04T00:31:19.187116+0000","last_active":"2024-05-04T00:31:26.088847+0000","last_peered":"2024-05-04T00:31:26.088847+0000","last_clean":"2024-05-04T00:31:26.088847+0000","last_became_active":"2024-05-04T00:31:19.186540+0000","last_became_peered":"2024-05-04T00:31:19.186540+0000","last_unstale":"2024-05-04T00:31:26.088847+0000","last_undegraded":"2024-05-04T00:31:26.088847+0000","last_fullsized":"2024-05-04T00:31:26.088847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:08.420067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334905+0000","last_change":"2024-05-04T00:31:21.407986+0000","last_active":"2024-05-04T00:31:26.334905+0000","last_peered":"2024-05-04T00:31:26.334905+0000","last_clean":"2024-05-04T00:31:26.334905+0000","last_became_active":"2024-05-04T00:31:21.404350+0000","last_became_peered":"2024-05-04T00:31:21.404350+0000","last_unstale":"2024-05-04T00:31:26.334905+0000","last_undegraded":"2024-05-04T00:31:26.334905+0000","last_fullsized":"2024-05-04T00:31:26.334905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:12:34.898595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336199+0000","last_change":"2024-05-04T00:31:19.190045+0000","last_active":"2024-05-04T00:31:26.336199+0000","last_peered":"2024-05-04T00:31:26.336199+0000","last_clean":"2024-05-04T00:31:26.336199+0000","last_became_active":"2024-05-04T00:31:19.189166+0000","last_became_peered":"2024-05-04T00:31:19.189166+0000","last_unstale":"2024-05-04T00:31:26.336199+0000","last_undegraded":"2024-05-04T00:31:26.336199+0000","last_fullsized":"2024-05-04T00:31:26.336199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:31.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334803+0000","last_change":"2024-05-04T00:31:21.402171+0000","last_active":"2024-05-04T00:31:26.334803+0000","last_peered":"2024-05-04T00:31:26.334803+0000","last_clean":"2024-05-04T00:31:26.334803+0000","last_became_active":"2024-05-04T00:31:21.401467+0000","last_became_peered":"2024-05-04T00:31:21.401467+0000","last_unstale":"2024-05-04T00:31:26.334803+0000","last_undegraded":"2024-05-04T00:31:26.334803+0000","last_fullsized":"2024-05-04T00:31:26.334803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:34:25.722557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.404498+0000","last_change":"2024-05-04T00:31:19.155210+0000","last_active":"2024-05-04T00:31:35.404498+0000","last_peered":"2024-05-04T00:31:35.404498+0000","last_clean":"2024-05-04T00:31:35.404498+0000","last_became_active":"2024-05-04T00:31:19.154504+0000","last_became_peered":"2024-05-04T00:31:19.154504+0000","last_unstale":"2024-05-04T00:31:35.404498+0000","last_undegraded":"2024-05-04T00:31:35.404498+0000","last_fullsized":"2024-05-04T00:31:35.404498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:47:23.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978511+0000","last_change":"2024-05-04T00:31:21.406273+0000","last_active":"2024-05-04T00:31:25.978511+0000","last_peered":"2024-05-04T00:31:25.978511+0000","last_clean":"2024-05-04T00:31:25.978511+0000","last_became_active":"2024-05-04T00:31:21.405283+0000","last_became_peered":"2024-05-04T00:31:21.405283+0000","last_unstale":"2024-05-04T00:31:25.978511+0000","last_undegraded":"2024-05-04T00:31:25.978511+0000","last_fullsized":"2024-05-04T00:31:25.978511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:20:31.795673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":117,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.332489+0000","last_change":"2024-05-04T00:30:40.841283+0000","last_active":"2024-05-04T00:31:26.332489+0000","last_peered":"2024-05-04T00:31:26.332489+0000","last_clean":"2024-05-04T00:31:26.332489+0000","last_became_active":"2024-05-04T00:30:40.838353+0000","last_became_peered":"2024-05-04T00:30:40.838353+0000","last_unstale":"2024-05-04T00:31:26.332489+0000","last_undegraded":"2024-05-04T00:31:26.332489+0000","last_fullsized":"2024-05-04T00:31:26.332489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:30:37.159356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:30:37.159356+0000","last_clean_scrub_stamp":"2024-05-04T00:30:37.159356+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:30:10.374994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.656668+0000","last_change":"2024-05-04T00:31:19.248691+0000","last_active":"2024-05-04T00:31:31.656668+0000","last_peered":"2024-05-04T00:31:31.656668+0000","last_clean":"2024-05-04T00:31:31.656668+0000","last_became_active":"2024-05-04T00:31:19.247815+0000","last_became_peered":"2024-05-04T00:31:19.247815+0000","last_unstale":"2024-05-04T00:31:31.656668+0000","last_undegraded":"2024-05-04T00:31:31.656668+0000","last_fullsized":"2024-05-04T00:31:31.656668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:46:05.720208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088363+0000","last_change":"2024-05-04T00:31:21.446500+0000","last_active":"2024-05-04T00:31:26.088363+0000","last_peered":"2024-05-04T00:31:26.088363+0000","last_clean":"2024-05-04T00:31:26.088363+0000","last_became_active":"2024-05-04T00:31:21.446100+0000","last_became_peered":"2024-05-04T00:31:21.446100+0000","last_unstale":"2024-05-04T00:31:26.088363+0000","last_undegraded":"2024-05-04T00:31:26.088363+0000","last_fullsized":"2024-05-04T00:31:26.088363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:06.542614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.418363+0000","last_change":"2024-05-04T00:31:19.184044+0000","last_active":"2024-05-04T00:31:35.418363+0000","last_peered":"2024-05-04T00:31:35.418363+0000","last_clean":"2024-05-04T00:31:35.418363+0000","last_became_active":"2024-05-04T00:31:19.181956+0000","last_became_peered":"2024-05-04T00:31:19.181956+0000","last_unstale":"2024-05-04T00:31:35.418363+0000","last_undegraded":"2024-05-04T00:31:35.418363+0000","last_fullsized":"2024-05-04T00:31:35.418363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:09:33.607433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.049528+0000","last_change":"2024-05-04T00:31:21.343953+0000","last_active":"2024-05-04T00:31:26.049528+0000","last_peered":"2024-05-04T00:31:26.049528+0000","last_clean":"2024-05-04T00:31:26.049528+0000","last_became_active":"2024-05-04T00:31:21.343499+0000","last_became_peered":"2024-05-04T00:31:21.343499+0000","last_unstale":"2024-05-04T00:31:26.049528+0000","last_undegraded":"2024-05-04T00:31:26.049528+0000","last_fullsized":"2024-05-04T00:31:26.049528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:33.938895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.311044+0000","last_change":"2024-05-04T00:31:19.184947+0000","last_active":"2024-05-04T00:31:35.311044+0000","last_peered":"2024-05-04T00:31:35.311044+0000","last_clean":"2024-05-04T00:31:35.311044+0000","last_became_active":"2024-05-04T00:31:19.184606+0000","last_became_peered":"2024-05-04T00:31:19.184606+0000","last_unstale":"2024-05-04T00:31:35.311044+0000","last_undegraded":"2024-05-04T00:31:35.311044+0000","last_fullsized":"2024-05-04T00:31:35.311044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:07:49.638230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.335413+0000","last_change":"2024-05-04T00:31:21.402799+0000","last_active":"2024-05-04T00:31:26.335413+0000","last_peered":"2024-05-04T00:31:26.335413+0000","last_clean":"2024-05-04T00:31:26.335413+0000","last_became_active":"2024-05-04T00:31:21.401591+0000","last_became_peered":"2024-05-04T00:31:21.401591+0000","last_unstale":"2024-05-04T00:31:26.335413+0000","last_undegraded":"2024-05-04T00:31:26.335413+0000","last_fullsized":"2024-05-04T00:31:26.335413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:28:07.779536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978310+0000","last_change":"2024-05-04T00:31:19.182214+0000","last_active":"2024-05-04T00:31:25.978310+0000","last_peered":"2024-05-04T00:31:25.978310+0000","last_clean":"2024-05-04T00:31:25.978310+0000","last_became_active":"2024-05-04T00:31:19.180317+0000","last_became_peered":"2024-05-04T00:31:19.180317+0000","last_unstale":"2024-05-04T00:31:25.978310+0000","last_undegraded":"2024-05-04T00:31:25.978310+0000","last_fullsized":"2024-05-04T00:31:25.978310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:44.678316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334340+0000","last_change":"2024-05-04T00:31:21.401965+0000","last_active":"2024-05-04T00:31:26.334340+0000","last_peered":"2024-05-04T00:31:26.334340+0000","last_clean":"2024-05-04T00:31:26.334340+0000","last_became_active":"2024-05-04T00:31:21.389808+0000","last_became_peered":"2024-05-04T00:31:21.389808+0000","last_unstale":"2024-05-04T00:31:26.334340+0000","last_undegraded":"2024-05-04T00:31:26.334340+0000","last_fullsized":"2024-05-04T00:31:26.334340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:52:48.345813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336089+0000","last_change":"2024-05-04T00:31:19.183991+0000","last_active":"2024-05-04T00:31:26.336089+0000","last_peered":"2024-05-04T00:31:26.336089+0000","last_clean":"2024-05-04T00:31:26.336089+0000","last_became_active":"2024-05-04T00:31:19.179785+0000","last_became_peered":"2024-05-04T00:31:19.179785+0000","last_unstale":"2024-05-04T00:31:26.336089+0000","last_undegraded":"2024-05-04T00:31:26.336089+0000","last_fullsized":"2024-05-04T00:31:26.336089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:29.575176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.333549+0000","last_change":"2024-05-04T00:31:21.342687+0000","last_active":"2024-05-04T00:31:26.333549+0000","last_peered":"2024-05-04T00:31:26.333549+0000","last_clean":"2024-05-04T00:31:26.333549+0000","last_became_active":"2024-05-04T00:31:21.341702+0000","last_became_peered":"2024-05-04T00:31:21.341702+0000","last_unstale":"2024-05-04T00:31:26.333549+0000","last_undegraded":"2024-05-04T00:31:26.333549+0000","last_fullsized":"2024-05-04T00:31:26.333549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:56.687510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978903+0000","last_change":"2024-05-04T00:31:19.176663+0000","last_active":"2024-05-04T00:31:25.978903+0000","last_peered":"2024-05-04T00:31:25.978903+0000","last_clean":"2024-05-04T00:31:25.978903+0000","last_became_active":"2024-05-04T00:31:19.175616+0000","last_became_peered":"2024-05-04T00:31:19.175616+0000","last_unstale":"2024-05-04T00:31:25.978903+0000","last_undegraded":"2024-05-04T00:31:25.978903+0000","last_fullsized":"2024-05-04T00:31:25.978903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:24:47.124717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.050096+0000","last_change":"2024-05-04T00:31:21.403129+0000","last_active":"2024-05-04T00:31:26.050096+0000","last_peered":"2024-05-04T00:31:26.050096+0000","last_clean":"2024-05-04T00:31:26.050096+0000","last_became_active":"2024-05-04T00:31:21.402248+0000","last_became_peered":"2024-05-04T00:31:21.402248+0000","last_unstale":"2024-05-04T00:31:26.050096+0000","last_undegraded":"2024-05-04T00:31:26.050096+0000","last_fullsized":"2024-05-04T00:31:26.050096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:10.771050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.202466+0000","last_change":"2024-05-04T00:31:19.155903+0000","last_active":"2024-05-04T00:31:35.202466+0000","last_peered":"2024-05-04T00:31:35.202466+0000","last_clean":"2024-05-04T00:31:35.202466+0000","last_became_active":"2024-05-04T00:31:19.154909+0000","last_became_peered":"2024-05-04T00:31:19.154909+0000","last_unstale":"2024-05-04T00:31:35.202466+0000","last_undegraded":"2024-05-04T00:31:35.202466+0000","last_fullsized":"2024-05-04T00:31:35.202466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:53:25.815241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088979+0000","last_change":"2024-05-04T00:31:21.445396+0000","last_active":"2024-05-04T00:31:26.088979+0000","last_peered":"2024-05-04T00:31:26.088979+0000","last_clean":"2024-05-04T00:31:26.088979+0000","last_became_active":"2024-05-04T00:31:21.444934+0000","last_became_peered":"2024-05-04T00:31:21.444934+0000","last_unstale":"2024-05-04T00:31:26.088979+0000","last_undegraded":"2024-05-04T00:31:26.088979+0000","last_fullsized":"2024-05-04T00:31:26.088979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:23:02.407000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.645726+0000","last_change":"2024-05-04T00:31:19.182946+0000","last_active":"2024-05-04T00:31:31.645726+0000","last_peered":"2024-05-04T00:31:31.645726+0000","last_clean":"2024-05-04T00:31:31.645726+0000","last_became_active":"2024-05-04T00:31:19.182050+0000","last_became_peered":"2024-05-04T00:31:19.182050+0000","last_unstale":"2024-05-04T00:31:31.645726+0000","last_undegraded":"2024-05-04T00:31:31.645726+0000","last_fullsized":"2024-05-04T00:31:31.645726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:55:12.448558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088626+0000","last_change":"2024-05-04T00:31:21.443100+0000","last_active":"2024-05-04T00:31:26.088626+0000","last_peered":"2024-05-04T00:31:26.088626+0000","last_clean":"2024-05-04T00:31:26.088626+0000","last_became_active":"2024-05-04T00:31:21.442602+0000","last_became_peered":"2024-05-04T00:31:21.442602+0000","last_unstale":"2024-05-04T00:31:26.088626+0000","last_undegraded":"2024-05-04T00:31:26.088626+0000","last_fullsized":"2024-05-04T00:31:26.088626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:16:45.807230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.680264+0000","last_change":"2024-05-04T00:31:19.248358+0000","last_active":"2024-05-04T00:31:31.680264+0000","last_peered":"2024-05-04T00:31:31.680264+0000","last_clean":"2024-05-04T00:31:31.680264+0000","last_became_active":"2024-05-04T00:31:19.247822+0000","last_became_peered":"2024-05-04T00:31:19.247822+0000","last_unstale":"2024-05-04T00:31:31.680264+0000","last_undegraded":"2024-05-04T00:31:31.680264+0000","last_fullsized":"2024-05-04T00:31:31.680264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:04.191631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977590+0000","last_change":"2024-05-04T00:31:21.441959+0000","last_active":"2024-05-04T00:31:25.977590+0000","last_peered":"2024-05-04T00:31:25.977590+0000","last_clean":"2024-05-04T00:31:25.977590+0000","last_became_active":"2024-05-04T00:31:21.441015+0000","last_became_peered":"2024-05-04T00:31:21.441015+0000","last_unstale":"2024-05-04T00:31:25.977590+0000","last_undegraded":"2024-05-04T00:31:25.977590+0000","last_fullsized":"2024-05-04T00:31:25.977590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:54:30.187813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.492350+0000","last_change":"2024-05-04T00:31:19.159146+0000","last_active":"2024-05-04T00:31:31.492350+0000","last_peered":"2024-05-04T00:31:31.492350+0000","last_clean":"2024-05-04T00:31:31.492350+0000","last_became_active":"2024-05-04T00:31:19.158366+0000","last_became_peered":"2024-05-04T00:31:19.158366+0000","last_unstale":"2024-05-04T00:31:31.492350+0000","last_undegraded":"2024-05-04T00:31:31.492350+0000","last_fullsized":"2024-05-04T00:31:31.492350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:07.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.088049+0000","last_change":"2024-05-04T00:31:21.441521+0000","last_active":"2024-05-04T00:31:26.088049+0000","last_peered":"2024-05-04T00:31:26.088049+0000","last_clean":"2024-05-04T00:31:26.088049+0000","last_became_active":"2024-05-04T00:31:21.441074+0000","last_became_peered":"2024-05-04T00:31:21.441074+0000","last_unstale":"2024-05-04T00:31:26.088049+0000","last_undegraded":"2024-05-04T00:31:26.088049+0000","last_fullsized":"2024-05-04T00:31:26.088049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:31.926158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.050129+0000","last_change":"2024-05-04T00:31:19.174493+0000","last_active":"2024-05-04T00:31:26.050129+0000","last_peered":"2024-05-04T00:31:26.050129+0000","last_clean":"2024-05-04T00:31:26.050129+0000","last_became_active":"2024-05-04T00:31:19.174113+0000","last_became_peered":"2024-05-04T00:31:19.174113+0000","last_unstale":"2024-05-04T00:31:26.050129+0000","last_undegraded":"2024-05-04T00:31:26.050129+0000","last_fullsized":"2024-05-04T00:31:26.050129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:54.336528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334858+0000","last_change":"2024-05-04T00:31:21.406782+0000","last_active":"2024-05-04T00:31:26.334858+0000","last_peered":"2024-05-04T00:31:26.334858+0000","last_clean":"2024-05-04T00:31:26.334858+0000","last_became_active":"2024-05-04T00:31:21.406008+0000","last_became_peered":"2024-05-04T00:31:21.406008+0000","last_unstale":"2024-05-04T00:31:26.334858+0000","last_undegraded":"2024-05-04T00:31:26.334858+0000","last_fullsized":"2024-05-04T00:31:26.334858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:24:01.565048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:31.645923+0000","last_change":"2024-05-04T00:31:19.248682+0000","last_active":"2024-05-04T00:31:31.645923+0000","last_peered":"2024-05-04T00:31:31.645923+0000","last_clean":"2024-05-04T00:31:31.645923+0000","last_became_active":"2024-05-04T00:31:19.247736+0000","last_became_peered":"2024-05-04T00:31:19.247736+0000","last_unstale":"2024-05-04T00:31:31.645923+0000","last_undegraded":"2024-05-04T00:31:31.645923+0000","last_fullsized":"2024-05-04T00:31:31.645923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:42:59.459764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.977927+0000","last_change":"2024-05-04T00:31:21.401858+0000","last_active":"2024-05-04T00:31:25.977927+0000","last_peered":"2024-05-04T00:31:25.977927+0000","last_clean":"2024-05-04T00:31:25.977927+0000","last_became_active":"2024-05-04T00:31:21.400935+0000","last_became_peered":"2024-05-04T00:31:21.400935+0000","last_unstale":"2024-05-04T00:31:25.977927+0000","last_undegraded":"2024-05-04T00:31:25.977927+0000","last_fullsized":"2024-05-04T00:31:25.977927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:50:11.762845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:25.978424+0000","last_change":"2024-05-04T00:31:21.392918+0000","last_active":"2024-05-04T00:31:25.978424+0000","last_peered":"2024-05-04T00:31:25.978424+0000","last_clean":"2024-05-04T00:31:25.978424+0000","last_became_active":"2024-05-04T00:31:21.392020+0000","last_became_peered":"2024-05-04T00:31:21.392020+0000","last_unstale":"2024-05-04T00:31:25.978424+0000","last_undegraded":"2024-05-04T00:31:25.978424+0000","last_fullsized":"2024-05-04T00:31:25.978424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:19:30.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.334811+0000","last_change":"2024-05-04T00:31:19.187930+0000","last_active":"2024-05-04T00:31:26.334811+0000","last_peered":"2024-05-04T00:31:26.334811+0000","last_clean":"2024-05-04T00:31:26.334811+0000","last_became_active":"2024-05-04T00:31:19.185156+0000","last_became_peered":"2024-05-04T00:31:19.185156+0000","last_unstale":"2024-05-04T00:31:26.334811+0000","last_undegraded":"2024-05-04T00:31:26.334811+0000","last_fullsized":"2024-05-04T00:31:26.334811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:40.266177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.332539+0000","last_change":"2024-05-04T00:31:21.397596+0000","last_active":"2024-05-04T00:31:26.332539+0000","last_peered":"2024-05-04T00:31:26.332539+0000","last_clean":"2024-05-04T00:31:26.332539+0000","last_became_active":"2024-05-04T00:31:21.396023+0000","last_became_peered":"2024-05-04T00:31:21.396023+0000","last_unstale":"2024-05-04T00:31:26.332539+0000","last_undegraded":"2024-05-04T00:31:26.332539+0000","last_fullsized":"2024-05-04T00:31:26.332539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:02:02.166274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.218942+0000","last_change":"2024-05-04T00:31:19.189413+0000","last_active":"2024-05-04T00:31:35.218942+0000","last_peered":"2024-05-04T00:31:35.218942+0000","last_clean":"2024-05-04T00:31:35.218942+0000","last_became_active":"2024-05-04T00:31:19.188359+0000","last_became_peered":"2024-05-04T00:31:19.188359+0000","last_unstale":"2024-05-04T00:31:35.218942+0000","last_undegraded":"2024-05-04T00:31:35.218942+0000","last_fullsized":"2024-05-04T00:31:35.218942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:16:43.456248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336512+0000","last_change":"2024-05-04T00:31:21.417364+0000","last_active":"2024-05-04T00:31:26.336512+0000","last_peered":"2024-05-04T00:31:26.336512+0000","last_clean":"2024-05-04T00:31:26.336512+0000","last_became_active":"2024-05-04T00:31:21.416267+0000","last_became_peered":"2024-05-04T00:31:21.416267+0000","last_unstale":"2024-05-04T00:31:26.336512+0000","last_undegraded":"2024-05-04T00:31:26.336512+0000","last_fullsized":"2024-05-04T00:31:26.336512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:42:31.303120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336815+0000","last_change":"2024-05-04T00:31:19.187081+0000","last_active":"2024-05-04T00:31:26.336815+0000","last_peered":"2024-05-04T00:31:26.336815+0000","last_clean":"2024-05-04T00:31:26.336815+0000","last_became_active":"2024-05-04T00:31:19.186483+0000","last_became_peered":"2024-05-04T00:31:19.186483+0000","last_unstale":"2024-05-04T00:31:26.336815+0000","last_undegraded":"2024-05-04T00:31:26.336815+0000","last_fullsized":"2024-05-04T00:31:26.336815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:07.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:26.336315+0000","last_change":"2024-05-04T00:31:21.414034+0000","last_active":"2024-05-04T00:31:26.336315+0000","last_peered":"2024-05-04T00:31:26.336315+0000","last_clean":"2024-05-04T00:31:26.336315+0000","last_became_active":"2024-05-04T00:31:21.413330+0000","last_became_peered":"2024-05-04T00:31:21.413330+0000","last_unstale":"2024-05-04T00:31:26.336315+0000","last_undegraded":"2024-05-04T00:31:26.336315+0000","last_fullsized":"2024-05-04T00:31:26.336315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:07.135906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"26'9","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-04T00:31:35.210221+0000","last_change":"2024-05-04T00:31:19.175936+0000","last_active":"2024-05-04T00:31:35.210221+0000","last_peered":"2024-05-04T00:31:35.210221+0000","last_clean":"2024-05-04T00:31:35.210221+0000","last_became_active":"2024-05-04T00:31:19.175356+0000","last_became_peered":"2024-05-04T00:31:19.175356+0000","last_unstale":"2024-05-04T00:31:35.210221+0000","last_undegraded":"2024-05-04T00:31:35.210221+0000","last_fullsized":"2024-05-04T00:31:35.210221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:33.026019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5222,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":10444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":100887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":102863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":101329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":872448,"data_stored":690211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":100999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":100591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":884736,"data_stored":690855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542163,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":100909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T00:31:46.527 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-04T00:31:46.527 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-04T00:31:46.527 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-04T00:31:46.527 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-04T00:31:46.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.713+0000 7f208884b640 1 Processor -- start 2024-05-04T00:31:46.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.713+0000 7f208884b640 1 -- start start 2024-05-04T00:31:46.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.717+0000 7f208884b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20840c4890 0x7f20841541a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:46.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.717+0000 7f208884b640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f20840709d0 0x7f20840c8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:46.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.717+0000 7f208884b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f208406f860 0x7f208406fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:46.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.717+0000 7f208884b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f20840c81e0 con 0x7f208406f860 2024-05-04T00:31:46.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.717+0000 7f208884b640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f208415aac0 con 0x7f20840709d0 2024-05-04T00:31:46.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.717+0000 7f208884b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f20840c7b90 con 0x7f20840c4890 2024-05-04T00:31:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.717+0000 7f2082d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f208406f860 0x7f208406fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.717+0000 7f2082d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f208406f860 0x7f208406fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47152/0 (socket says 172.21.15.6:47152) 2024-05-04T00:31:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.717+0000 7f2082d9d640 1 -- 172.21.15.6:0/1642397312 learned_addr learned my addr 172.21.15.6:0/1642397312 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.717+0000 7f207bfff640 1 --2- 172.21.15.6:0/1642397312 >> v2:172.21.15.163:3300/0 conn(0x7f20840709d0 0x7f20840c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.717+0000 7f208259c640 1 --2- 172.21.15.6:0/1642397312 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20840c4890 0x7f20841541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.721+0000 7f2082d9d640 1 -- 172.21.15.6:0/1642397312 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20840c4890 msgr2=0x7f20841541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.721+0000 7f2082d9d640 1 --2- 172.21.15.6:0/1642397312 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20840c4890 0x7f20841541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.721+0000 7f2082d9d640 1 -- 172.21.15.6:0/1642397312 >> v2:172.21.15.163:3300/0 conn(0x7f20840709d0 msgr2=0x7f20840c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.721+0000 7f2082d9d640 1 --2- 172.21.15.6:0/1642397312 >> v2:172.21.15.163:3300/0 conn(0x7f20840709d0 0x7f20840c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.721+0000 7f2082d9d640 1 -- 172.21.15.6:0/1642397312 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20840c7e70 con 0x7f208406f860 2024-05-04T00:31:46.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.721+0000 7f2082d9d640 1 --2- 172.21.15.6:0/1642397312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208406f860 0x7f208406fc70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f20840ca300 tx=0x7f207c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5cfccc283fd27d server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:46.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.729+0000 7f2081d9b640 1 -- 172.21.15.6:0/1642397312 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c0a5550 con 0x7f208406f860 2024-05-04T00:31:46.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.729+0000 7f2081d9b640 1 -- 172.21.15.6:0/1642397312 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f207c0a56f0 con 0x7f208406f860 2024-05-04T00:31:46.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.729+0000 7f2081d9b640 1 -- 172.21.15.6:0/1642397312 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c0a5ac0 con 0x7f208406f860 2024-05-04T00:31:46.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.729+0000 7f208884b640 1 -- 172.21.15.6:0/1642397312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208406f860 msgr2=0x7f208406fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:46.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.729+0000 7f208884b640 1 --2- 172.21.15.6:0/1642397312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208406f860 0x7f208406fc70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f20840ca300 tx=0x7f207c01c8d0 comp rx=0 tx=0).stop 2024-05-04T00:31:46.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.729+0000 7f208884b640 1 -- 172.21.15.6:0/1642397312 shutdown_connections 2024-05-04T00:31:46.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.729+0000 7f208884b640 1 --2- 172.21.15.6:0/1642397312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208406f860 0x7f208406fc70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:46.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.729+0000 7f208884b640 1 --2- 172.21.15.6:0/1642397312 >> v2:172.21.15.163:3300/0 conn(0x7f20840709d0 0x7f20840c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:46.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.729+0000 7f208884b640 1 --2- 172.21.15.6:0/1642397312 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20840c4890 0x7f20841541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:46.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.729+0000 7f208884b640 1 -- 172.21.15.6:0/1642397312 >> 172.21.15.6:0/1642397312 conn(0x7f208406cf70 msgr2=0x7f20840c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:46.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.729+0000 7f208884b640 1 -- 172.21.15.6:0/1642397312 shutdown_connections 2024-05-04T00:31:46.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.729+0000 7f208884b640 1 -- 172.21.15.6:0/1642397312 wait complete. 2024-05-04T00:31:46.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.729+0000 7f208884b640 1 Processor -- start 2024-05-04T00:31:46.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.729+0000 7f208884b640 1 -- start start 2024-05-04T00:31:46.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.733+0000 7f208884b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208406f860 0x7f20841f9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:46.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.733+0000 7f208884b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20840709d0 0x7f2084149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:46.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.733+0000 7f208884b640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20840c4890 0x7f2084143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:46.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.733+0000 7f208884b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f20840c50f0 con 0x7f208406f860 2024-05-04T00:31:46.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.733+0000 7f208884b640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f20840c4f70 con 0x7f20840c4890 2024-05-04T00:31:46.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.733+0000 7f208884b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f208415dca0 con 0x7f20840709d0 2024-05-04T00:31:46.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.733+0000 7f208259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208406f860 0x7f20841f9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:46.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.733+0000 7f208259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208406f860 0x7f20841f9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47160/0 (socket says 172.21.15.6:47160) 2024-05-04T00:31:46.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.733+0000 7f208259c640 1 -- 172.21.15.6:0/4118963623 learned_addr learned my addr 172.21.15.6:0/4118963623 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:46.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.733+0000 7f207bfff640 1 --2- 172.21.15.6:0/4118963623 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20840709d0 0x7f2084149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:46.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.733+0000 7f2082d9d640 1 --2- 172.21.15.6:0/4118963623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20840c4890 0x7f2084143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:46.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.737+0000 7f208259c640 1 -- 172.21.15.6:0/4118963623 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20840709d0 msgr2=0x7f2084149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:46.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.737+0000 7f208259c640 1 --2- 172.21.15.6:0/4118963623 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20840709d0 0x7f2084149740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:46.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.737+0000 7f208259c640 1 -- 172.21.15.6:0/4118963623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20840c4890 msgr2=0x7f2084143f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:46.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.737+0000 7f208259c640 1 --2- 172.21.15.6:0/4118963623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20840c4890 0x7f2084143f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:46.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.737+0000 7f208259c640 1 -- 172.21.15.6:0/4118963623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20841f9570 con 0x7f208406f860 2024-05-04T00:31:46.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.741+0000 7f208259c640 1 --2- 172.21.15.6:0/4118963623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208406f860 0x7f20841f9030 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f207400e870 tx=0x7f207400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:46.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.745+0000 7f207affd640 1 -- 172.21.15.6:0/4118963623 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074017070 con 0x7f208406f860 2024-05-04T00:31:46.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.745+0000 7f207affd640 1 -- 172.21.15.6:0/4118963623 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f207400c940 con 0x7f208406f860 2024-05-04T00:31:46.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.745+0000 7f207affd640 1 -- 172.21.15.6:0/4118963623 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207400ccf0 con 0x7f208406f860 2024-05-04T00:31:46.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.745+0000 7f208884b640 1 -- 172.21.15.6:0/4118963623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2084163740 con 0x7f208406f860 2024-05-04T00:31:46.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.745+0000 7f208884b640 1 -- 172.21.15.6:0/4118963623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2084164030 con 0x7f208406f860 2024-05-04T00:31:46.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:46.745+0000 7f208884b640 1 -- 172.21.15.6:0/4118963623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f208406a390 con 0x7f208406f860 2024-05-04T00:31:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.065+0000 7f207affd640 1 -- 172.21.15.6:0/4118963623 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f207401a070 con 0x7f208406f860 2024-05-04T00:31:47.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.069+0000 7f207affd640 1 --2- 172.21.15.6:0/4118963623 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f206406f450 0x7f2064071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:47.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.069+0000 7f207bfff640 1 --2- 172.21.15.6:0/4118963623 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f206406f450 0x7f2064071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.069+0000 7f207bfff640 1 --2- 172.21.15.6:0/4118963623 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f206406f450 0x7f2064071960 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f20841476c0 tx=0x7f206c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:47.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.109+0000 7f207affd640 1 -- 172.21.15.6:0/4118963623 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f2074058450 con 0x7f208406f860 2024-05-04T00:31:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.109+0000 7f207affd640 1 -- 172.21.15.6:0/4118963623 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f207405c1c0 con 0x7f208406f860 2024-05-04T00:31:47.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.317+0000 7f208884b640 1 -- 172.21.15.6:0/4118963623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2084069ee0 con 0x7f208406f860 2024-05-04T00:31:47.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.333+0000 7f207affd640 1 -- 172.21.15.6:0/4118963623 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f20740604c0 con 0x7f208406f860 2024-05-04T00:31:47.335 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:31:47.335 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-04T00:31:47.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.337+0000 7f208884b640 1 -- 172.21.15.6:0/4118963623 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f206406f450 msgr2=0x7f2064071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:47.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.337+0000 7f208884b640 1 --2- 172.21.15.6:0/4118963623 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f206406f450 0x7f2064071960 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f20841476c0 tx=0x7f206c009190 comp rx=0 tx=0).stop 2024-05-04T00:31:47.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.337+0000 7f208884b640 1 -- 172.21.15.6:0/4118963623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208406f860 msgr2=0x7f20841f9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:47.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.337+0000 7f208884b640 1 --2- 172.21.15.6:0/4118963623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208406f860 0x7f20841f9030 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f207400e870 tx=0x7f207400ec70 comp rx=0 tx=0).stop 2024-05-04T00:31:47.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.337+0000 7f208884b640 1 -- 172.21.15.6:0/4118963623 shutdown_connections 2024-05-04T00:31:47.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.337+0000 7f208884b640 1 --2- 172.21.15.6:0/4118963623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20840c4890 0x7f2084143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:47.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.337+0000 7f208884b640 1 --2- 172.21.15.6:0/4118963623 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f206406f450 0x7f2064071960 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:47.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.337+0000 7f208884b640 1 --2- 172.21.15.6:0/4118963623 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20840709d0 0x7f2084149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:47.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.337+0000 7f208884b640 1 --2- 172.21.15.6:0/4118963623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208406f860 0x7f20841f9030 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:47.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.337+0000 7f208884b640 1 -- 172.21.15.6:0/4118963623 >> 172.21.15.6:0/4118963623 conn(0x7f208406cf70 msgr2=0x7f2084147a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:47.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.337+0000 7f208884b640 1 -- 172.21.15.6:0/4118963623 shutdown_connections 2024-05-04T00:31:47.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.337+0000 7f208884b640 1 -- 172.21.15.6:0/4118963623 wait complete. 2024-05-04T00:31:47.356 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-04T00:31:47.357 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T00:31:47.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.505+0000 7f18d63c8640 1 Processor -- start 2024-05-04T00:31:47.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.505+0000 7f18d63c8640 1 -- start start 2024-05-04T00:31:47.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.505+0000 7f18d63c8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18d0159780 0x7f18d0152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:47.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.505+0000 7f18d63c8640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f18d0073cd0 0x7f18d0163680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:47.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.505+0000 7f18d63c8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18d0153420 con 0x7f18d00738c0 2024-05-04T00:31:47.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.505+0000 7f18d63c8640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f18d00c6710 con 0x7f18d0073cd0 2024-05-04T00:31:47.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.505+0000 7f18d63c8640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f18d00ca420 con 0x7f18d0159780 2024-05-04T00:31:47.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.505+0000 7f18cffff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18d0159780 0x7f18d0152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:47.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.505+0000 7f18d4965640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f18d0073cd0 0x7f18d0163680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:47.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.509+0000 7f18cffff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18d0159780 0x7f18d0152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:47258/0 (socket says 172.21.15.6:47258) 2024-05-04T00:31:47.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.509+0000 7f18cffff640 1 -- 172.21.15.6:0/2025740389 learned_addr learned my addr 172.21.15.6:0/2025740389 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:47.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.513+0000 7f18cffff640 1 -- 172.21.15.6:0/2025740389 >> v2:172.21.15.163:3300/0 conn(0x7f18d0073cd0 msgr2=0x7f18d0163680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:47.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.513+0000 7f18cffff640 1 --2- 172.21.15.6:0/2025740389 >> v2:172.21.15.163:3300/0 conn(0x7f18d0073cd0 0x7f18d0163680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:47.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.513+0000 7f18cffff640 1 -- 172.21.15.6:0/2025740389 >> v1:172.21.15.6:6789/0 conn(0x7f18d00738c0 legacy=0x7f18d00c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:47.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.513+0000 7f18cffff640 1 -- 172.21.15.6:0/2025740389 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d0072bc0 con 0x7f18d0159780 2024-05-04T00:31:47.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.521+0000 7f18cffff640 1 --2- 172.21.15.6:0/2025740389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18d0159780 0x7f18d0152ee0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009e50 tx=0x7f18c001ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8a9baa49b95e1d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:47.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.529+0000 7f18ceffd640 1 -- 172.21.15.6:0/2025740389 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c00a5840 con 0x7f18d0159780 2024-05-04T00:31:47.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.529+0000 7f18ceffd640 1 -- 172.21.15.6:0/2025740389 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c00a59e0 con 0x7f18d0159780 2024-05-04T00:31:47.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.529+0000 7f18ceffd640 1 -- 172.21.15.6:0/2025740389 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c00a5db0 con 0x7f18d0159780 2024-05-04T00:31:47.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.529+0000 7f18d63c8640 1 -- 172.21.15.6:0/2025740389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18d0159780 msgr2=0x7f18d0152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:47.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.529+0000 7f18d63c8640 1 --2- 172.21.15.6:0/2025740389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18d0159780 0x7f18d0152ee0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009e50 tx=0x7f18c001ca00 comp rx=0 tx=0).stop 2024-05-04T00:31:47.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.529+0000 7f18d63c8640 1 -- 172.21.15.6:0/2025740389 shutdown_connections 2024-05-04T00:31:47.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.529+0000 7f18d63c8640 1 --2- 172.21.15.6:0/2025740389 >> v2:172.21.15.163:3300/0 conn(0x7f18d0073cd0 0x7f18d0163680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:47.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.529+0000 7f18d63c8640 1 --2- 172.21.15.6:0/2025740389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18d0159780 0x7f18d0152ee0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:47.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.529+0000 7f18d63c8640 1 -- 172.21.15.6:0/2025740389 >> 172.21.15.6:0/2025740389 conn(0x7f18d006cf70 msgr2=0x7f18d00c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:47.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.533+0000 7f18d63c8640 1 -- 172.21.15.6:0/2025740389 shutdown_connections 2024-05-04T00:31:47.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.533+0000 7f18d63c8640 1 -- 172.21.15.6:0/2025740389 wait complete. 2024-05-04T00:31:47.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.533+0000 7f18d63c8640 1 Processor -- start 2024-05-04T00:31:47.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.533+0000 7f18d63c8640 1 -- start start 2024-05-04T00:31:47.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.533+0000 7f18d63c8640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18d00738c0 0x7f18d0152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.533+0000 7f18d63c8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18d0073cd0 0x7f18d014af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.533+0000 7f18d63c8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18d0159780 0x7f18d014ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.533+0000 7f18d63c8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f18d0159b90 con 0x7f18d0073cd0 2024-05-04T00:31:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.533+0000 7f18d63c8640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f18d00c6f20 con 0x7f18d00738c0 2024-05-04T00:31:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.533+0000 7f18d63c8640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f18d00c7440 con 0x7f18d0159780 2024-05-04T00:31:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.533+0000 7f18cf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18d0073cd0 0x7f18d014af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.537+0000 7f18cf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18d0073cd0 0x7f18d014af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47170/0 (socket says 172.21.15.6:47170) 2024-05-04T00:31:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.537+0000 7f18cf7fe640 1 -- 172.21.15.6:0/3871110506 learned_addr learned my addr 172.21.15.6:0/3871110506 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:47.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.537+0000 7f18d4965640 1 --2- 172.21.15.6:0/3871110506 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18d0159780 0x7f18d014ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:47.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.541+0000 7f18cf7fe640 1 -- 172.21.15.6:0/3871110506 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18d0159780 msgr2=0x7f18d014ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:47.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.541+0000 7f18cf7fe640 1 --2- 172.21.15.6:0/3871110506 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18d0159780 0x7f18d014ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:47.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.541+0000 7f18cf7fe640 1 -- 172.21.15.6:0/3871110506 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18d00738c0 msgr2=0x7f18d0152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:47.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.541+0000 7f18cf7fe640 1 --2- 172.21.15.6:0/3871110506 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18d00738c0 0x7f18d0152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:47.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.541+0000 7f18cf7fe640 1 -- 172.21.15.6:0/3871110506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d015ca10 con 0x7f18d0073cd0 2024-05-04T00:31:47.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.541+0000 7f18cf7fe640 1 --2- 172.21.15.6:0/3871110506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18d0073cd0 0x7f18d014af00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f18c400b410 tx=0x7f18c400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.549+0000 7f18ccff9640 1 -- 172.21.15.6:0/3871110506 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c4015020 con 0x7f18d0073cd0 2024-05-04T00:31:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.549+0000 7f18ccff9640 1 -- 172.21.15.6:0/3871110506 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c4011850 con 0x7f18d0073cd0 2024-05-04T00:31:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.549+0000 7f18ccff9640 1 -- 172.21.15.6:0/3871110506 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c4011c40 con 0x7f18d0073cd0 2024-05-04T00:31:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.549+0000 7f18d63c8640 1 -- 172.21.15.6:0/3871110506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18d015a240 con 0x7f18d0073cd0 2024-05-04T00:31:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.549+0000 7f18d63c8640 1 -- 172.21.15.6:0/3871110506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18d015ccb0 con 0x7f18d0073cd0 2024-05-04T00:31:47.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.549+0000 7f18d63c8640 1 -- 172.21.15.6:0/3871110506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18d006a390 con 0x7f18d0073cd0 2024-05-04T00:31:47.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.877+0000 7f18ccff9640 1 -- 172.21.15.6:0/3871110506 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f18c4018020 con 0x7f18d0073cd0 2024-05-04T00:31:47.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.877+0000 7f18ccff9640 1 --2- 172.21.15.6:0/3871110506 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f18bc06f400 0x7f18bc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:47.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.877+0000 7f18cffff640 1 --2- 172.21.15.6:0/3871110506 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f18bc06f400 0x7f18bc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:47.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.877+0000 7f18cffff640 1 --2- 172.21.15.6:0/3871110506 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f18bc06f400 0x7f18bc071910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f18c00ae000 tx=0x7f18c0004ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.913+0000 7f18ccff9640 1 -- 172.21.15.6:0/3871110506 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f18c4011de0 con 0x7f18d0073cd0 2024-05-04T00:31:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:47.913+0000 7f18ccff9640 1 -- 172.21.15.6:0/3871110506 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f18c401f020 con 0x7f18d0073cd0 2024-05-04T00:31:48.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.137+0000 7f18d63c8640 1 -- 172.21.15.6:0/3871110506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18d00c9370 con 0x7f18d0073cd0 2024-05-04T00:31:48.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.213+0000 7f18ccff9640 1 -- 172.21.15.6:0/3871110506 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6850 (secure 0 0 0) 0x7f18c405c690 con 0x7f18d0073cd0 2024-05-04T00:31:48.216 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:31:48.216 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4185,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/811470677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":811470677},{"type":"v1","addr":"172.21.15.6:6833","nonce":811470677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4194,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/50303985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":50303985},{"type":"v1","addr":"172.21.15.163:6839","nonce":50303985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2015777060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2015777060},{"type":"v1","addr":"172.21.15.6:6835","nonce":2015777060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T00:31:21.468790+0000","modified":"2024-05-04T00:31:36.770046+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.163:6835/428471443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":428471443},{"type":"v1","addr":"172.21.15.163:6835","nonce":428471443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"b","rank":1,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6837/1055589916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1055589916},{"type":"v1","addr":"172.21.15.163:6837","nonce":1055589916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.6:6837/639743836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":639743836},{"type":"v1","addr":"172.21.15.6:6837","nonce":639743836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-04T00:31:48.216 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 12 2024-05-04T00:31:48.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.217+0000 7f18d63c8640 1 -- 172.21.15.6:0/3871110506 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f18bc06f400 msgr2=0x7f18bc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:48.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.217+0000 7f18d63c8640 1 --2- 172.21.15.6:0/3871110506 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f18bc06f400 0x7f18bc071910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f18c00ae000 tx=0x7f18c0004ac0 comp rx=0 tx=0).stop 2024-05-04T00:31:48.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.217+0000 7f18d63c8640 1 -- 172.21.15.6:0/3871110506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18d0073cd0 msgr2=0x7f18d014af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:48.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.217+0000 7f18d63c8640 1 --2- 172.21.15.6:0/3871110506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18d0073cd0 0x7f18d014af00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f18c400b410 tx=0x7f18c400b8d0 comp rx=0 tx=0).stop 2024-05-04T00:31:48.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.217+0000 7f18d63c8640 1 -- 172.21.15.6:0/3871110506 shutdown_connections 2024-05-04T00:31:48.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.217+0000 7f18d63c8640 1 --2- 172.21.15.6:0/3871110506 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f18bc06f400 0x7f18bc071910 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:48.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.217+0000 7f18d63c8640 1 --2- 172.21.15.6:0/3871110506 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18d0159780 0x7f18d014ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:48.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.217+0000 7f18d63c8640 1 --2- 172.21.15.6:0/3871110506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18d0073cd0 0x7f18d014af00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:48.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.217+0000 7f18d63c8640 1 --2- 172.21.15.6:0/3871110506 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18d00738c0 0x7f18d0152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:48.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.217+0000 7f18d63c8640 1 -- 172.21.15.6:0/3871110506 >> 172.21.15.6:0/3871110506 conn(0x7f18d006cf70 msgr2=0x7f18d00cc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:48.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.217+0000 7f18d63c8640 1 -- 172.21.15.6:0/3871110506 shutdown_connections 2024-05-04T00:31:48.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.217+0000 7f18d63c8640 1 -- 172.21.15.6:0/3871110506 wait complete. 2024-05-04T00:31:48.251 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T00:31:48.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.409+0000 7fd5c331c640 1 Processor -- start 2024-05-04T00:31:48.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.409+0000 7fd5c331c640 1 -- start start 2024-05-04T00:31:48.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.409+0000 7fd5c331c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd5bc156470 0x7fd5bc0cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.409+0000 7fd5c331c640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5bc0ccf90 0x7fd5bc0cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.409+0000 7fd5c331c640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5bc160620 con 0x7fd5bc15c7a0 2024-05-04T00:31:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.409+0000 7fd5c331c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd5bc15c310 con 0x7fd5bc156470 2024-05-04T00:31:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.409+0000 7fd5c331c640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fd5bc15faa0 con 0x7fd5bc0ccf90 2024-05-04T00:31:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.409+0000 7fd5c10b8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd5bc156470 0x7fd5bc0cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:48.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.409+0000 7fd5c10b8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd5bc156470 0x7fd5bc0cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47176/0 (socket says 172.21.15.6:47176) 2024-05-04T00:31:48.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.409+0000 7fd5c10b8640 1 -- 172.21.15.6:0/1225032075 learned_addr learned my addr 172.21.15.6:0/1225032075 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:48.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.413+0000 7fd5c10b8640 1 -- 172.21.15.6:0/1225032075 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5bc0ccf90 msgr2=0x7fd5bc0cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:48.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.413+0000 7fd5c10b8640 1 --2- 172.21.15.6:0/1225032075 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5bc0ccf90 0x7fd5bc0cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:48.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.413+0000 7fd5c10b8640 1 -- 172.21.15.6:0/1225032075 >> v1:172.21.15.163:6789/0 conn(0x7fd5bc15c7a0 legacy=0x7fd5bc072da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:48.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.413+0000 7fd5c10b8640 1 -- 172.21.15.6:0/1225032075 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5bc15fd80 con 0x7fd5bc156470 2024-05-04T00:31:48.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.417+0000 7fd5c10b8640 1 --2- 172.21.15.6:0/1225032075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5bc156470 0x7fd5bc0cc230 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc06d330 tx=0x7fd5b801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2706e245cdfec66 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:48.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.425+0000 7fd5b3fff640 1 -- 172.21.15.6:0/1225032075 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b80b5070 con 0x7fd5bc156470 2024-05-04T00:31:48.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.425+0000 7fd5b3fff640 1 -- 172.21.15.6:0/1225032075 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5b80a89b0 con 0x7fd5bc156470 2024-05-04T00:31:48.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.425+0000 7fd5b3fff640 1 -- 172.21.15.6:0/1225032075 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b80a8d80 con 0x7fd5bc156470 2024-05-04T00:31:48.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.425+0000 7fd5c331c640 1 -- 172.21.15.6:0/1225032075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5bc156470 msgr2=0x7fd5bc0cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:48.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.425+0000 7fd5c331c640 1 --2- 172.21.15.6:0/1225032075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5bc156470 0x7fd5bc0cc230 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc06d330 tx=0x7fd5b801ed30 comp rx=0 tx=0).stop 2024-05-04T00:31:48.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.425+0000 7fd5c331c640 1 -- 172.21.15.6:0/1225032075 shutdown_connections 2024-05-04T00:31:48.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.425+0000 7fd5c331c640 1 --2- 172.21.15.6:0/1225032075 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5bc0ccf90 0x7fd5bc0cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:48.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.425+0000 7fd5c331c640 1 --2- 172.21.15.6:0/1225032075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5bc156470 0x7fd5bc0cc230 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:48.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.425+0000 7fd5c331c640 1 -- 172.21.15.6:0/1225032075 >> 172.21.15.6:0/1225032075 conn(0x7fd5bc0d1600 msgr2=0x7fd5bc0d1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:48.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.425+0000 7fd5c331c640 1 -- 172.21.15.6:0/1225032075 shutdown_connections 2024-05-04T00:31:48.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.425+0000 7fd5c331c640 1 -- 172.21.15.6:0/1225032075 wait complete. 2024-05-04T00:31:48.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.425+0000 7fd5c331c640 1 Processor -- start 2024-05-04T00:31:48.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.425+0000 7fd5c331c640 1 -- start start 2024-05-04T00:31:48.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.429+0000 7fd5c331c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5bc0ccf90 0x7fd5bc0c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:48.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.429+0000 7fd5c331c640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5bc15c7a0 0x7fd5bc1f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:48.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.429+0000 7fd5c331c640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5bc0b5280 0x7fd5bc152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:48.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.429+0000 7fd5c331c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd5bc0cc770 con 0x7fd5bc0ccf90 2024-05-04T00:31:48.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.429+0000 7fd5c331c640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd5bc160340 con 0x7fd5bc0b5280 2024-05-04T00:31:48.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.429+0000 7fd5c331c640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fd5bc15f6d0 con 0x7fd5bc15c7a0 2024-05-04T00:31:48.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.429+0000 7fd5c10b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5bc0ccf90 0x7fd5bc0c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:48.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.429+0000 7fd5c10b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5bc0ccf90 0x7fd5bc0c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47182/0 (socket says 172.21.15.6:47182) 2024-05-04T00:31:48.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.429+0000 7fd5c10b8640 1 -- 172.21.15.6:0/469041493 learned_addr learned my addr 172.21.15.6:0/469041493 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:48.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.433+0000 7fd5c10b8640 1 -- 172.21.15.6:0/469041493 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5bc15c7a0 msgr2=0x7fd5bc1f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:48.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.433+0000 7fd5c10b8640 1 --2- 172.21.15.6:0/469041493 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5bc15c7a0 0x7fd5bc1f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:48.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.433+0000 7fd5c10b8640 1 -- 172.21.15.6:0/469041493 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5bc0b5280 msgr2=0x7fd5bc152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:48.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.433+0000 7fd5c10b8640 1 --2- 172.21.15.6:0/469041493 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5bc0b5280 0x7fd5bc152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:48.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.433+0000 7fd5c10b8640 1 -- 172.21.15.6:0/469041493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5bc1f4650 con 0x7fd5bc0ccf90 2024-05-04T00:31:48.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.437+0000 7fd5c10b8640 1 --2- 172.21.15.6:0/469041493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5bc0ccf90 0x7fd5bc0c8930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd5b801eb60 tx=0x7fd5b801bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.441+0000 7fd5b1ffb640 1 -- 172.21.15.6:0/469041493 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b80b5040 con 0x7fd5bc0ccf90 2024-05-04T00:31:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.441+0000 7fd5b1ffb640 1 -- 172.21.15.6:0/469041493 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5b80be070 con 0x7fd5bc0ccf90 2024-05-04T00:31:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.441+0000 7fd5b1ffb640 1 -- 172.21.15.6:0/469041493 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b80b0b10 con 0x7fd5bc0ccf90 2024-05-04T00:31:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.441+0000 7fd5c331c640 1 -- 172.21.15.6:0/469041493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5bc15dee0 con 0x7fd5bc0ccf90 2024-05-04T00:31:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.441+0000 7fd5c331c640 1 -- 172.21.15.6:0/469041493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5bc15e480 con 0x7fd5bc0ccf90 2024-05-04T00:31:48.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.441+0000 7fd5c331c640 1 -- 172.21.15.6:0/469041493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5bc069a50 con 0x7fd5bc0ccf90 2024-05-04T00:31:48.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.465+0000 7fd5b1ffb640 1 -- 172.21.15.6:0/469041493 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd5b80b0cb0 con 0x7fd5bc0ccf90 2024-05-04T00:31:48.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.469+0000 7fd5b1ffb640 1 --2- 172.21.15.6:0/469041493 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fd5a006f450 0x7fd5a0071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:48.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.469+0000 7fd5c08b7640 1 --2- 172.21.15.6:0/469041493 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fd5a006f450 0x7fd5a0071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:48.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.469+0000 7fd5c08b7640 1 --2- 172.21.15.6:0/469041493 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fd5a006f450 0x7fd5a0071960 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc15f470 tx=0x7fd5ac006c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.473+0000 7fd5b1ffb640 1 -- 172.21.15.6:0/469041493 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fd5b80f60f0 con 0x7fd5bc0ccf90 2024-05-04T00:31:48.567 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:31:48.571 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:31:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:48.797+0000 7fd5b1ffb640 1 -- 172.21.15.6:0/469041493 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd5b8018890 con 0x7fd5bc0ccf90 2024-05-04T00:31:49.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.021+0000 7fd5c331c640 1 -- 172.21.15.6:0/469041493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5bc0b5840 con 0x7fd5bc0ccf90 2024-05-04T00:31:49.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.041+0000 7fd5b1ffb640 1 -- 172.21.15.6:0/469041493 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6850 (secure 0 0 0) 0x7fd5b80fa560 con 0x7fd5bc0ccf90 2024-05-04T00:31:49.045 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:31:49.046 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4185,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/811470677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":811470677},{"type":"v1","addr":"172.21.15.6:6833","nonce":811470677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4194,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/50303985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":50303985},{"type":"v1","addr":"172.21.15.163:6839","nonce":50303985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2015777060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2015777060},{"type":"v1","addr":"172.21.15.6:6835","nonce":2015777060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T00:31:21.468790+0000","modified":"2024-05-04T00:31:36.770046+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.163:6835/428471443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":428471443},{"type":"v1","addr":"172.21.15.163:6835","nonce":428471443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"b","rank":1,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6837/1055589916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1055589916},{"type":"v1","addr":"172.21.15.163:6837","nonce":1055589916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.6:6837/639743836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":639743836},{"type":"v1","addr":"172.21.15.6:6837","nonce":639743836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-04T00:31:49.046 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 12 2024-05-04T00:31:49.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.045+0000 7fd5c331c640 1 -- 172.21.15.6:0/469041493 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fd5a006f450 msgr2=0x7fd5a0071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:49.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.045+0000 7fd5c331c640 1 --2- 172.21.15.6:0/469041493 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fd5a006f450 0x7fd5a0071960 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc15f470 tx=0x7fd5ac006c00 comp rx=0 tx=0).stop 2024-05-04T00:31:49.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.045+0000 7fd5c331c640 1 -- 172.21.15.6:0/469041493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5bc0ccf90 msgr2=0x7fd5bc0c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:49.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.045+0000 7fd5c331c640 1 --2- 172.21.15.6:0/469041493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5bc0ccf90 0x7fd5bc0c8930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd5b801eb60 tx=0x7fd5b801bad0 comp rx=0 tx=0).stop 2024-05-04T00:31:49.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.045+0000 7fd5c331c640 1 -- 172.21.15.6:0/469041493 shutdown_connections 2024-05-04T00:31:49.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.045+0000 7fd5c331c640 1 --2- 172.21.15.6:0/469041493 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5bc0b5280 0x7fd5bc152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:49.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.045+0000 7fd5c331c640 1 --2- 172.21.15.6:0/469041493 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fd5a006f450 0x7fd5a0071960 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:49.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.045+0000 7fd5c331c640 1 --2- 172.21.15.6:0/469041493 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5bc15c7a0 0x7fd5bc1f4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:49.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.045+0000 7fd5c331c640 1 --2- 172.21.15.6:0/469041493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5bc0ccf90 0x7fd5bc0c8930 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:49.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.045+0000 7fd5c331c640 1 -- 172.21.15.6:0/469041493 >> 172.21.15.6:0/469041493 conn(0x7fd5bc0d1600 msgr2=0x7fd5bc153c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:49.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.049+0000 7fd5c331c640 1 -- 172.21.15.6:0/469041493 shutdown_connections 2024-05-04T00:31:49.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.049+0000 7fd5c331c640 1 -- 172.21.15.6:0/469041493 wait complete. 2024-05-04T00:31:49.073 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T00:31:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.229+0000 7f5dec0cc640 1 Processor -- start 2024-05-04T00:31:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.229+0000 7f5dec0cc640 1 -- start start 2024-05-04T00:31:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.229+0000 7f5dec0cc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5de414f780 0x7f5de40cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.229+0000 7f5dec0cc640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5de414fb90 0x7f5de40ce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.229+0000 7f5dec0cc640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5de4159090 con 0x7f5de40c9c60 2024-05-04T00:31:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.229+0000 7f5dec0cc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f5de40ca3a0 con 0x7f5de414f780 2024-05-04T00:31:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.229+0000 7f5dec0cc640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f5de40c3340 con 0x7f5de414fb90 2024-05-04T00:31:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.229+0000 7f5de9667640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5de414f780 0x7f5de40cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.233+0000 7f5de9667640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5de414f780 0x7f5de40cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47188/0 (socket says 172.21.15.6:47188) 2024-05-04T00:31:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.233+0000 7f5de9667640 1 -- 172.21.15.6:0/2900928699 learned_addr learned my addr 172.21.15.6:0/2900928699 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.233+0000 7f5dea669640 1 --2- 172.21.15.6:0/2900928699 >> v2:172.21.15.163:3300/0 conn(0x7f5de414fb90 0x7f5de40ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.233+0000 7f5de9667640 1 -- 172.21.15.6:0/2900928699 >> v2:172.21.15.163:3300/0 conn(0x7f5de414fb90 msgr2=0x7f5de40ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.233+0000 7f5de9667640 1 --2- 172.21.15.6:0/2900928699 >> v2:172.21.15.163:3300/0 conn(0x7f5de414fb90 0x7f5de40ce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.233+0000 7f5de9667640 1 -- 172.21.15.6:0/2900928699 >> v1:172.21.15.163:6789/0 conn(0x7f5de40c9c60 legacy=0x7f5de4159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.233+0000 7f5de9667640 1 -- 172.21.15.6:0/2900928699 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de40c3620 con 0x7f5de414f780 2024-05-04T00:31:49.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.237+0000 7f5de9667640 1 --2- 172.21.15.6:0/2900928699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de414f780 0x7f5de40cddf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5de40ca520 tx=0x7f5dd401e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d3c08fa8c462e server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.241+0000 7f5de8e66640 1 -- 172.21.15.6:0/2900928699 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd40ad5f0 con 0x7f5de414f780 2024-05-04T00:31:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.241+0000 7f5de8e66640 1 -- 172.21.15.6:0/2900928699 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd40b2070 con 0x7f5de414f780 2024-05-04T00:31:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.241+0000 7f5de8e66640 1 -- 172.21.15.6:0/2900928699 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd40ad9b0 con 0x7f5de414f780 2024-05-04T00:31:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.245+0000 7f5dec0cc640 1 -- 172.21.15.6:0/2900928699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de414f780 msgr2=0x7f5de40cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.245+0000 7f5dec0cc640 1 --2- 172.21.15.6:0/2900928699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de414f780 0x7f5de40cddf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5de40ca520 tx=0x7f5dd401e610 comp rx=0 tx=0).stop 2024-05-04T00:31:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.245+0000 7f5dec0cc640 1 -- 172.21.15.6:0/2900928699 shutdown_connections 2024-05-04T00:31:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.245+0000 7f5dec0cc640 1 --2- 172.21.15.6:0/2900928699 >> v2:172.21.15.163:3300/0 conn(0x7f5de414fb90 0x7f5de40ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.245+0000 7f5dec0cc640 1 --2- 172.21.15.6:0/2900928699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de414f780 0x7f5de40cddf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.245+0000 7f5dec0cc640 1 -- 172.21.15.6:0/2900928699 >> 172.21.15.6:0/2900928699 conn(0x7f5de4070d60 msgr2=0x7f5de40711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.245+0000 7f5dec0cc640 1 -- 172.21.15.6:0/2900928699 shutdown_connections 2024-05-04T00:31:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.245+0000 7f5dec0cc640 1 -- 172.21.15.6:0/2900928699 wait complete. 2024-05-04T00:31:49.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.245+0000 7f5dec0cc640 1 Processor -- start 2024-05-04T00:31:49.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.245+0000 7f5dec0cc640 1 -- start start 2024-05-04T00:31:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.245+0000 7f5dec0cc640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5de40c9c60 0x7f5de41f2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.245+0000 7f5dec0cc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de414f780 0x7f5de41f52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.245+0000 7f5dec0cc640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5de414fb90 0x7f5de40ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.245+0000 7f5dec0cc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5de4074b80 con 0x7f5de414f780 2024-05-04T00:31:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.245+0000 7f5dec0cc640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5de4074a00 con 0x7f5de40c9c60 2024-05-04T00:31:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.245+0000 7f5dec0cc640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f5de415c520 con 0x7f5de414fb90 2024-05-04T00:31:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.249+0000 7f5de9667640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de414f780 0x7f5de41f52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.249+0000 7f5de9667640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de414f780 0x7f5de41f52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47192/0 (socket says 172.21.15.6:47192) 2024-05-04T00:31:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.249+0000 7f5de9667640 1 -- 172.21.15.6:0/4259482952 learned_addr learned my addr 172.21.15.6:0/4259482952 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:49.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.249+0000 7f5de9e68640 1 --2- 172.21.15.6:0/4259482952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5de40c9c60 0x7f5de41f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:49.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.249+0000 7f5dea669640 1 --2- 172.21.15.6:0/4259482952 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5de414fb90 0x7f5de40ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:49.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.253+0000 7f5de9667640 1 -- 172.21.15.6:0/4259482952 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5de414fb90 msgr2=0x7f5de40ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:49.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.253+0000 7f5de9667640 1 --2- 172.21.15.6:0/4259482952 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5de414fb90 0x7f5de40ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:49.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.253+0000 7f5de9667640 1 -- 172.21.15.6:0/4259482952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5de40c9c60 msgr2=0x7f5de41f2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:49.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.253+0000 7f5de9667640 1 --2- 172.21.15.6:0/4259482952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5de40c9c60 0x7f5de41f2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:49.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.253+0000 7f5de9667640 1 -- 172.21.15.6:0/4259482952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de41f57e0 con 0x7f5de414f780 2024-05-04T00:31:49.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.257+0000 7f5de9667640 1 --2- 172.21.15.6:0/4259482952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de414f780 0x7f5de41f52a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5dd401ccc0 tx=0x7f5dd401ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.261+0000 7f5dda7fc640 1 -- 172.21.15.6:0/4259482952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd40bc070 con 0x7f5de414f780 2024-05-04T00:31:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.261+0000 7f5dda7fc640 1 -- 172.21.15.6:0/4259482952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd40b8440 con 0x7f5de414f780 2024-05-04T00:31:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.261+0000 7f5dda7fc640 1 -- 172.21.15.6:0/4259482952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd40b8830 con 0x7f5de414f780 2024-05-04T00:31:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.261+0000 7f5dec0cc640 1 -- 172.21.15.6:0/4259482952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de414c250 con 0x7f5de414f780 2024-05-04T00:31:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.261+0000 7f5dec0cc640 1 -- 172.21.15.6:0/4259482952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de414ebc0 con 0x7f5de414f780 2024-05-04T00:31:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.261+0000 7f5dec0cc640 1 -- 172.21.15.6:0/4259482952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de4069a50 con 0x7f5de414f780 2024-05-04T00:31:49.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.289+0000 7f5dda7fc640 1 -- 172.21.15.6:0/4259482952 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5dd40bf070 con 0x7f5de414f780 2024-05-04T00:31:49.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.289+0000 7f5dda7fc640 1 --2- 172.21.15.6:0/4259482952 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f5dc806f480 0x7f5dc8071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:49.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.289+0000 7f5de9e68640 1 --2- 172.21.15.6:0/4259482952 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f5dc806f480 0x7f5dc8071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:49.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.289+0000 7f5de9e68640 1 --2- 172.21.15.6:0/4259482952 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f5dc806f480 0x7f5dc8071990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5de00098e0 tx=0x7f5de0009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:49.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.601+0000 7f5dda7fc640 1 -- 172.21.15.6:0/4259482952 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f5dd40f2390 con 0x7f5de414f780 2024-05-04T00:31:49.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.605+0000 7f5dda7fc640 1 -- 172.21.15.6:0/4259482952 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5dd4018320 con 0x7f5de414f780 2024-05-04T00:31:49.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.805+0000 7f5dec0cc640 1 -- 172.21.15.6:0/4259482952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5de40c5060 con 0x7f5de414f780 2024-05-04T00:31:49.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.877+0000 7f5dda7fc640 1 -- 172.21.15.6:0/4259482952 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+16537 (secure 0 0 0) 0x7f5de40c5060 con 0x7f5de414f780 2024-05-04T00:31:49.881 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:31:49.881 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"ad5951ed-0d5e-4770-b5d9-995e08a00213","created":"2024-05-04T00:30:11.236352+0000","modified":"2024-05-04T00:31:25.449331+0000","last_up_change":"2024-05-04T00:30:35.679943+0000","last_in_change":"2024-05-04T00:30:24.926330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T00:30:36.311072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T00:31:17.278288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T00:31:18.957819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a907d753-b7cf-499c-ae36-81e44ed933a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6805","nonce":489144503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6810","nonce":489144503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6824","nonce":489144503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6813","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6817","nonce":489144503}]},"public_addr":"172.21.15.6:6805/489144503","cluster_addr":"172.21.15.6:6810/489144503","heartbeat_back_addr":"172.21.15.6:6824/489144503","heartbeat_front_addr":"172.21.15.6:6817/489144503","state":["exists","up"]},{"osd":1,"uuid":"eab41a32-d5f1-43b8-8835-f2d4bffc9cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6802","nonce":3099957279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6807","nonce":3099957279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6819","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6823","nonce":3099957279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6815","nonce":3099957279}]},"public_addr":"172.21.15.6:6802/3099957279","cluster_addr":"172.21.15.6:6807/3099957279","heartbeat_back_addr":"172.21.15.6:6823/3099957279","heartbeat_front_addr":"172.21.15.6:6815/3099957279","state":["exists","up"]},{"osd":2,"uuid":"f2540144-b533-4ffc-a9cf-24f0e4910a9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6801","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6806","nonce":2770857903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6809","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6812","nonce":2770857903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6827","nonce":2770857903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6821","nonce":2770857903}]},"public_addr":"172.21.15.6:6806/2770857903","cluster_addr":"172.21.15.6:6812/2770857903","heartbeat_back_addr":"172.21.15.6:6827/2770857903","heartbeat_front_addr":"172.21.15.6:6821/2770857903","state":["exists","up"]},{"osd":3,"uuid":"982b7ace-fd02-4f03-aef2-0428468f8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6818","nonce":3149875909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6826","nonce":3149875909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6831","nonce":3149875909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6829","nonce":3149875909}]},"public_addr":"172.21.15.6:6818/3149875909","cluster_addr":"172.21.15.6:6826/3149875909","heartbeat_back_addr":"172.21.15.6:6831/3149875909","heartbeat_front_addr":"172.21.15.6:6829/3149875909","state":["exists","up"]},{"osd":4,"uuid":"ecf94166-cfdf-4ac8-a659-6ae907686e8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6818","nonce":2508264225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6821","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6824","nonce":2508264225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6833","nonce":2508264225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6831","nonce":2508264225}]},"public_addr":"172.21.15.163:6818/2508264225","cluster_addr":"172.21.15.163:6824/2508264225","heartbeat_back_addr":"172.21.15.163:6833/2508264225","heartbeat_front_addr":"172.21.15.163:6831/2508264225","state":["exists","up"]},{"osd":5,"uuid":"fc5cfa90-0e3a-4fc2-829c-5ff57d7a5953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6815","nonce":167619435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6820","nonce":167619435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6827","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6829","nonce":167619435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6825","nonce":167619435}]},"public_addr":"172.21.15.163:6815/167619435","cluster_addr":"172.21.15.163:6820/167619435","heartbeat_back_addr":"172.21.15.163:6829/167619435","heartbeat_front_addr":"172.21.15.163:6825/167619435","state":["exists","up"]},{"osd":6,"uuid":"ed95f0cf-f309-4861-b47c-4a5a6b44ffdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6811","nonce":1460767610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6813","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6814","nonce":1460767610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6830","nonce":1460767610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6819","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6822","nonce":1460767610}]},"public_addr":"172.21.15.163:6811/1460767610","cluster_addr":"172.21.15.163:6814/1460767610","heartbeat_back_addr":"172.21.15.163:6830/1460767610","heartbeat_front_addr":"172.21.15.163:6822/1460767610","state":["exists","up"]},{"osd":7,"uuid":"2f57afcd-567f-44f6-9db7-df0342c8c4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6803","nonce":239650691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6805","nonce":239650691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6809","nonce":239650691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6807","nonce":239650691}]},"public_addr":"172.21.15.163:6803/239650691","cluster_addr":"172.21.15.163:6805/239650691","heartbeat_back_addr":"172.21.15.163:6809/239650691","heartbeat_front_addr":"172.21.15.163:6807/239650691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.818870+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.749094+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.805522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.576430+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.740084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.755726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.797961+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.577731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T00:31:49.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.881+0000 7f5dec0cc640 1 -- 172.21.15.6:0/4259482952 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f5dc806f480 msgr2=0x7f5dc8071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:49.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.881+0000 7f5dec0cc640 1 --2- 172.21.15.6:0/4259482952 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f5dc806f480 0x7f5dc8071990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5de00098e0 tx=0x7f5de0009060 comp rx=0 tx=0).stop 2024-05-04T00:31:49.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.881+0000 7f5dec0cc640 1 -- 172.21.15.6:0/4259482952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de414f780 msgr2=0x7f5de41f52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.881+0000 7f5dec0cc640 1 --2- 172.21.15.6:0/4259482952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de414f780 0x7f5de41f52a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5dd401ccc0 tx=0x7f5dd401ce50 comp rx=0 tx=0).stop 2024-05-04T00:31:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.881+0000 7f5dec0cc640 1 -- 172.21.15.6:0/4259482952 shutdown_connections 2024-05-04T00:31:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.881+0000 7f5dec0cc640 1 --2- 172.21.15.6:0/4259482952 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f5dc806f480 0x7f5dc8071990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.881+0000 7f5dec0cc640 1 --2- 172.21.15.6:0/4259482952 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5de414fb90 0x7f5de40ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.881+0000 7f5dec0cc640 1 --2- 172.21.15.6:0/4259482952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de414f780 0x7f5de41f52a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.881+0000 7f5dec0cc640 1 --2- 172.21.15.6:0/4259482952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5de40c9c60 0x7f5de41f2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.881+0000 7f5dec0cc640 1 -- 172.21.15.6:0/4259482952 >> 172.21.15.6:0/4259482952 conn(0x7f5de4070d60 msgr2=0x7f5de4075cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.881+0000 7f5dec0cc640 1 -- 172.21.15.6:0/4259482952 shutdown_connections 2024-05-04T00:31:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:49.881+0000 7f5dec0cc640 1 -- 172.21.15.6:0/4259482952 wait complete. 2024-05-04T00:31:49.906 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T00:31:50.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.057+0000 7f8a5032a640 1 Processor -- start 2024-05-04T00:31:50.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.057+0000 7f8a5032a640 1 -- start start 2024-05-04T00:31:50.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.057+0000 7f8a5032a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8a481600c0 0x7f8a48167ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:50.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.057+0000 7f8a5032a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a480c39e0 con 0x7f8a480c8ae0 2024-05-04T00:31:50.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.057+0000 7f8a5032a640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a480c3cc0 con 0x7f8a480c8ef0 2024-05-04T00:31:50.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.057+0000 7f8a5032a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8a480c3fa0 con 0x7f8a481600c0 2024-05-04T00:31:50.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.061+0000 7f8a4d8c5640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f8a480c8ef0 0x7f8a4815f9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:43644/0 (socket says 172.21.15.6:43644) 2024-05-04T00:31:50.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.061+0000 7f8a4d8c5640 1 -- 172.21.15.6:0/1725349870 learned_addr learned my addr 172.21.15.6:0/1725349870 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.165+0000 7f8a4e8c7640 1 --2- 172.21.15.6:0/1725349870 >> v2:172.21.15.6:3300/0 conn(0x7f8a481600c0 0x7f8a48167ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:50.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.177+0000 7f8a4e8c7640 1 -- 172.21.15.6:0/1725349870 >> v1:172.21.15.163:6789/0 conn(0x7f8a480c8ef0 legacy=0x7f8a4815f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:50.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.177+0000 7f8a4e8c7640 1 -- 172.21.15.6:0/1725349870 >> v1:172.21.15.6:6789/0 conn(0x7f8a480c8ae0 legacy=0x7f8a480cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:50.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.177+0000 7f8a4e8c7640 1 -- 172.21.15.6:0/1725349870 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a480c4280 con 0x7f8a481600c0 2024-05-04T00:31:50.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.193+0000 7f8a4e8c7640 1 --2- 172.21.15.6:0/1725349870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a481600c0 0x7f8a48167ab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009d90 tx=0x7f8a4001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd9297456fffbca server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:50.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.209+0000 7f8a4d0c4640 1 -- 172.21.15.6:0/1725349870 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a400b4070 con 0x7f8a481600c0 2024-05-04T00:31:50.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.209+0000 7f8a4d0c4640 1 -- 172.21.15.6:0/1725349870 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a400af600 con 0x7f8a481600c0 2024-05-04T00:31:50.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.209+0000 7f8a4d0c4640 1 -- 172.21.15.6:0/1725349870 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a400af9d0 con 0x7f8a481600c0 2024-05-04T00:31:50.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.209+0000 7f8a5032a640 1 -- 172.21.15.6:0/1725349870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a481600c0 msgr2=0x7f8a48167ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:50.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.209+0000 7f8a5032a640 1 --2- 172.21.15.6:0/1725349870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a481600c0 0x7f8a48167ab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009d90 tx=0x7f8a4001f150 comp rx=0 tx=0).stop 2024-05-04T00:31:50.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.209+0000 7f8a5032a640 1 -- 172.21.15.6:0/1725349870 shutdown_connections 2024-05-04T00:31:50.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.209+0000 7f8a5032a640 1 --2- 172.21.15.6:0/1725349870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a481600c0 0x7f8a48167ab0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:50.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.209+0000 7f8a5032a640 1 -- 172.21.15.6:0/1725349870 >> 172.21.15.6:0/1725349870 conn(0x7f8a48070d60 msgr2=0x7f8a480711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:50.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.209+0000 7f8a5032a640 1 -- 172.21.15.6:0/1725349870 shutdown_connections 2024-05-04T00:31:50.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.209+0000 7f8a5032a640 1 -- 172.21.15.6:0/1725349870 wait complete. 2024-05-04T00:31:50.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.213+0000 7f8a5032a640 1 Processor -- start 2024-05-04T00:31:50.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.213+0000 7f8a5032a640 1 -- start start 2024-05-04T00:31:50.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.217+0000 7f8a5032a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a480c8ae0 0x7f8a480cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:50.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.217+0000 7f8a5032a640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8a480c8ef0 0x7f8a48151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:50.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.217+0000 7f8a5032a640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8a481600c0 0x7f8a48154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:50.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.217+0000 7f8a5032a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8a480c4840 con 0x7f8a480c8ae0 2024-05-04T00:31:50.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.217+0000 7f8a5032a640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8a480c9300 con 0x7f8a480c8ef0 2024-05-04T00:31:50.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.217+0000 7f8a5032a640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f8a480c49c0 con 0x7f8a481600c0 2024-05-04T00:31:50.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.217+0000 7f8a4e0c6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a480c8ae0 0x7f8a480cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:50.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.217+0000 7f8a4e0c6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a480c8ae0 0x7f8a480cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47208/0 (socket says 172.21.15.6:47208) 2024-05-04T00:31:50.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.217+0000 7f8a4e0c6640 1 -- 172.21.15.6:0/3955738286 learned_addr learned my addr 172.21.15.6:0/3955738286 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:50.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.221+0000 7f8a4e0c6640 1 -- 172.21.15.6:0/3955738286 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8a481600c0 msgr2=0x7f8a48154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:50.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.221+0000 7f8a4e0c6640 1 --2- 172.21.15.6:0/3955738286 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8a481600c0 0x7f8a48154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:50.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.221+0000 7f8a4e0c6640 1 -- 172.21.15.6:0/3955738286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8a480c8ef0 msgr2=0x7f8a48151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:50.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.221+0000 7f8a4e0c6640 1 --2- 172.21.15.6:0/3955738286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8a480c8ef0 0x7f8a48151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:50.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.221+0000 7f8a4e0c6640 1 -- 172.21.15.6:0/3955738286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a480cc0b0 con 0x7f8a480c8ae0 2024-05-04T00:31:50.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.225+0000 7f8a4e0c6640 1 --2- 172.21.15.6:0/3955738286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a480c8ae0 0x7f8a480cbb70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400c3f0 tx=0x7f8a4400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:50.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.229+0000 7f8a3effd640 1 -- 172.21.15.6:0/3955738286 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44017070 con 0x7f8a480c8ae0 2024-05-04T00:31:50.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.229+0000 7f8a3effd640 1 -- 172.21.15.6:0/3955738286 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a440052d0 con 0x7f8a480c8ae0 2024-05-04T00:31:50.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.229+0000 7f8a3effd640 1 -- 172.21.15.6:0/3955738286 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44003820 con 0x7f8a480c8ae0 2024-05-04T00:31:50.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.229+0000 7f8a5032a640 1 -- 172.21.15.6:0/3955738286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a481f3860 con 0x7f8a480c8ae0 2024-05-04T00:31:50.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.229+0000 7f8a5032a640 1 -- 172.21.15.6:0/3955738286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a481f3e20 con 0x7f8a480c8ae0 2024-05-04T00:31:50.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.233+0000 7f8a5032a640 1 -- 172.21.15.6:0/3955738286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a48069a50 con 0x7f8a480c8ae0 2024-05-04T00:31:50.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.261+0000 7f8a3effd640 1 -- 172.21.15.6:0/3955738286 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8a4401a070 con 0x7f8a480c8ae0 2024-05-04T00:31:50.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.265+0000 7f8a3effd640 1 --2- 172.21.15.6:0/3955738286 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8a2c06f450 0x7f8a2c071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:50.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.265+0000 7f8a4d8c5640 1 --2- 172.21.15.6:0/3955738286 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8a2c06f450 0x7f8a2c071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:50.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.265+0000 7f8a4d8c5640 1 --2- 172.21.15.6:0/3955738286 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8a2c06f450 0x7f8a2c071960 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8a38005890 tx=0x7f8a38007a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.569+0000 7f8a3effd640 1 -- 172.21.15.6:0/3955738286 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f8a44057200 con 0x7f8a480c8ae0 2024-05-04T00:31:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.569+0000 7f8a3effd640 1 -- 172.21.15.6:0/3955738286 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8a44021080 con 0x7f8a480c8ae0 2024-05-04T00:31:50.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.789+0000 7f8a5032a640 1 -- 172.21.15.6:0/3955738286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a48159aa0 con 0x7f8a480c8ae0 2024-05-04T00:31:50.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.813+0000 7f8a3effd640 1 -- 172.21.15.6:0/3955738286 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6850 (secure 0 0 0) 0x7f8a44005480 con 0x7f8a480c8ae0 2024-05-04T00:31:50.814 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T00:31:50.814 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4185,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/811470677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":811470677},{"type":"v1","addr":"172.21.15.6:6833","nonce":811470677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4194,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/50303985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":50303985},{"type":"v1","addr":"172.21.15.163:6839","nonce":50303985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2015777060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2015777060},{"type":"v1","addr":"172.21.15.6:6835","nonce":2015777060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T00:31:21.468790+0000","modified":"2024-05-04T00:31:36.770046+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.163:6835/428471443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":428471443},{"type":"v1","addr":"172.21.15.163:6835","nonce":428471443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"b","rank":1,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6837/1055589916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1055589916},{"type":"v1","addr":"172.21.15.163:6837","nonce":1055589916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.6:6837/639743836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":639743836},{"type":"v1","addr":"172.21.15.6:6837","nonce":639743836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-04T00:31:50.814 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 12 2024-05-04T00:31:50.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.813+0000 7f8a5032a640 1 -- 172.21.15.6:0/3955738286 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8a2c06f450 msgr2=0x7f8a2c071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:50.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.813+0000 7f8a5032a640 1 --2- 172.21.15.6:0/3955738286 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8a2c06f450 0x7f8a2c071960 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8a38005890 tx=0x7f8a38007a30 comp rx=0 tx=0).stop 2024-05-04T00:31:50.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.813+0000 7f8a5032a640 1 -- 172.21.15.6:0/3955738286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a480c8ae0 msgr2=0x7f8a480cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:50.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.813+0000 7f8a5032a640 1 --2- 172.21.15.6:0/3955738286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a480c8ae0 0x7f8a480cbb70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400c3f0 tx=0x7f8a4400c8b0 comp rx=0 tx=0).stop 2024-05-04T00:31:50.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.813+0000 7f8a5032a640 1 -- 172.21.15.6:0/3955738286 shutdown_connections 2024-05-04T00:31:50.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.813+0000 7f8a5032a640 1 --2- 172.21.15.6:0/3955738286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8a480c8ef0 0x7f8a48151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:50.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.813+0000 7f8a5032a640 1 --2- 172.21.15.6:0/3955738286 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8a2c06f450 0x7f8a2c071960 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:50.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.813+0000 7f8a5032a640 1 --2- 172.21.15.6:0/3955738286 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8a481600c0 0x7f8a48154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:50.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.813+0000 7f8a5032a640 1 --2- 172.21.15.6:0/3955738286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a480c8ae0 0x7f8a480cbb70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:50.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.813+0000 7f8a5032a640 1 -- 172.21.15.6:0/3955738286 >> 172.21.15.6:0/3955738286 conn(0x7f8a48070d60 msgr2=0x7f8a4814b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:50.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.813+0000 7f8a5032a640 1 -- 172.21.15.6:0/3955738286 shutdown_connections 2024-05-04T00:31:50.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:50.813+0000 7f8a5032a640 1 -- 172.21.15.6:0/3955738286 wait complete. 2024-05-04T00:31:51.443 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-04T00:31:21.468790+0000', 'modified': '2024-05-04T00:31:36.770046+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4276, 'mds_1': 4270, 'mds_2': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'd', 'rank': 2, 'incarnation': 11, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.163:6835/428471443', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6834', 'nonce': 428471443}, {'type': 'v1', 'addr': '172.21.15.163:6835', 'nonce': 428471443}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4270': {'gid': 4270, 'name': 'b', 'rank': 1, 'incarnation': 8, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.163:6837/1055589916', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6836', 'nonce': 1055589916}, {'type': 'v1', 'addr': '172.21.15.163:6837', 'nonce': 1055589916}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4276': {'gid': 4276, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.6:6837/639743836', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6836', 'nonce': 639743836}, {'type': 'v1', 'addr': '172.21.15.6:6837', 'nonce': 639743836}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4276, 'qdb_cluster': [4267, 4270, 4276]} 2024-05-04T00:31:51.443 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-04T00:31:51.443 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-05-04T00:31:51.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.613+0000 7f5645fcd640 1 Processor -- start 2024-05-04T00:31:51.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.613+0000 7f5645fcd640 1 -- start start 2024-05-04T00:31:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.617+0000 7f5645fcd640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f564015c480 0x7f56400c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.617+0000 7f5645fcd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f564015c890 0x7f56400c9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.617+0000 7f5645fcd640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f564015bca0 con 0x7f5640155b90 2024-05-04T00:31:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.617+0000 7f5645fcd640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f564015bff0 con 0x7f564015c890 2024-05-04T00:31:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.617+0000 7f5645fcd640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f56400cdf80 con 0x7f564015c480 2024-05-04T00:31:51.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.617+0000 7f563effd640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f564015c480 0x7f56400c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:51.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.617+0000 7f563f7fe640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f5640155b90 0x7f56400747d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:43654/0 (socket says 172.21.15.6:43654) 2024-05-04T00:31:51.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.617+0000 7f563f7fe640 1 -- 172.21.15.6:0/2478946486 learned_addr learned my addr 172.21.15.6:0/2478946486 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:51.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.633+0000 7f563effd640 1 -- 172.21.15.6:0/2478946486 >> v2:172.21.15.6:3300/0 conn(0x7f564015c890 msgr2=0x7f56400c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:51.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.633+0000 7f563effd640 1 --2- 172.21.15.6:0/2478946486 >> v2:172.21.15.6:3300/0 conn(0x7f564015c890 0x7f56400c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:51.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.633+0000 7f563effd640 1 -- 172.21.15.6:0/2478946486 >> v1:172.21.15.163:6789/0 conn(0x7f5640155b90 legacy=0x7f56400747d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:51.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.633+0000 7f563effd640 1 -- 172.21.15.6:0/2478946486 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56400ce260 con 0x7f564015c480 2024-05-04T00:31:51.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.645+0000 7f563effd640 1 --2- 172.21.15.6:0/2478946486 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f564015c480 0x7f56400c93d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f564015c170 tx=0x7f5634020020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b94b4a6496d7b9ce server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:51.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.665+0000 7f563e7fc640 1 -- 172.21.15.6:0/2478946486 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56340b6070 con 0x7f564015c480 2024-05-04T00:31:51.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.665+0000 7f563e7fc640 1 -- 172.21.15.6:0/2478946486 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56340a9e30 con 0x7f564015c480 2024-05-04T00:31:51.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.665+0000 7f563e7fc640 1 -- 172.21.15.6:0/2478946486 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563400b040 con 0x7f564015c480 2024-05-04T00:31:51.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.665+0000 7f5645fcd640 1 -- 172.21.15.6:0/2478946486 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f564015c480 msgr2=0x7f56400c93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:51.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.665+0000 7f5645fcd640 1 --2- 172.21.15.6:0/2478946486 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f564015c480 0x7f56400c93d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f564015c170 tx=0x7f5634020020 comp rx=0 tx=0).stop 2024-05-04T00:31:51.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.665+0000 7f5645fcd640 1 -- 172.21.15.6:0/2478946486 shutdown_connections 2024-05-04T00:31:51.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.665+0000 7f5645fcd640 1 --2- 172.21.15.6:0/2478946486 >> v2:172.21.15.6:3300/0 conn(0x7f564015c890 0x7f56400c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:51.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.665+0000 7f5645fcd640 1 --2- 172.21.15.6:0/2478946486 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f564015c480 0x7f56400c93d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:51.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.665+0000 7f5645fcd640 1 -- 172.21.15.6:0/2478946486 >> 172.21.15.6:0/2478946486 conn(0x7f5640070d60 msgr2=0x7f56400711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:51.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.665+0000 7f5645fcd640 1 -- 172.21.15.6:0/2478946486 shutdown_connections 2024-05-04T00:31:51.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.665+0000 7f5645fcd640 1 -- 172.21.15.6:0/2478946486 wait complete. 2024-05-04T00:31:51.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.669+0000 7f5645fcd640 1 Processor -- start 2024-05-04T00:31:51.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.669+0000 7f5645fcd640 1 -- start start 2024-05-04T00:31:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.669+0000 7f5645fcd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5640155b90 0x7f56401f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.669+0000 7f5645fcd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f564015c480 0x7f56400c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.669+0000 7f5645fcd640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f564015c890 0x7f564014f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.669+0000 7f5645fcd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5640158730 con 0x7f564015c480 2024-05-04T00:31:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.669+0000 7f5645fcd640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f56400ce820 con 0x7f564015c890 2024-05-04T00:31:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.669+0000 7f5645fcd640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f56401588b0 con 0x7f5640155b90 2024-05-04T00:31:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.669+0000 7f563effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f564015c480 0x7f56400c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.669+0000 7f563effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f564015c480 0x7f56400c45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47220/0 (socket says 172.21.15.6:47220) 2024-05-04T00:31:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.669+0000 7f563effd640 1 -- 172.21.15.6:0/3655494356 learned_addr learned my addr 172.21.15.6:0/3655494356 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.669+0000 7f563f7fe640 1 --2- 172.21.15.6:0/3655494356 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5640155b90 0x7f56401f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.673+0000 7f563effd640 1 -- 172.21.15.6:0/3655494356 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5640155b90 msgr2=0x7f56401f0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.673+0000 7f563effd640 1 --2- 172.21.15.6:0/3655494356 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5640155b90 0x7f56401f0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.673+0000 7f563effd640 1 -- 172.21.15.6:0/3655494356 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f564015c890 msgr2=0x7f564014f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.673+0000 7f563effd640 1 --2- 172.21.15.6:0/3655494356 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f564015c890 0x7f564014f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:51.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.673+0000 7f563effd640 1 -- 172.21.15.6:0/3655494356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56401f14c0 con 0x7f564015c480 2024-05-04T00:31:51.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.677+0000 7f563effd640 1 --2- 172.21.15.6:0/3655494356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f564015c480 0x7f56400c45e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f563401cc30 tx=0x7f563401cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:51.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.681+0000 7f5627fff640 1 -- 172.21.15.6:0/3655494356 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56340b6040 con 0x7f564015c480 2024-05-04T00:31:51.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.681+0000 7f5627fff640 1 -- 172.21.15.6:0/3655494356 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56340bf070 con 0x7f564015c480 2024-05-04T00:31:51.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.681+0000 7f5645fcd640 1 -- 172.21.15.6:0/3655494356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5640157d30 con 0x7f564015c480 2024-05-04T00:31:51.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.681+0000 7f5627fff640 1 -- 172.21.15.6:0/3655494356 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56340ba3f0 con 0x7f564015c480 2024-05-04T00:31:51.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.681+0000 7f5645fcd640 1 -- 172.21.15.6:0/3655494356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56401582f0 con 0x7f564015c480 2024-05-04T00:31:51.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.685+0000 7f564d32b000 1 Processor -- start 2024-05-04T00:31:51.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.685+0000 7f564d32b000 1 -- start start 2024-05-04T00:31:51.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.689+0000 7f564d32b000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f1047c0 0x55f17f5f9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:51.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.689+0000 7f564d32b000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f4ecf80 0x55f17f5fa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:51.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.689+0000 7f564d32b000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4d66b0 0x55f17f6356b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:51.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.689+0000 7f564d32b000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f17f4db620 con 0x55f17f4d66b0 2024-05-04T00:31:51.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.689+0000 7f564d32b000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55f17f3f6740 con 0x55f17f4ecf80 2024-05-04T00:31:51.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.689+0000 7f564d32b000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55f17f444090 con 0x55f17f1047c0 2024-05-04T00:31:51.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.689+0000 7f563f7fe640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f4ecf80 0x55f17f5fa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:51.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.689+0000 7f563f7fe640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f4ecf80 0x55f17f5fa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:43810/0 (socket says 172.21.15.6:43810) 2024-05-04T00:31:51.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.689+0000 7f563f7fe640 1 -- 172.21.15.6:0/1747975078 learned_addr learned my addr 172.21.15.6:0/1747975078 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:51.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.693+0000 7f563ffff640 1 --2- 172.21.15.6:0/1747975078 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f1047c0 0x55f17f5f9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:51.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.697+0000 7f563f7fe640 1 -- 172.21.15.6:0/1747975078 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f1047c0 msgr2=0x55f17f5f9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:51.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.697+0000 7f563f7fe640 1 --2- 172.21.15.6:0/1747975078 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f1047c0 0x55f17f5f9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:51.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.697+0000 7f563f7fe640 1 -- 172.21.15.6:0/1747975078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4d66b0 msgr2=0x55f17f6356b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:51.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.697+0000 7f563f7fe640 1 --2- 172.21.15.6:0/1747975078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4d66b0 0x55f17f6356b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:51.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.697+0000 7f563f7fe640 1 -- 172.21.15.6:0/1747975078 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f17f5d80a0 con 0x55f17f4ecf80 2024-05-04T00:31:51.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.705+0000 7f563f7fe640 1 --2- 172.21.15.6:0/1747975078 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f4ecf80 0x55f17f5fa4d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f56300018a0 tx=0x7f5630007eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f91feeccda71bfef server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:51.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.709+0000 7f5627fff640 1 -- 172.21.15.6:0/3655494356 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f56340ba590 con 0x7f564015c480 2024-05-04T00:31:51.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.709+0000 7f5627fff640 1 --2- 172.21.15.6:0/3655494356 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f562c06f480 0x7f562c071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:51.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.709+0000 7f563ffff640 1 --2- 172.21.15.6:0/3655494356 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f562c06f480 0x7f562c071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.709+0000 7f563ffff640 1 --2- 172.21.15.6:0/3655494356 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f562c06f480 0x7f562c071990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f56400c4f90 tx=0x7f563800d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:51.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.713+0000 7f5627fff640 1 -- 172.21.15.6:0/3655494356 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f56340f5440 con 0x7f564015c480 2024-05-04T00:31:51.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.717+0000 7f56257fa640 1 -- 172.21.15.6:0/1747975078 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630005ad0 con 0x55f17f4ecf80 2024-05-04T00:31:51.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.717+0000 7f56257fa640 1 -- 172.21.15.6:0/1747975078 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5630018070 con 0x55f17f4ecf80 2024-05-04T00:31:51.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.717+0000 7f56257fa640 1 -- 172.21.15.6:0/1747975078 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563000f870 con 0x55f17f4ecf80 2024-05-04T00:31:51.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.717+0000 7f564d32b000 1 -- 172.21.15.6:0/1747975078 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f4ecf80 msgr2=0x55f17f5fa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:51.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.717+0000 7f564d32b000 1 --2- 172.21.15.6:0/1747975078 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f4ecf80 0x55f17f5fa4d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f56300018a0 tx=0x7f5630007eb0 comp rx=0 tx=0).stop 2024-05-04T00:31:51.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.717+0000 7f564d32b000 1 -- 172.21.15.6:0/1747975078 shutdown_connections 2024-05-04T00:31:51.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.717+0000 7f564d32b000 1 --2- 172.21.15.6:0/1747975078 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f4ecf80 0x55f17f5fa4d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:51.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.717+0000 7f564d32b000 1 --2- 172.21.15.6:0/1747975078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4d66b0 0x55f17f6356b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:51.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.717+0000 7f564d32b000 1 --2- 172.21.15.6:0/1747975078 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f1047c0 0x55f17f5f9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:51.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.717+0000 7f564d32b000 1 -- 172.21.15.6:0/1747975078 >> 172.21.15.6:0/1747975078 conn(0x55f17f5c3340 msgr2=0x55f17f633470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:51.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.717+0000 7f564d32b000 1 -- 172.21.15.6:0/1747975078 shutdown_connections 2024-05-04T00:31:51.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.717+0000 7f564d32b000 1 -- 172.21.15.6:0/1747975078 wait complete. 2024-05-04T00:31:51.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.717+0000 7f564d32b000 1 -- start start 2024-05-04T00:31:51.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.717+0000 7f564d32b000 1 Processor -- start 2024-05-04T00:31:51.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.721+0000 7f564d32b000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f1047c0 0x55f17f6499d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:51.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.721+0000 7f564d32b000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f4d66b0 0x55f17f649f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:51.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.721+0000 7f564d32b000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4ecf80 0x55f17f5f7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:51.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.721+0000 7f564d32b000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f17f440050 con 0x55f17f4ecf80 2024-05-04T00:31:51.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.721+0000 7f564d32b000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55f17f3fcec0 con 0x55f17f1047c0 2024-05-04T00:31:51.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.721+0000 7f564d32b000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55f17f3e3c90 con 0x55f17f4d66b0 2024-05-04T00:31:51.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.721+0000 7f564d32b000 10 client.0 _ll_register_callbacks cb 0x55f17f5dfe60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-04T00:31:51.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.721+0000 7f563f7fe640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f1047c0 0x55f17f6499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:51.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.721+0000 7f563ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4ecf80 0x55f17f5f7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:51.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.721+0000 7f563effd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f4d66b0 0x55f17f649f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:51.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.721+0000 7f563ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4ecf80 0x55f17f5f7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47250/0 (socket says 172.21.15.6:47250) 2024-05-04T00:31:51.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.721+0000 7f563ffff640 1 -- 172.21.15.6:0/1051982872 learned_addr learned my addr 172.21.15.6:0/1051982872 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:51.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.729+0000 7f563ffff640 1 -- 172.21.15.6:0/1051982872 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f4d66b0 msgr2=0x55f17f649f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:51.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.729+0000 7f563ffff640 1 --2- 172.21.15.6:0/1051982872 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f4d66b0 0x55f17f649f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:51.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.729+0000 7f563ffff640 1 -- 172.21.15.6:0/1051982872 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f1047c0 msgr2=0x55f17f6499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:51.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.729+0000 7f563ffff640 1 --2- 172.21.15.6:0/1051982872 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f1047c0 0x55f17f6499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:51.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.729+0000 7f563ffff640 1 -- 172.21.15.6:0/1051982872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f17f4ee6f0 con 0x55f17f4ecf80 2024-05-04T00:31:51.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.729+0000 7f563ffff640 1 --2- 172.21.15.6:0/1051982872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4ecf80 0x55f17f5f7980 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5638016d50 tx=0x7f5638004b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b16e4cfcbb9f1c server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:51.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.729+0000 7f561e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-04T00:31:51.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.733+0000 7f561e7fc640 1 -- 172.21.15.6:0/1051982872 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638025060 con 0x55f17f4ecf80 2024-05-04T00:31:51.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.733+0000 7f561e7fc640 1 -- 172.21.15.6:0/1051982872 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f56380205f0 con 0x55f17f4ecf80 2024-05-04T00:31:51.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.733+0000 7f564d32b000 1 -- 172.21.15.6:0/1051982872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5630018070 con 0x55f17f4ecf80 2024-05-04T00:31:51.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.737+0000 7f561e7fc640 1 -- 172.21.15.6:0/1051982872 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f563802b050 con 0x55f17f4ecf80 2024-05-04T00:31:51.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.737+0000 7f564d32b000 10 client.4395 fetch_fsmap learned FSMap version 12 2024-05-04T00:31:51.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.737+0000 7f564d32b000 1 -- 172.21.15.6:0/1051982872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x55f17f4ea6a0 con 0x55f17f4ecf80 2024-05-04T00:31:51.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.745+0000 7f561e7fc640 1 -- 172.21.15.6:0/1051982872 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5630018070 con 0x55f17f4ecf80 2024-05-04T00:31:51.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.745+0000 7f561e7fc640 1 -- 172.21.15.6:0/1051982872 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 12) ==== 4744+0+0 (secure 0 0 0) 0x7f563802e020 con 0x55f17f4ecf80 2024-05-04T00:31:51.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.745+0000 7f564d32b000 10 client.4395 fetch_fsmap finished waiting for FSMap version 12 2024-05-04T00:31:51.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.745+0000 7f564d32b000 10 client.4395 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-04T00:31:51.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.745+0000 7f564d32b000 20 client.4395 populate_metadata read hostname 'smithi006' 2024-05-04T00:31:51.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.745+0000 7f564d32b000 1 --2- 172.21.15.6:0/1051982872 >> [v2:172.21.15.163:6834/428471443,v1:172.21.15.163:6835/428471443] conn(0x55f17f0e97d0 0x55f17f5f8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:51.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.745+0000 7f564d32b000 4 client.4395 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-04T00:31:51.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.745+0000 7f564d32b000 1 -- 172.21.15.6:0/1051982872 --> [v2:172.21.15.163:6834/428471443,v1:172.21.15.163:6835/428471443] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f17f3dcbe0 con 0x55f17f0e97d0 2024-05-04T00:31:51.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.769+0000 7f563f7fe640 1 --2- 172.21.15.6:0/1051982872 >> [v2:172.21.15.163:6834/428471443,v1:172.21.15.163:6835/428471443] conn(0x55f17f0e97d0 0x55f17f5f8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:51.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.969+0000 7f563f7fe640 1 --2- 172.21.15.6:0/1051982872 >> [v2:172.21.15.163:6834/428471443,v1:172.21.15.163:6835/428471443] conn(0x55f17f0e97d0 0x55f17f5f8630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4f801663067c79c3 server_cookie=a90b47d123057000 in_seq=0 out_seq=0 2024-05-04T00:31:51.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:51.969+0000 7f561e7fc640 10 client.4395 ms_handle_connect on v2:172.21.15.163:6834/428471443 2024-05-04T00:31:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.197+0000 7f561e7fc640 1 -- 172.21.15.6:0/1051982872 <== mds.2 v2:172.21.15.163:6834/428471443 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f17f3dcbe0 con 0x55f17f0e97d0 2024-05-04T00:31:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.197+0000 7f561e7fc640 10 client.4395 handle_command_reply: tid=0 2024-05-04T00:31:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.197+0000 7f564d32b000 1 client.4395 shutdown 2024-05-04T00:31:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.197+0000 7f564d32b000 1 -- 172.21.15.6:0/1051982872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4ecf80 msgr2=0x55f17f5f7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.197+0000 7f564d32b000 1 --2- 172.21.15.6:0/1051982872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4ecf80 0x55f17f5f7980 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5638016d50 tx=0x7f5638004b30 comp rx=0 tx=0).stop 2024-05-04T00:31:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.197+0000 7f564d32b000 1 -- 172.21.15.6:0/1051982872 shutdown_connections 2024-05-04T00:31:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.197+0000 7f564d32b000 1 --2- 172.21.15.6:0/1051982872 >> [v2:172.21.15.163:6834/428471443,v1:172.21.15.163:6835/428471443] conn(0x55f17f0e97d0 0x55f17f5f8630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.197+0000 7f564d32b000 1 --2- 172.21.15.6:0/1051982872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4ecf80 0x55f17f5f7980 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.197+0000 7f564d32b000 1 --2- 172.21.15.6:0/1051982872 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f4d66b0 0x55f17f649f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.197+0000 7f564d32b000 1 --2- 172.21.15.6:0/1051982872 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f1047c0 0x55f17f6499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.197+0000 7f564d32b000 1 -- 172.21.15.6:0/1051982872 >> 172.21.15.6:0/1051982872 conn(0x55f17f5c3340 msgr2=0x55f17f631e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.197+0000 7f561e7fc640 0 client.4395 ms_handle_reset on v2:172.21.15.163:6834/428471443 2024-05-04T00:31:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.197+0000 7f564d32b000 1 -- 172.21.15.6:0/1051982872 shutdown_connections 2024-05-04T00:31:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.197+0000 7f564d32b000 1 -- 172.21.15.6:0/1051982872 wait complete. 2024-05-04T00:31:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.197+0000 7f564d32b000 20 client.4395 trim_cache size 0 max 16384 2024-05-04T00:31:52.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.249+0000 7f564d32b000 1 Processor -- start 2024-05-04T00:31:52.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.249+0000 7f564d32b000 1 -- start start 2024-05-04T00:31:52.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.249+0000 7f564d32b000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f1047c0 0x55f17f659d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.249+0000 7f564d32b000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4d66b0 0x55f17f5f32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.249+0000 7f564d32b000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f4ecf80 0x55f17f5f3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.249+0000 7f564d32b000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f56401f4a30 con 0x55f17f4d66b0 2024-05-04T00:31:52.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.249+0000 7f564d32b000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55f17f451490 con 0x55f17f1047c0 2024-05-04T00:31:52.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.249+0000 7f564d32b000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55f17f4433a0 con 0x55f17f4ecf80 2024-05-04T00:31:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.253+0000 7f563effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4d66b0 0x55f17f5f32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.253+0000 7f563ffff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f4ecf80 0x55f17f5f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.253+0000 7f563f7fe640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f1047c0 0x55f17f659d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.253+0000 7f563effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4d66b0 0x55f17f5f32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47252/0 (socket says 172.21.15.6:47252) 2024-05-04T00:31:52.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.253+0000 7f563effd640 1 -- 172.21.15.6:0/3905903940 learned_addr learned my addr 172.21.15.6:0/3905903940 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:52.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.257+0000 7f563effd640 1 -- 172.21.15.6:0/3905903940 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f4ecf80 msgr2=0x55f17f5f3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:52.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.257+0000 7f563effd640 1 --2- 172.21.15.6:0/3905903940 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f4ecf80 0x55f17f5f3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.257+0000 7f563effd640 1 -- 172.21.15.6:0/3905903940 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f1047c0 msgr2=0x55f17f659d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:52.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.257+0000 7f563effd640 1 --2- 172.21.15.6:0/3905903940 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f1047c0 0x55f17f659d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.257+0000 7f563effd640 1 -- 172.21.15.6:0/3905903940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f17f41daf0 con 0x55f17f4d66b0 2024-05-04T00:31:52.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.261+0000 7f563effd640 1 --2- 172.21.15.6:0/3905903940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4d66b0 0x55f17f5f32e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f563409c950 tx=0x7f5634008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874cdd52f17bc952 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:52.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.269+0000 7f5624ff9640 1 -- 172.21.15.6:0/3905903940 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5634101cf0 con 0x55f17f4d66b0 2024-05-04T00:31:52.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.269+0000 7f5624ff9640 1 -- 172.21.15.6:0/3905903940 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5634000e50 con 0x55f17f4d66b0 2024-05-04T00:31:52.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.269+0000 7f5624ff9640 1 -- 172.21.15.6:0/3905903940 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56340f8630 con 0x55f17f4d66b0 2024-05-04T00:31:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.269+0000 7f564d32b000 1 -- 172.21.15.6:0/3905903940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4d66b0 msgr2=0x55f17f5f32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.269+0000 7f564d32b000 1 --2- 172.21.15.6:0/3905903940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4d66b0 0x55f17f5f32e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f563409c950 tx=0x7f5634008040 comp rx=0 tx=0).stop 2024-05-04T00:31:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.269+0000 7f564d32b000 1 -- 172.21.15.6:0/3905903940 shutdown_connections 2024-05-04T00:31:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.269+0000 7f564d32b000 1 --2- 172.21.15.6:0/3905903940 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f4ecf80 0x55f17f5f3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.269+0000 7f564d32b000 1 --2- 172.21.15.6:0/3905903940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4d66b0 0x55f17f5f32e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.269+0000 7f564d32b000 1 --2- 172.21.15.6:0/3905903940 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f1047c0 0x55f17f659d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.269+0000 7f564d32b000 1 -- 172.21.15.6:0/3905903940 >> 172.21.15.6:0/3905903940 conn(0x55f17f5c3340 msgr2=0x55f17f62fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.269+0000 7f564d32b000 1 -- 172.21.15.6:0/3905903940 shutdown_connections 2024-05-04T00:31:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.269+0000 7f564d32b000 1 -- 172.21.15.6:0/3905903940 wait complete. 2024-05-04T00:31:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.269+0000 7f564d32b000 1 -- start start 2024-05-04T00:31:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.269+0000 7f564d32b000 1 Processor -- start 2024-05-04T00:31:52.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.273+0000 7f564d32b000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f1047c0 0x55f17f64fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.273+0000 7f564d32b000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f4d66b0 0x55f17f659b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.273+0000 7f564d32b000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4ecf80 0x55f17f65a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.273+0000 7f564d32b000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f17f3de220 con 0x55f17f4ecf80 2024-05-04T00:31:52.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.273+0000 7f564d32b000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55f17f44dc30 con 0x55f17f1047c0 2024-05-04T00:31:52.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.273+0000 7f564d32b000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55f17f64a450 con 0x55f17f4d66b0 2024-05-04T00:31:52.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.273+0000 7f564d32b000 10 client.0 _ll_register_callbacks cb 0x7f5638009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-04T00:31:52.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.273+0000 7f563ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4ecf80 0x55f17f65a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.273+0000 7f563ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4ecf80 0x55f17f65a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47262/0 (socket says 172.21.15.6:47262) 2024-05-04T00:31:52.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.273+0000 7f563ffff640 1 -- 172.21.15.6:0/51815439 learned_addr learned my addr 172.21.15.6:0/51815439 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:52.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.273+0000 7f563f7fe640 1 --2- 172.21.15.6:0/51815439 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f1047c0 0x55f17f64fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.273+0000 7f563effd640 1 --2- 172.21.15.6:0/51815439 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f4d66b0 0x55f17f659b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.277+0000 7f563ffff640 1 -- 172.21.15.6:0/51815439 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f4d66b0 msgr2=0x55f17f659b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:52.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.277+0000 7f563ffff640 1 --2- 172.21.15.6:0/51815439 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f4d66b0 0x55f17f659b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.277+0000 7f563ffff640 1 -- 172.21.15.6:0/51815439 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f1047c0 msgr2=0x55f17f64fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:52.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.277+0000 7f563ffff640 1 --2- 172.21.15.6:0/51815439 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f1047c0 0x55f17f64fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.277+0000 7f563ffff640 1 -- 172.21.15.6:0/51815439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f17f41ce40 con 0x55f17f4ecf80 2024-05-04T00:31:52.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.281+0000 7f563ffff640 1 --2- 172.21.15.6:0/51815439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4ecf80 0x55f17f65a0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5638016d50 tx=0x7f5638016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1390156c643b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:52.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.281+0000 7f561e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-04T00:31:52.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.285+0000 7f561e7fc640 1 -- 172.21.15.6:0/51815439 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638020800 con 0x55f17f4ecf80 2024-05-04T00:31:52.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.285+0000 7f561e7fc640 1 -- 172.21.15.6:0/51815439 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f5638039b30 con 0x55f17f4ecf80 2024-05-04T00:31:52.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.285+0000 7f564d32b000 1 -- 172.21.15.6:0/51815439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5634000e50 con 0x55f17f4ecf80 2024-05-04T00:31:52.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.289+0000 7f561e7fc640 1 -- 172.21.15.6:0/51815439 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f5638039d30 con 0x55f17f4ecf80 2024-05-04T00:31:52.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.289+0000 7f564d32b000 10 client.4401 fetch_fsmap learned FSMap version 12 2024-05-04T00:31:52.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.289+0000 7f564d32b000 1 -- 172.21.15.6:0/51815439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x55f17f4c44e0 con 0x55f17f4ecf80 2024-05-04T00:31:52.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.293+0000 7f561e7fc640 1 -- 172.21.15.6:0/51815439 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5634000e50 con 0x55f17f4ecf80 2024-05-04T00:31:52.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.293+0000 7f561e7fc640 1 -- 172.21.15.6:0/51815439 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 12) ==== 4744+0+0 (secure 0 0 0) 0x7f563802e040 con 0x55f17f4ecf80 2024-05-04T00:31:52.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.293+0000 7f564d32b000 10 client.4401 fetch_fsmap finished waiting for FSMap version 12 2024-05-04T00:31:52.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.293+0000 7f564d32b000 10 client.4401 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-04T00:31:52.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.293+0000 7f564d32b000 20 client.4401 populate_metadata read hostname 'smithi006' 2024-05-04T00:31:52.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.293+0000 7f564d32b000 1 --2- 172.21.15.6:0/51815439 >> [v2:172.21.15.163:6834/428471443,v1:172.21.15.163:6835/428471443] conn(0x55f17f0d7830 0x55f17f6bd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.293+0000 7f564d32b000 4 client.4401 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-04T00:31:52.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.293+0000 7f564d32b000 1 -- 172.21.15.6:0/51815439 --> [v2:172.21.15.163:6834/428471443,v1:172.21.15.163:6835/428471443] -- command(tid 0: {"prefix": "status"}) -- 0x55f17f451ca0 con 0x55f17f0d7830 2024-05-04T00:31:52.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.293+0000 7f563f7fe640 1 --2- 172.21.15.6:0/51815439 >> [v2:172.21.15.163:6834/428471443,v1:172.21.15.163:6835/428471443] conn(0x55f17f0d7830 0x55f17f6bd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.305+0000 7f561e7fc640 10 client.4401 ms_handle_connect on v2:172.21.15.163:6834/428471443 2024-05-04T00:31:52.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.305+0000 7f563f7fe640 1 --2- 172.21.15.6:0/51815439 >> [v2:172.21.15.163:6834/428471443,v1:172.21.15.163:6835/428471443] conn(0x55f17f0d7830 0x55f17f6bd910 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1a2e5aebc9ed68ba server_cookie=97d107cf596dd7c0 in_seq=0 out_seq=0 2024-05-04T00:31:52.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.329+0000 7f561e7fc640 1 -- 172.21.15.6:0/51815439 <== mds.2 v2:172.21.15.163:6834/428471443 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55f17f451ca0 con 0x55f17f0d7830 2024-05-04T00:31:52.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.329+0000 7f561e7fc640 10 client.4401 handle_command_reply: tid=0 2024-05-04T00:31:52.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.329+0000 7f564d32b000 1 client.4401 shutdown 2024-05-04T00:31:52.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.329+0000 7f564d32b000 1 -- 172.21.15.6:0/51815439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4ecf80 msgr2=0x55f17f65a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:52.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.329+0000 7f564d32b000 1 --2- 172.21.15.6:0/51815439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4ecf80 0x55f17f65a0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5638016d50 tx=0x7f5638016000 comp rx=0 tx=0).stop 2024-05-04T00:31:52.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.329+0000 7f564d32b000 1 -- 172.21.15.6:0/51815439 shutdown_connections 2024-05-04T00:31:52.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.329+0000 7f564d32b000 1 --2- 172.21.15.6:0/51815439 >> [v2:172.21.15.163:6834/428471443,v1:172.21.15.163:6835/428471443] conn(0x55f17f0d7830 0x55f17f6bd910 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.329+0000 7f564d32b000 1 --2- 172.21.15.6:0/51815439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f17f4ecf80 0x55f17f65a0a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.333+0000 7f564d32b000 1 --2- 172.21.15.6:0/51815439 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55f17f4d66b0 0x55f17f659b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.333+0000 7f564d32b000 1 --2- 172.21.15.6:0/51815439 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f17f1047c0 0x55f17f64fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.333+0000 7f564d32b000 1 -- 172.21.15.6:0/51815439 >> 172.21.15.6:0/51815439 conn(0x55f17f5c3340 msgr2=0x55f17f5f7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:52.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.333+0000 7f561e7fc640 0 client.4401 ms_handle_reset on v2:172.21.15.163:6834/428471443 2024-05-04T00:31:52.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.333+0000 7f564d32b000 1 -- 172.21.15.6:0/51815439 shutdown_connections 2024-05-04T00:31:52.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.333+0000 7f564d32b000 1 -- 172.21.15.6:0/51815439 wait complete. 2024-05-04T00:31:52.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.333+0000 7f564d32b000 20 client.4401 trim_cache size 0 max 16384 2024-05-04T00:31:52.335 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-04T00:31:52.336 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "ad5951ed-0d5e-4770-b5d9-995e08a00213", 2024-05-04T00:31:52.336 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 2, 2024-05-04T00:31:52.336 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4267, 2024-05-04T00:31:52.336 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-04T00:31:52.336 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-04T00:31:52.336 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-04T00:31:52.336 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 18.592966965999999, 2024-05-04T00:31:52.336 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 12, 2024-05-04T00:31:52.336 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 26, 2024-05-04T00:31:52.336 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 26, 2024-05-04T00:31:52.336 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 48.494412969999999 2024-05-04T00:31:52.336 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-04T00:31:52.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.333+0000 7f5645fcd640 1 -- 172.21.15.6:0/3655494356 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f562c06f480 msgr2=0x7f562c071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:52.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.333+0000 7f5645fcd640 1 --2- 172.21.15.6:0/3655494356 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f562c06f480 0x7f562c071990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f56400c4f90 tx=0x7f563800d040 comp rx=0 tx=0).stop 2024-05-04T00:31:52.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.333+0000 7f5645fcd640 1 -- 172.21.15.6:0/3655494356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f564015c480 msgr2=0x7f56400c45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:52.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.333+0000 7f5645fcd640 1 --2- 172.21.15.6:0/3655494356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f564015c480 0x7f56400c45e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f563401cc30 tx=0x7f563401cdc0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.333+0000 7f5645fcd640 1 -- 172.21.15.6:0/3655494356 shutdown_connections 2024-05-04T00:31:52.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.333+0000 7f5645fcd640 1 --2- 172.21.15.6:0/3655494356 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f564015c890 0x7f564014f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.333+0000 7f5645fcd640 1 --2- 172.21.15.6:0/3655494356 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f562c06f480 0x7f562c071990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.333+0000 7f5645fcd640 1 --2- 172.21.15.6:0/3655494356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f564015c480 0x7f56400c45e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.333+0000 7f5645fcd640 1 --2- 172.21.15.6:0/3655494356 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5640155b90 0x7f56401f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.333+0000 7f5645fcd640 1 -- 172.21.15.6:0/3655494356 >> 172.21.15.6:0/3655494356 conn(0x7f5640070d60 msgr2=0x7f56400ca5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:52.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.333+0000 7f5645fcd640 1 -- 172.21.15.6:0/3655494356 shutdown_connections 2024-05-04T00:31:52.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.333+0000 7f5645fcd640 1 -- 172.21.15.6:0/3655494356 wait complete. 2024-05-04T00:31:52.365 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-04T00:31:52.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.525+0000 7f86c591f640 1 Processor -- start 2024-05-04T00:31:52.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.525+0000 7f86c591f640 1 -- start start 2024-05-04T00:31:52.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.525+0000 7f86c591f640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f86c015ce00 0x7f86c01646b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.525+0000 7f86c591f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c00c7d70 con 0x7f86c01599c0 2024-05-04T00:31:52.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.525+0000 7f86c591f640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c00c8050 con 0x7f86c015c9f0 2024-05-04T00:31:52.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.525+0000 7f86c591f640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f86c015d210 con 0x7f86c015ce00 2024-05-04T00:31:52.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.529+0000 7f86beffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f86c01599c0 0x7f86c00c8d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39638/0 (socket says 172.21.15.6:39638) 2024-05-04T00:31:52.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.529+0000 7f86beffd640 1 -- 172.21.15.6:0/1697935497 learned_addr learned my addr 172.21.15.6:0/1697935497 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:52.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.529+0000 7f86bf7fe640 1 --2- 172.21.15.6:0/1697935497 >> v2:172.21.15.163:3300/0 conn(0x7f86c015ce00 0x7f86c01646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.533+0000 7f86bdffb640 1 -- 172.21.15.6:0/1697935497 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2776485094 0 0) 0x7f86c00c7d70 con 0x7f86c01599c0 2024-05-04T00:31:52.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.533+0000 7f86bdffb640 1 -- 172.21.15.6:0/1697935497 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86a8003530 con 0x7f86c01599c0 2024-05-04T00:31:52.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.537+0000 7f86bdffb640 1 -- 172.21.15.6:0/1697935497 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4095278964 0 0) 0x7f86a8003530 con 0x7f86c01599c0 2024-05-04T00:31:52.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.537+0000 7f86bdffb640 1 -- 172.21.15.6:0/1697935497 >> v2:172.21.15.163:3300/0 conn(0x7f86c015ce00 msgr2=0x7f86c01646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:52.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.537+0000 7f86bdffb640 1 --2- 172.21.15.6:0/1697935497 >> v2:172.21.15.163:3300/0 conn(0x7f86c015ce00 0x7f86c01646b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.537+0000 7f86bdffb640 1 -- 172.21.15.6:0/1697935497 >> v1:172.21.15.163:6789/0 conn(0x7f86c015c9f0 legacy=0x7f86c0070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:52.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.537+0000 7f86bdffb640 1 -- 172.21.15.6:0/1697935497 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c00c8330 con 0x7f86c01599c0 2024-05-04T00:31:52.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.537+0000 7f86bdffb640 1 -- 172.21.15.6:0/1697935497 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 557976392 0 0) 0x7f86b8001c00 con 0x7f86c01599c0 2024-05-04T00:31:52.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.537+0000 7f86bdffb640 1 -- 172.21.15.6:0/1697935497 >> v1:172.21.15.6:6789/0 conn(0x7f86c01599c0 legacy=0x7f86c00c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:52.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.537+0000 7f86bdffb640 1 --2- 172.21.15.6:0/1697935497 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86a8003ab0 0x7f86a8003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.537+0000 7f86bdffb640 1 --2- 172.21.15.6:0/1697935497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86a8004810 0x7f86a8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.537+0000 7f86bdffb640 1 --2- 172.21.15.6:0/1697935497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86a80052b0 0x7f86a800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.537+0000 7f86bdffb640 1 -- 172.21.15.6:0/1697935497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f86c015d210 con 0x7f86a80052b0 2024-05-04T00:31:52.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.537+0000 7f86bdffb640 1 -- 172.21.15.6:0/1697935497 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f86a800c240 con 0x7f86a8004810 2024-05-04T00:31:52.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.537+0000 7f86bdffb640 1 -- 172.21.15.6:0/1697935497 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f86a800c440 con 0x7f86a8003ab0 2024-05-04T00:31:52.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.537+0000 7f86beffd640 1 --2- 172.21.15.6:0/1697935497 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86a8003ab0 0x7f86a8003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.541+0000 7f86bf7fe640 1 --2- 172.21.15.6:0/1697935497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86a80052b0 0x7f86a800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.545+0000 7f86bf7fe640 1 -- 172.21.15.6:0/1697935497 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86a8003ab0 msgr2=0x7f86a8003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:52.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.545+0000 7f86bf7fe640 1 --2- 172.21.15.6:0/1697935497 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86a8003ab0 0x7f86a8003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.545+0000 7f86bf7fe640 1 -- 172.21.15.6:0/1697935497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86a8004810 msgr2=0x7f86a8004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:52.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.545+0000 7f86bf7fe640 1 --2- 172.21.15.6:0/1697935497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86a8004810 0x7f86a8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.545+0000 7f86bf7fe640 1 -- 172.21.15.6:0/1697935497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a8003530 con 0x7f86a80052b0 2024-05-04T00:31:52.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.549+0000 7f86bf7fe640 1 -- 172.21.15.6:0/1697935497 reap_dead start 2024-05-04T00:31:52.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.549+0000 7f86bf7fe640 1 --2- 172.21.15.6:0/1697935497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86a80052b0 0x7f86a800b9d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f86b0009ab0 tx=0x7f86b001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2dbd096cf5d5fc server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:52.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.557+0000 7f86bdffb640 1 -- 172.21.15.6:0/1697935497 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b00096b0 con 0x7f86a80052b0 2024-05-04T00:31:52.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.557+0000 7f86bdffb640 1 -- 172.21.15.6:0/1697935497 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b0004020 con 0x7f86a80052b0 2024-05-04T00:31:52.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.557+0000 7f86bdffb640 1 -- 172.21.15.6:0/1697935497 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b0004410 con 0x7f86a80052b0 2024-05-04T00:31:52.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.557+0000 7f86c591f640 1 -- 172.21.15.6:0/1697935497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86a80052b0 msgr2=0x7f86a800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:52.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.557+0000 7f86c591f640 1 --2- 172.21.15.6:0/1697935497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86a80052b0 0x7f86a800b9d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f86b0009ab0 tx=0x7f86b001ca90 comp rx=0 tx=0).stop 2024-05-04T00:31:52.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.557+0000 7f86c591f640 1 -- 172.21.15.6:0/1697935497 shutdown_connections 2024-05-04T00:31:52.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.557+0000 7f86c591f640 1 --2- 172.21.15.6:0/1697935497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86a80052b0 0x7f86a800b9d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.557+0000 7f86c591f640 1 -- 172.21.15.6:0/1697935497 >> 172.21.15.6:0/1697935497 conn(0x7f86c00ce310 msgr2=0x7f86c00ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:52.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.557+0000 7f86c591f640 1 -- 172.21.15.6:0/1697935497 shutdown_connections 2024-05-04T00:31:52.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.557+0000 7f86c591f640 1 -- 172.21.15.6:0/1697935497 wait complete. 2024-05-04T00:31:52.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.561+0000 7f86c591f640 1 Processor -- start 2024-05-04T00:31:52.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.561+0000 7f86c591f640 1 -- start start 2024-05-04T00:31:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.561+0000 7f86c591f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86a80052b0 0x7f86c015b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.561+0000 7f86c591f640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86c0153710 0x7f86c0157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.561+0000 7f86c591f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86c00c97c0 0x7f86c014cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.561+0000 7f86c591f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f86c0158dc0 con 0x7f86a80052b0 2024-05-04T00:31:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.561+0000 7f86c591f640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f86c015c4d0 con 0x7f86c0153710 2024-05-04T00:31:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.561+0000 7f86c591f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f86c00c7a10 con 0x7f86c00c97c0 2024-05-04T00:31:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.561+0000 7f86beffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86a80052b0 0x7f86c015b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.561+0000 7f86beffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86a80052b0 0x7f86c015b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47280/0 (socket says 172.21.15.6:47280) 2024-05-04T00:31:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.561+0000 7f86beffd640 1 -- 172.21.15.6:0/2025053547 learned_addr learned my addr 172.21.15.6:0/2025053547 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.561+0000 7f86bf7fe640 1 --2- 172.21.15.6:0/2025053547 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86c00c97c0 0x7f86c014cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.561+0000 7f86be7fc640 1 --2- 172.21.15.6:0/2025053547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86c0153710 0x7f86c0157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.569+0000 7f86beffd640 1 -- 172.21.15.6:0/2025053547 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86c00c97c0 msgr2=0x7f86c014cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.569+0000 7f86beffd640 1 --2- 172.21.15.6:0/2025053547 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86c00c97c0 0x7f86c014cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.569+0000 7f86beffd640 1 -- 172.21.15.6:0/2025053547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86c0153710 msgr2=0x7f86c0157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.569+0000 7f86beffd640 1 --2- 172.21.15.6:0/2025053547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86c0153710 0x7f86c0157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.569+0000 7f86beffd640 1 -- 172.21.15.6:0/2025053547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c00cec60 con 0x7f86a80052b0 2024-05-04T00:31:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.569+0000 7f86beffd640 1 --2- 172.21.15.6:0/2025053547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86a80052b0 0x7f86c015b840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f86b8007690 tx=0x7f86b8007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:52.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.577+0000 7f86a7fff640 1 -- 172.21.15.6:0/2025053547 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b8017020 con 0x7f86a80052b0 2024-05-04T00:31:52.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.577+0000 7f86a7fff640 1 -- 172.21.15.6:0/2025053547 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b800fa80 con 0x7f86a80052b0 2024-05-04T00:31:52.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.577+0000 7f86a7fff640 1 -- 172.21.15.6:0/2025053547 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b800fe70 con 0x7f86a80052b0 2024-05-04T00:31:52.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.577+0000 7f86c591f640 1 -- 172.21.15.6:0/2025053547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c0158110 con 0x7f86a80052b0 2024-05-04T00:31:52.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.577+0000 7f86c591f640 1 -- 172.21.15.6:0/2025053547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c01562b0 con 0x7f86a80052b0 2024-05-04T00:31:52.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.581+0000 7f86ccc7d000 1 Processor -- start 2024-05-04T00:31:52.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.581+0000 7f86ccc7d000 1 -- start start 2024-05-04T00:31:52.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.581+0000 7f86ccc7d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8ef7c0 0x55a1dfe21ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.581+0000 7f86ccc7d000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1dfcd7f80 0x55a1dfe1b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.581+0000 7f86ccc7d000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 0x55a1dfe1bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.581+0000 7f86ccc7d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a1dfcc6620 con 0x55a1df8ef7c0 2024-05-04T00:31:52.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.581+0000 7f86ccc7d000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55a1dfbe1740 con 0x55a1dfcc16b0 2024-05-04T00:31:52.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.581+0000 7f86ccc7d000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55a1dfc2f090 con 0x55a1dfcd7f80 2024-05-04T00:31:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.581+0000 7f86beffd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1dfcd7f80 0x55a1dfe1b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.581+0000 7f86beffd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1dfcd7f80 0x55a1dfe1b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:47378/0 (socket says 172.21.15.6:47378) 2024-05-04T00:31:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.581+0000 7f86beffd640 1 -- 172.21.15.6:0/3788449387 learned_addr learned my addr 172.21.15.6:0/3788449387 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.585+0000 7f86be7fc640 1 --2- 172.21.15.6:0/3788449387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 0x55a1dfe1bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.589+0000 7f86bf7fe640 1 --2- 172.21.15.6:0/3788449387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8ef7c0 0x55a1dfe21ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.589+0000 7f86beffd640 1 -- 172.21.15.6:0/3788449387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 msgr2=0x55a1dfe1bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:52.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.589+0000 7f86beffd640 1 --2- 172.21.15.6:0/3788449387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 0x55a1dfe1bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.589+0000 7f86beffd640 1 -- 172.21.15.6:0/3788449387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8ef7c0 msgr2=0x55a1dfe21ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:52.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.589+0000 7f86beffd640 1 --2- 172.21.15.6:0/3788449387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8ef7c0 0x55a1dfe21ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.589+0000 7f86beffd640 1 -- 172.21.15.6:0/3788449387 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1dfdc30a0 con 0x55a1dfcd7f80 2024-05-04T00:31:52.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.597+0000 7f86beffd640 1 --2- 172.21.15.6:0/3788449387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1dfcd7f80 0x55a1dfe1b5f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f86b8015000 tx=0x7f86b8013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59c141d3d68de5f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:52.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.605+0000 7f86a7fff640 1 -- 172.21.15.6:0/2025053547 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f86b801a020 con 0x7f86a80052b0 2024-05-04T00:31:52.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.605+0000 7f86a7fff640 1 --2- 172.21.15.6:0/2025053547 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f86ac06f480 0x7f86ac071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86a57fa640 1 -- 172.21.15.6:0/3788449387 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b805ac50 con 0x55a1dfcd7f80 2024-05-04T00:31:52.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86a57fa640 1 -- 172.21.15.6:0/3788449387 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b805e110 con 0x55a1dfcd7f80 2024-05-04T00:31:52.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86a57fa640 1 -- 172.21.15.6:0/3788449387 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b805dd70 con 0x55a1dfcd7f80 2024-05-04T00:31:52.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86bf7fe640 1 --2- 172.21.15.6:0/2025053547 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f86ac06f480 0x7f86ac071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86ccc7d000 1 -- 172.21.15.6:0/3788449387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1dfcd7f80 msgr2=0x55a1dfe1b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:52.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/3788449387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1dfcd7f80 0x55a1dfe1b5f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f86b8015000 tx=0x7f86b8013000 comp rx=0 tx=0).stop 2024-05-04T00:31:52.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86ccc7d000 1 -- 172.21.15.6:0/3788449387 shutdown_connections 2024-05-04T00:31:52.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/3788449387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 0x55a1dfe1bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/3788449387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1dfcd7f80 0x55a1dfe1b5f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/3788449387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8ef7c0 0x55a1dfe21ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86ccc7d000 1 -- 172.21.15.6:0/3788449387 >> 172.21.15.6:0/3788449387 conn(0x55a1dfdae340 msgr2=0x55a1dfe1e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:52.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86ccc7d000 1 -- 172.21.15.6:0/3788449387 shutdown_connections 2024-05-04T00:31:52.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86ccc7d000 1 -- 172.21.15.6:0/3788449387 wait complete. 2024-05-04T00:31:52.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86bf7fe640 1 --2- 172.21.15.6:0/2025053547 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f86ac06f480 0x7f86ac071990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f86a800c210 tx=0x7f86b00a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:52.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86ccc7d000 1 -- start start 2024-05-04T00:31:52.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86ccc7d000 1 Processor -- start 2024-05-04T00:31:52.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86a7fff640 1 -- 172.21.15.6:0/2025053547 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f86b80283a0 con 0x7f86a80052b0 2024-05-04T00:31:52.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86ccc7d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8ef7c0 0x55a1dfe1a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86ccc7d000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 0x55a1dfe1af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86ccc7d000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1dfcd7f80 0x55a1dfe26550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86ccc7d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a1dfc2b050 con 0x55a1df8ef7c0 2024-05-04T00:31:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86ccc7d000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55a1dfbe7ec0 con 0x55a1dfcc16b0 2024-05-04T00:31:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86ccc7d000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55a1dfbcec90 con 0x55a1dfcd7f80 2024-05-04T00:31:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.609+0000 7f86ccc7d000 10 client.0 _ll_register_callbacks cb 0x55a1dfdcae60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-04T00:31:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.613+0000 7f86be7fc640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 0x55a1dfe1af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.613+0000 7f86beffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8ef7c0 0x55a1dfe1a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.613+0000 7f86bf7fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1dfcd7f80 0x55a1dfe26550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.613+0000 7f86be7fc640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 0x55a1dfe1af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:43912/0 (socket says 172.21.15.6:43912) 2024-05-04T00:31:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.613+0000 7f86be7fc640 1 -- 172.21.15.6:0/2946460484 learned_addr learned my addr 172.21.15.6:0/2946460484 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:52.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.617+0000 7f86beffd640 1 -- 172.21.15.6:0/2946460484 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1dfcd7f80 msgr2=0x55a1dfe26550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:52.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.617+0000 7f86beffd640 1 --2- 172.21.15.6:0/2946460484 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1dfcd7f80 0x55a1dfe26550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.617+0000 7f86beffd640 1 -- 172.21.15.6:0/2946460484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 msgr2=0x55a1dfe1af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:52.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.617+0000 7f86beffd640 1 --2- 172.21.15.6:0/2946460484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 0x55a1dfe1af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.617+0000 7f86beffd640 1 -- 172.21.15.6:0/2946460484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1dfcd96f0 con 0x55a1df8ef7c0 2024-05-04T00:31:52.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.621+0000 7f86beffd640 1 --2- 172.21.15.6:0/2946460484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8ef7c0 0x55a1dfe1a9d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f86b8001280 tx=0x7f86b805eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dfc7861fc997d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:52.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.621+0000 7f869e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-04T00:31:52.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.625+0000 7f869e7fc640 1 -- 172.21.15.6:0/2946460484 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b805df50 con 0x55a1df8ef7c0 2024-05-04T00:31:52.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.625+0000 7f869e7fc640 1 -- 172.21.15.6:0/2946460484 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f86b805d860 con 0x55a1df8ef7c0 2024-05-04T00:31:52.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.625+0000 7f86ccc7d000 1 -- 172.21.15.6:0/2946460484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86b805e110 con 0x55a1df8ef7c0 2024-05-04T00:31:52.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.625+0000 7f869e7fc640 1 -- 172.21.15.6:0/2946460484 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f86b805e3d0 con 0x55a1df8ef7c0 2024-05-04T00:31:52.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.625+0000 7f86ccc7d000 10 client.4410 fetch_fsmap learned FSMap version 12 2024-05-04T00:31:52.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.625+0000 7f86ccc7d000 1 -- 172.21.15.6:0/2946460484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x55a1dfcd56a0 con 0x55a1df8ef7c0 2024-05-04T00:31:52.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.633+0000 7f869e7fc640 1 -- 172.21.15.6:0/2946460484 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b805e110 con 0x55a1df8ef7c0 2024-05-04T00:31:52.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.633+0000 7f869e7fc640 1 -- 172.21.15.6:0/2946460484 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 12) ==== 4744+0+0 (secure 0 0 0) 0x7f86b8059f70 con 0x55a1df8ef7c0 2024-05-04T00:31:52.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.633+0000 7f86ccc7d000 10 client.4410 fetch_fsmap finished waiting for FSMap version 12 2024-05-04T00:31:52.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.633+0000 7f86ccc7d000 10 client.4410 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-04T00:31:52.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.633+0000 7f86ccc7d000 20 client.4410 populate_metadata read hostname 'smithi006' 2024-05-04T00:31:52.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.633+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/2946460484 >> [v2:172.21.15.163:6836/1055589916,v1:172.21.15.163:6837/1055589916] conn(0x55a1df8d47d0 0x55a1dfe27200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:52.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.633+0000 7f86ccc7d000 4 client.4410 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-04T00:31:52.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.633+0000 7f86ccc7d000 1 -- 172.21.15.6:0/2946460484 --> [v2:172.21.15.163:6836/1055589916,v1:172.21.15.163:6837/1055589916] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1dfbc7be0 con 0x55a1df8d47d0 2024-05-04T00:31:52.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.633+0000 7f86be7fc640 1 --2- 172.21.15.6:0/2946460484 >> [v2:172.21.15.163:6836/1055589916,v1:172.21.15.163:6837/1055589916] conn(0x55a1df8d47d0 0x55a1dfe27200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:52.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.789+0000 7f86be7fc640 1 --2- 172.21.15.6:0/2946460484 >> [v2:172.21.15.163:6836/1055589916,v1:172.21.15.163:6837/1055589916] conn(0x55a1df8d47d0 0x55a1dfe27200 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2b7c3e3e25c467d3 server_cookie=be78e6196cb46070 in_seq=0 out_seq=0 2024-05-04T00:31:52.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.789+0000 7f869e7fc640 10 client.4410 ms_handle_connect on v2:172.21.15.163:6836/1055589916 2024-05-04T00:31:52.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.969+0000 7f869e7fc640 1 -- 172.21.15.6:0/2946460484 <== mds.1 v2:172.21.15.163:6836/1055589916 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a1dfbc7be0 con 0x55a1df8d47d0 2024-05-04T00:31:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.969+0000 7f869e7fc640 10 client.4410 handle_command_reply: tid=0 2024-05-04T00:31:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.969+0000 7f86ccc7d000 1 client.4410 shutdown 2024-05-04T00:31:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.969+0000 7f86ccc7d000 1 -- 172.21.15.6:0/2946460484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8ef7c0 msgr2=0x55a1dfe1a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.969+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/2946460484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8ef7c0 0x55a1dfe1a9d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f86b8001280 tx=0x7f86b805eb60 comp rx=0 tx=0).stop 2024-05-04T00:31:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.969+0000 7f86ccc7d000 1 -- 172.21.15.6:0/2946460484 shutdown_connections 2024-05-04T00:31:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.969+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/2946460484 >> [v2:172.21.15.163:6836/1055589916,v1:172.21.15.163:6837/1055589916] conn(0x55a1df8d47d0 0x55a1dfe27200 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.969+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/2946460484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 0x55a1dfe1af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.969+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/2946460484 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1dfcd7f80 0x55a1dfe26550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.969+0000 7f869e7fc640 0 client.4410 ms_handle_reset on v2:172.21.15.163:6836/1055589916 2024-05-04T00:31:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.969+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/2946460484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8ef7c0 0x55a1dfe1a9d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.969+0000 7f86ccc7d000 1 -- 172.21.15.6:0/2946460484 >> 172.21.15.6:0/2946460484 conn(0x55a1dfdae340 msgr2=0x55a1dfe1d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:52.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.969+0000 7f86ccc7d000 1 -- 172.21.15.6:0/2946460484 shutdown_connections 2024-05-04T00:31:52.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.969+0000 7f86ccc7d000 1 -- 172.21.15.6:0/2946460484 wait complete. 2024-05-04T00:31:52.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:52.973+0000 7f86ccc7d000 20 client.4410 trim_cache size 0 max 16384 2024-05-04T00:31:53.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.029+0000 7f86ccc7d000 1 Processor -- start 2024-05-04T00:31:53.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.029+0000 7f86ccc7d000 1 -- start start 2024-05-04T00:31:53.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.029+0000 7f86ccc7d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8d47d0 0x55a1dfe31250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.029+0000 7f86ccc7d000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1df8ef7c0 0x55a1dfe31790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.029+0000 7f86ccc7d000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 0x55a1dfe32100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.029+0000 7f86ccc7d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f86c01fdd90 con 0x55a1df8d47d0 2024-05-04T00:31:53.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.029+0000 7f86ccc7d000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55a1dfc3c490 con 0x55a1dfcc16b0 2024-05-04T00:31:53.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.029+0000 7f86ccc7d000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55a1dfc2b050 con 0x55a1df8ef7c0 2024-05-04T00:31:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.033+0000 7f86be7fc640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1df8ef7c0 0x55a1dfe31790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:53.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.033+0000 7f86be7fc640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1df8ef7c0 0x55a1dfe31790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:47400/0 (socket says 172.21.15.6:47400) 2024-05-04T00:31:53.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.033+0000 7f86be7fc640 1 -- 172.21.15.6:0/1748312850 learned_addr learned my addr 172.21.15.6:0/1748312850 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:53.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.037+0000 7f86bf7fe640 1 --2- 172.21.15.6:0/1748312850 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 0x55a1dfe32100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:53.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.133+0000 7f86beffd640 1 --2- 172.21.15.6:0/1748312850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8d47d0 0x55a1dfe31250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:53.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.141+0000 7f86beffd640 1 -- 172.21.15.6:0/1748312850 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1df8ef7c0 msgr2=0x55a1dfe31790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:53.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.141+0000 7f86beffd640 1 --2- 172.21.15.6:0/1748312850 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1df8ef7c0 0x55a1dfe31790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.141+0000 7f86beffd640 1 -- 172.21.15.6:0/1748312850 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 msgr2=0x55a1dfe32100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:53.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.141+0000 7f86beffd640 1 --2- 172.21.15.6:0/1748312850 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 0x55a1dfe32100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.141+0000 7f86beffd640 1 -- 172.21.15.6:0/1748312850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1dfc08af0 con 0x55a1df8d47d0 2024-05-04T00:31:53.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.145+0000 7f86beffd640 1 --2- 172.21.15.6:0/1748312850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8d47d0 0x55a1dfe31250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f86b805e590 tx=0x7f86b8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e5974f1acb82f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:53.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.157+0000 7f86a4ff9640 1 -- 172.21.15.6:0/1748312850 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b805a4c0 con 0x55a1df8d47d0 2024-05-04T00:31:53.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.157+0000 7f86a4ff9640 1 -- 172.21.15.6:0/1748312850 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b805e110 con 0x55a1df8d47d0 2024-05-04T00:31:53.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.157+0000 7f86a4ff9640 1 -- 172.21.15.6:0/1748312850 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b805d860 con 0x55a1df8d47d0 2024-05-04T00:31:53.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.161+0000 7f86ccc7d000 1 -- 172.21.15.6:0/1748312850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8d47d0 msgr2=0x55a1dfe31250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:53.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.161+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/1748312850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8d47d0 0x55a1dfe31250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f86b805e590 tx=0x7f86b8032000 comp rx=0 tx=0).stop 2024-05-04T00:31:53.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.161+0000 7f86ccc7d000 1 -- 172.21.15.6:0/1748312850 shutdown_connections 2024-05-04T00:31:53.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.161+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/1748312850 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 0x55a1dfe32100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.161+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/1748312850 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1df8ef7c0 0x55a1dfe31790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.161+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/1748312850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8d47d0 0x55a1dfe31250 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.161+0000 7f86ccc7d000 1 -- 172.21.15.6:0/1748312850 >> 172.21.15.6:0/1748312850 conn(0x55a1dfdae340 msgr2=0x55a1dfe1e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:53.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.161+0000 7f86ccc7d000 1 -- 172.21.15.6:0/1748312850 shutdown_connections 2024-05-04T00:31:53.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.161+0000 7f86ccc7d000 1 -- 172.21.15.6:0/1748312850 wait complete. 2024-05-04T00:31:53.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.161+0000 7f86ccc7d000 1 -- start start 2024-05-04T00:31:53.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.161+0000 7f86ccc7d000 1 Processor -- start 2024-05-04T00:31:53.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.165+0000 7f86ccc7d000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1df8d47d0 0x55a1dfe22b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.165+0000 7f86ccc7d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8ef7c0 0x55a1dfe23090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.165+0000 7f86ccc7d000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 0x55a1dfe235d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.165+0000 7f86ccc7d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a1dfc2e3a0 con 0x55a1df8ef7c0 2024-05-04T00:31:53.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.165+0000 7f86ccc7d000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55a1dfce9d80 con 0x55a1dfcc16b0 2024-05-04T00:31:53.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.165+0000 7f86ccc7d000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55a1dfe1b450 con 0x55a1df8d47d0 2024-05-04T00:31:53.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.165+0000 7f86ccc7d000 10 client.0 _ll_register_callbacks cb 0x7f86b8062920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-04T00:31:53.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.169+0000 7f86bf7fe640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 0x55a1dfe235d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:53.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.169+0000 7f86bf7fe640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 0x55a1dfe235d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:43924/0 (socket says 172.21.15.6:43924) 2024-05-04T00:31:53.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.169+0000 7f86bf7fe640 1 -- 172.21.15.6:0/3888569230 learned_addr learned my addr 172.21.15.6:0/3888569230 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:53.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.169+0000 7f86beffd640 1 --2- 172.21.15.6:0/3888569230 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1df8d47d0 0x55a1dfe22b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:53.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.177+0000 7f86be7fc640 1 --2- 172.21.15.6:0/3888569230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8ef7c0 0x55a1dfe23090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:53.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.181+0000 7f86bf7fe640 1 -- 172.21.15.6:0/3888569230 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1df8d47d0 msgr2=0x55a1dfe22b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:53.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.181+0000 7f86bf7fe640 1 --2- 172.21.15.6:0/3888569230 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1df8d47d0 0x55a1dfe22b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.181+0000 7f86bf7fe640 1 -- 172.21.15.6:0/3888569230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8ef7c0 msgr2=0x55a1dfe23090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:53.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.181+0000 7f86bf7fe640 1 --2- 172.21.15.6:0/3888569230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8ef7c0 0x55a1dfe23090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.181+0000 7f86bf7fe640 1 -- 172.21.15.6:0/3888569230 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1dfc07e40 con 0x55a1dfcc16b0 2024-05-04T00:31:53.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.185+0000 7f86bf7fe640 1 --2- 172.21.15.6:0/3888569230 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 0x55a1dfe235d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f86b0009820 tx=0x7f86b0019830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7243cd4d39a9be5b server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:53.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.185+0000 7f869e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-05-04T00:31:53.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.201+0000 7f869e7fc640 1 -- 172.21.15.6:0/3888569230 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b00a5e20 con 0x55a1dfcc16b0 2024-05-04T00:31:53.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.201+0000 7f869e7fc640 1 -- 172.21.15.6:0/3888569230 <== mon.1 v2:172.21.15.163:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f86b00059a0 con 0x55a1dfcc16b0 2024-05-04T00:31:53.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.201+0000 7f86ccc7d000 1 -- 172.21.15.6:0/3888569230 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86b805e110 con 0x55a1dfcc16b0 2024-05-04T00:31:53.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.205+0000 7f869e7fc640 1 -- 172.21.15.6:0/3888569230 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f86b00d2050 con 0x55a1dfcc16b0 2024-05-04T00:31:53.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.205+0000 7f86ccc7d000 10 client.4483 fetch_fsmap learned FSMap version 12 2024-05-04T00:31:53.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.205+0000 7f86ccc7d000 1 -- 172.21.15.6:0/3888569230 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x55a1dfcaf4e0 con 0x55a1dfcc16b0 2024-05-04T00:31:53.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.245+0000 7f869e7fc640 1 -- 172.21.15.6:0/3888569230 <== mon.1 v2:172.21.15.163:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b805e110 con 0x55a1dfcc16b0 2024-05-04T00:31:53.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.245+0000 7f869e7fc640 1 -- 172.21.15.6:0/3888569230 <== mon.1 v2:172.21.15.163:3300/0 5 ==== fsmap(e 12) ==== 4744+0+0 (secure 0 0 0) 0x7f86b00d5020 con 0x55a1dfcc16b0 2024-05-04T00:31:53.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.245+0000 7f86ccc7d000 10 client.4483 fetch_fsmap finished waiting for FSMap version 12 2024-05-04T00:31:53.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.245+0000 7f86ccc7d000 10 client.4483 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-04T00:31:53.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.245+0000 7f86ccc7d000 20 client.4483 populate_metadata read hostname 'smithi006' 2024-05-04T00:31:53.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.245+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/3888569230 >> [v2:172.21.15.163:6836/1055589916,v1:172.21.15.163:6837/1055589916] conn(0x55a1df8ede80 0x55a1dfe9ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.245+0000 7f86ccc7d000 4 client.4483 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-04T00:31:53.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.245+0000 7f86ccc7d000 1 -- 172.21.15.6:0/3888569230 --> [v2:172.21.15.163:6836/1055589916,v1:172.21.15.163:6837/1055589916] -- command(tid 0: {"prefix": "status"}) -- 0x55a1dfc3cca0 con 0x55a1df8ede80 2024-05-04T00:31:53.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.249+0000 7f86beffd640 1 --2- 172.21.15.6:0/3888569230 >> [v2:172.21.15.163:6836/1055589916,v1:172.21.15.163:6837/1055589916] conn(0x55a1df8ede80 0x55a1dfe9ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:53.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.257+0000 7f86beffd640 1 --2- 172.21.15.6:0/3888569230 >> [v2:172.21.15.163:6836/1055589916,v1:172.21.15.163:6837/1055589916] conn(0x55a1df8ede80 0x55a1dfe9ece0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a9185c16582c9aff server_cookie=e195fa68f4829be in_seq=0 out_seq=0 2024-05-04T00:31:53.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.257+0000 7f869e7fc640 10 client.4483 ms_handle_connect on v2:172.21.15.163:6836/1055589916 2024-05-04T00:31:53.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f869e7fc640 1 -- 172.21.15.6:0/3888569230 <== mds.1 v2:172.21.15.163:6836/1055589916 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55a1dfc3cca0 con 0x55a1df8ede80 2024-05-04T00:31:53.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f869e7fc640 10 client.4483 handle_command_reply: tid=0 2024-05-04T00:31:53.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86ccc7d000 1 client.4483 shutdown 2024-05-04T00:31:53.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86ccc7d000 1 -- 172.21.15.6:0/3888569230 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 msgr2=0x55a1dfe235d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:53.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/3888569230 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 0x55a1dfe235d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f86b0009820 tx=0x7f86b0019830 comp rx=0 tx=0).stop 2024-05-04T00:31:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86ccc7d000 1 -- 172.21.15.6:0/3888569230 shutdown_connections 2024-05-04T00:31:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/3888569230 >> [v2:172.21.15.163:6836/1055589916,v1:172.21.15.163:6837/1055589916] conn(0x55a1df8ede80 0x55a1dfe9ece0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/3888569230 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a1dfcc16b0 0x55a1dfe235d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/3888569230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1df8ef7c0 0x55a1dfe23090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86ccc7d000 1 --2- 172.21.15.6:0/3888569230 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a1df8d47d0 0x55a1dfe22b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f869e7fc640 0 client.4483 ms_handle_reset on v2:172.21.15.163:6836/1055589916 2024-05-04T00:31:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86ccc7d000 1 -- 172.21.15.6:0/3888569230 >> 172.21.15.6:0/3888569230 conn(0x55a1dfdae340 msgr2=0x55a1dfde36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86ccc7d000 1 -- 172.21.15.6:0/3888569230 shutdown_connections 2024-05-04T00:31:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86ccc7d000 1 -- 172.21.15.6:0/3888569230 wait complete. 2024-05-04T00:31:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86ccc7d000 20 client.4483 trim_cache size 0 max 16384 2024-05-04T00:31:53.290 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-04T00:31:53.290 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "ad5951ed-0d5e-4770-b5d9-995e08a00213", 2024-05-04T00:31:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 1, 2024-05-04T00:31:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4270, 2024-05-04T00:31:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-04T00:31:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-04T00:31:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-04T00:31:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 23.221114915000001, 2024-05-04T00:31:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 12, 2024-05-04T00:31:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 26, 2024-05-04T00:31:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 26, 2024-05-04T00:31:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 45.942661960000002 2024-05-04T00:31:53.291 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-04T00:31:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86c591f640 1 -- 172.21.15.6:0/2025053547 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f86ac06f480 msgr2=0x7f86ac071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:53.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86c591f640 1 --2- 172.21.15.6:0/2025053547 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f86ac06f480 0x7f86ac071990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f86a800c210 tx=0x7f86b00a7040 comp rx=0 tx=0).stop 2024-05-04T00:31:53.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86c591f640 1 -- 172.21.15.6:0/2025053547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86a80052b0 msgr2=0x7f86c015b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:53.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86c591f640 1 --2- 172.21.15.6:0/2025053547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86a80052b0 0x7f86c015b840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f86b8007690 tx=0x7f86b8007b50 comp rx=0 tx=0).stop 2024-05-04T00:31:53.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86c591f640 1 -- 172.21.15.6:0/2025053547 shutdown_connections 2024-05-04T00:31:53.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86c591f640 1 --2- 172.21.15.6:0/2025053547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86c0153710 0x7f86c0157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86c591f640 1 --2- 172.21.15.6:0/2025053547 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f86ac06f480 0x7f86ac071990 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86c591f640 1 --2- 172.21.15.6:0/2025053547 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86c00c97c0 0x7f86c014cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86c591f640 1 --2- 172.21.15.6:0/2025053547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86a80052b0 0x7f86c015b840 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86c591f640 1 -- 172.21.15.6:0/2025053547 >> 172.21.15.6:0/2025053547 conn(0x7f86c00ce310 msgr2=0x7f86c00cc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:53.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86c591f640 1 -- 172.21.15.6:0/2025053547 shutdown_connections 2024-05-04T00:31:53.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.285+0000 7f86c591f640 1 -- 172.21.15.6:0/2025053547 wait complete. 2024-05-04T00:31:53.327 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-05-04T00:31:53.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.489+0000 7f2b826e4640 1 Processor -- start 2024-05-04T00:31:53.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.489+0000 7f2b826e4640 1 -- start start 2024-05-04T00:31:53.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.489+0000 7f2b826e4640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2b7c0c7120 0x7f2b7c152820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.489+0000 7f2b826e4640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2b7c06f860 0x7f2b7c06fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.489+0000 7f2b826e4640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b7c073010 con 0x7f2b7c0726f0 2024-05-04T00:31:53.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.489+0000 7f2b826e4640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f2b7c0c5ec0 con 0x7f2b7c06f860 2024-05-04T00:31:53.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.489+0000 7f2b826e4640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f2b7c0c61a0 con 0x7f2b7c0c7120 2024-05-04T00:31:53.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.493+0000 7f2b7b7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2b7c0726f0 0x7f2b7c0c7af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34180/0 (socket says 172.21.15.6:34180) 2024-05-04T00:31:53.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.493+0000 7f2b7b7fe640 1 -- 172.21.15.6:0/705787724 learned_addr learned my addr 172.21.15.6:0/705787724 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:53.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.493+0000 7f2b80c81640 1 --2- 172.21.15.6:0/705787724 >> v2:172.21.15.163:3300/0 conn(0x7f2b7c06f860 0x7f2b7c06fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:53.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.493+0000 7f2b7bfff640 1 --2- 172.21.15.6:0/705787724 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2b7c0c7120 0x7f2b7c152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:53.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.497+0000 7f2b7affd640 1 -- 172.21.15.6:0/705787724 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1860490956 0 0) 0x7f2b7c073010 con 0x7f2b7c0726f0 2024-05-04T00:31:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.497+0000 7f2b7affd640 1 -- 172.21.15.6:0/705787724 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b68003530 con 0x7f2b7c0726f0 2024-05-04T00:31:53.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.501+0000 7f2b80c81640 1 -- 172.21.15.6:0/705787724 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2b7c0c7120 msgr2=0x7f2b7c152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:53.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.501+0000 7f2b80c81640 1 --2- 172.21.15.6:0/705787724 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2b7c0c7120 0x7f2b7c152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.501+0000 7f2b80c81640 1 -- 172.21.15.6:0/705787724 >> v1:172.21.15.6:6789/0 conn(0x7f2b7c0726f0 legacy=0x7f2b7c0c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:53.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.501+0000 7f2b80c81640 1 -- 172.21.15.6:0/705787724 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7c0c6480 con 0x7f2b7c06f860 2024-05-04T00:31:53.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.569+0000 7f2b80c81640 1 --2- 172.21.15.6:0/705787724 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b7c06f860 0x7f2b7c06fc70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0097c0 tx=0x7f2b6c01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b955b9fd70f74713 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:53.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.577+0000 7f2b7affd640 1 -- 172.21.15.6:0/705787724 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c0b5070 con 0x7f2b7c06f860 2024-05-04T00:31:53.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.577+0000 7f2b7affd640 1 -- 172.21.15.6:0/705787724 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b6c0a8990 con 0x7f2b7c06f860 2024-05-04T00:31:53.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.577+0000 7f2b7affd640 1 -- 172.21.15.6:0/705787724 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c0a8d60 con 0x7f2b7c06f860 2024-05-04T00:31:53.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.581+0000 7f2b826e4640 1 -- 172.21.15.6:0/705787724 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b7c06f860 msgr2=0x7f2b7c06fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:53.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.581+0000 7f2b826e4640 1 --2- 172.21.15.6:0/705787724 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b7c06f860 0x7f2b7c06fc70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0097c0 tx=0x7f2b6c01ec90 comp rx=0 tx=0).stop 2024-05-04T00:31:53.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.581+0000 7f2b826e4640 1 -- 172.21.15.6:0/705787724 shutdown_connections 2024-05-04T00:31:53.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.581+0000 7f2b826e4640 1 --2- 172.21.15.6:0/705787724 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b7c06f860 0x7f2b7c06fc70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.581+0000 7f2b826e4640 1 --2- 172.21.15.6:0/705787724 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2b7c0c7120 0x7f2b7c152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.581+0000 7f2b826e4640 1 -- 172.21.15.6:0/705787724 >> 172.21.15.6:0/705787724 conn(0x7f2b7c06cf70 msgr2=0x7f2b7c0c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:53.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.581+0000 7f2b826e4640 1 -- 172.21.15.6:0/705787724 shutdown_connections 2024-05-04T00:31:53.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.581+0000 7f2b826e4640 1 -- 172.21.15.6:0/705787724 wait complete. 2024-05-04T00:31:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.585+0000 7f2b826e4640 1 Processor -- start 2024-05-04T00:31:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.585+0000 7f2b826e4640 1 -- start start 2024-05-04T00:31:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.589+0000 7f2b826e4640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b7c06f860 0x7f2b7c1404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.589+0000 7f2b826e4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b7c0726f0 0x7f2b7c147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.589+0000 7f2b826e4640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2b7c0c7120 0x7f2b7c13e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.589+0000 7f2b826e4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c072b00 con 0x7f2b7c0726f0 2024-05-04T00:31:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.589+0000 7f2b826e4640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c0c6760 con 0x7f2b7c06f860 2024-05-04T00:31:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.589+0000 7f2b826e4640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f2b7c072c80 con 0x7f2b7c0c7120 2024-05-04T00:31:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.589+0000 7f2b7bfff640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b7c06f860 0x7f2b7c1404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.589+0000 7f2b80c81640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2b7c0c7120 0x7f2b7c13e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.589+0000 7f2b7bfff640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b7c06f860 0x7f2b7c1404b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:56228/0 (socket says 172.21.15.6:56228) 2024-05-04T00:31:53.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.589+0000 7f2b7bfff640 1 -- 172.21.15.6:0/1752974957 learned_addr learned my addr 172.21.15.6:0/1752974957 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:53.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.601+0000 7f2b7bfff640 1 -- 172.21.15.6:0/1752974957 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2b7c0c7120 msgr2=0x7f2b7c13e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:53.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.601+0000 7f2b7bfff640 1 --2- 172.21.15.6:0/1752974957 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2b7c0c7120 0x7f2b7c13e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.601+0000 7f2b7bfff640 1 -- 172.21.15.6:0/1752974957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b7c0726f0 msgr2=0x7f2b7c147f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:53.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.601+0000 7f2b7bfff640 1 --2- 172.21.15.6:0/1752974957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b7c0726f0 0x7f2b7c147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.601+0000 7f2b7bfff640 1 -- 172.21.15.6:0/1752974957 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7c15ba00 con 0x7f2b7c06f860 2024-05-04T00:31:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.609+0000 7f2b7bfff640 1 --2- 172.21.15.6:0/1752974957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b7c06f860 0x7f2b7c1404b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400efc0 tx=0x7f2b7400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:53.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.621+0000 7f2b78ff9640 1 -- 172.21.15.6:0/1752974957 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74018020 con 0x7f2b7c06f860 2024-05-04T00:31:53.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.621+0000 7f2b78ff9640 1 -- 172.21.15.6:0/1752974957 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b74014480 con 0x7f2b7c06f860 2024-05-04T00:31:53.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.621+0000 7f2b78ff9640 1 -- 172.21.15.6:0/1752974957 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74014850 con 0x7f2b7c06f860 2024-05-04T00:31:53.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.621+0000 7f2b826e4640 1 -- 172.21.15.6:0/1752974957 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b7c148950 con 0x7f2b7c06f860 2024-05-04T00:31:53.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.621+0000 7f2b826e4640 1 -- 172.21.15.6:0/1752974957 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b7c15af20 con 0x7f2b7c06f860 2024-05-04T00:31:53.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.625+0000 7f2b89a42000 1 Processor -- start 2024-05-04T00:31:53.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.625+0000 7f2b89a42000 1 -- start start 2024-05-04T00:31:53.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.625+0000 7f2b89a42000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e30a77c0 0x55a4e359d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.625+0000 7f2b89a42000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4e348ff80 0x55a4e359d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.625+0000 7f2b89a42000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e34796b0 0x55a4e35d86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.625+0000 7f2b89a42000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a4e347e620 con 0x55a4e34796b0 2024-05-04T00:31:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.625+0000 7f2b89a42000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55a4e3399740 con 0x55a4e348ff80 2024-05-04T00:31:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.625+0000 7f2b89a42000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55a4e33e7090 con 0x55a4e30a77c0 2024-05-04T00:31:53.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.625+0000 7f2b80c81640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e30a77c0 0x55a4e359d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:53.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.629+0000 7f2b80c81640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e30a77c0 0x55a4e359d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:32802/0 (socket says 172.21.15.6:32802) 2024-05-04T00:31:53.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.629+0000 7f2b80c81640 1 -- 172.21.15.6:0/2014232119 learned_addr learned my addr 172.21.15.6:0/2014232119 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.633+0000 7f2b80c81640 1 -- 172.21.15.6:0/2014232119 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4e348ff80 msgr2=0x55a4e359d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.633+0000 7f2b80c81640 1 --2- 172.21.15.6:0/2014232119 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4e348ff80 0x55a4e359d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.633+0000 7f2b80c81640 1 -- 172.21.15.6:0/2014232119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e34796b0 msgr2=0x55a4e35d86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.633+0000 7f2b80c81640 1 --2- 172.21.15.6:0/2014232119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e34796b0 0x55a4e35d86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.633+0000 7f2b80c81640 1 -- 172.21.15.6:0/2014232119 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4e357b0a0 con 0x55a4e30a77c0 2024-05-04T00:31:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.641+0000 7f2b80c81640 1 --2- 172.21.15.6:0/2014232119 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e30a77c0 0x55a4e359d360 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c01ecd0 tx=0x7f2b6c004740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce82b0b8923a2b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:53.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.653+0000 7f2b71ffb640 1 -- 172.21.15.6:0/2014232119 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c0c0070 con 0x55a4e30a77c0 2024-05-04T00:31:53.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.653+0000 7f2b71ffb640 1 -- 172.21.15.6:0/2014232119 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b6c0a8990 con 0x55a4e30a77c0 2024-05-04T00:31:53.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.653+0000 7f2b71ffb640 1 -- 172.21.15.6:0/2014232119 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c0b5040 con 0x55a4e30a77c0 2024-05-04T00:31:53.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.653+0000 7f2b89a42000 1 -- 172.21.15.6:0/2014232119 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e30a77c0 msgr2=0x55a4e359d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:53.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.653+0000 7f2b89a42000 1 --2- 172.21.15.6:0/2014232119 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e30a77c0 0x55a4e359d360 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c01ecd0 tx=0x7f2b6c004740 comp rx=0 tx=0).stop 2024-05-04T00:31:53.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.653+0000 7f2b89a42000 1 -- 172.21.15.6:0/2014232119 shutdown_connections 2024-05-04T00:31:53.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.653+0000 7f2b89a42000 1 --2- 172.21.15.6:0/2014232119 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4e348ff80 0x55a4e359d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.653+0000 7f2b89a42000 1 --2- 172.21.15.6:0/2014232119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e34796b0 0x55a4e35d86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.653+0000 7f2b89a42000 1 --2- 172.21.15.6:0/2014232119 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e30a77c0 0x55a4e359d360 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.653+0000 7f2b89a42000 1 -- 172.21.15.6:0/2014232119 >> 172.21.15.6:0/2014232119 conn(0x55a4e3566340 msgr2=0x55a4e35d6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:53.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.653+0000 7f2b89a42000 1 -- 172.21.15.6:0/2014232119 shutdown_connections 2024-05-04T00:31:53.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.653+0000 7f2b89a42000 1 -- 172.21.15.6:0/2014232119 wait complete. 2024-05-04T00:31:53.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.657+0000 7f2b89a42000 1 -- start start 2024-05-04T00:31:53.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.657+0000 7f2b89a42000 1 Processor -- start 2024-05-04T00:31:53.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.661+0000 7f2b89a42000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e30a77c0 0x55a4e35d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.661+0000 7f2b89a42000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e34796b0 0x55a4e35d2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.661+0000 7f2b89a42000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4e348ff80 0x55a4e35e1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.661+0000 7f2b89a42000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a4e33e3050 con 0x55a4e30a77c0 2024-05-04T00:31:53.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.661+0000 7f2b89a42000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55a4e339fec0 con 0x55a4e348ff80 2024-05-04T00:31:53.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.661+0000 7f2b89a42000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55a4e3386c90 con 0x55a4e34796b0 2024-05-04T00:31:53.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.661+0000 7f2b89a42000 10 client.0 _ll_register_callbacks cb 0x55a4e3582e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-04T00:31:53.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.661+0000 7f2b7bfff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e34796b0 0x55a4e35d2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:53.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.661+0000 7f2b80c81640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e30a77c0 0x55a4e35d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:53.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.661+0000 7f2b7bfff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e34796b0 0x55a4e35d2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:32808/0 (socket says 172.21.15.6:32808) 2024-05-04T00:31:53.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.661+0000 7f2b7bfff640 1 -- 172.21.15.6:0/1972463039 learned_addr learned my addr 172.21.15.6:0/1972463039 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:53.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.669+0000 7f2b80c81640 1 -- 172.21.15.6:0/1972463039 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e34796b0 msgr2=0x55a4e35d2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:53.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.669+0000 7f2b80c81640 1 --2- 172.21.15.6:0/1972463039 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e34796b0 0x55a4e35d2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.669+0000 7f2b80c81640 1 -- 172.21.15.6:0/1972463039 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4e348ff80 msgr2=0x55a4e35e1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:53.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.669+0000 7f2b80c81640 1 --2- 172.21.15.6:0/1972463039 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4e348ff80 0x55a4e35e1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:53.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.669+0000 7f2b80c81640 1 -- 172.21.15.6:0/1972463039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4e34916f0 con 0x55a4e30a77c0 2024-05-04T00:31:53.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.673+0000 7f2b80c81640 1 --2- 172.21.15.6:0/1972463039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e30a77c0 0x55a4e35d29d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009120 tx=0x7f2b6c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d3732b2311861 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:53.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.673+0000 7f2b5affd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-04T00:31:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.677+0000 7f2b5affd640 1 -- 172.21.15.6:0/1972463039 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c0c0040 con 0x55a4e30a77c0 2024-05-04T00:31:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.677+0000 7f2b5affd640 1 -- 172.21.15.6:0/1972463039 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f2b6c0bcd20 con 0x55a4e30a77c0 2024-05-04T00:31:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.677+0000 7f2b89a42000 1 -- 172.21.15.6:0/1972463039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b6c0a8990 con 0x55a4e30a77c0 2024-05-04T00:31:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.681+0000 7f2b5affd640 1 -- 172.21.15.6:0/1972463039 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f2b6c0b5040 con 0x55a4e30a77c0 2024-05-04T00:31:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.681+0000 7f2b89a42000 10 client.4422 fetch_fsmap learned FSMap version 12 2024-05-04T00:31:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.681+0000 7f2b89a42000 1 -- 172.21.15.6:0/1972463039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x55a4e348d6a0 con 0x55a4e30a77c0 2024-05-04T00:31:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.689+0000 7f2b5affd640 1 -- 172.21.15.6:0/1972463039 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b6c0a8990 con 0x55a4e30a77c0 2024-05-04T00:31:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.689+0000 7f2b5affd640 1 -- 172.21.15.6:0/1972463039 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 12) ==== 4744+0+0 (secure 0 0 0) 0x7f2b6c0b1730 con 0x55a4e30a77c0 2024-05-04T00:31:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.689+0000 7f2b89a42000 10 client.4422 fetch_fsmap finished waiting for FSMap version 12 2024-05-04T00:31:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.689+0000 7f2b89a42000 10 client.4422 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-04T00:31:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.689+0000 7f2b89a42000 20 client.4422 populate_metadata read hostname 'smithi006' 2024-05-04T00:31:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.689+0000 7f2b89a42000 1 --2- 172.21.15.6:0/1972463039 >> [v2:172.21.15.6:6836/639743836,v1:172.21.15.6:6837/639743836] conn(0x55a4e308c7d0 0x55a4e35e2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.689+0000 7f2b89a42000 4 client.4422 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-04T00:31:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.689+0000 7f2b89a42000 1 -- 172.21.15.6:0/1972463039 --> [v2:172.21.15.6:6836/639743836,v1:172.21.15.6:6837/639743836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4e337fbe0 con 0x55a4e308c7d0 2024-05-04T00:31:53.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.689+0000 7f2b7bfff640 1 --2- 172.21.15.6:0/1972463039 >> [v2:172.21.15.6:6836/639743836,v1:172.21.15.6:6837/639743836] conn(0x55a4e308c7d0 0x55a4e35e2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:53.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.701+0000 7f2b78ff9640 1 -- 172.21.15.6:0/1752974957 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2b7401b020 con 0x7f2b7c06f860 2024-05-04T00:31:53.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.701+0000 7f2b78ff9640 1 --2- 172.21.15.6:0/1752974957 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f2b5c06f3b0 0x7f2b5c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:53.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.701+0000 7f2b7b7fe640 1 --2- 172.21.15.6:0/1752974957 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f2b5c06f3b0 0x7f2b5c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:53.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.701+0000 7f2b7b7fe640 1 --2- 172.21.15.6:0/1752974957 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f2b5c06f3b0 0x7f2b5c0718c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c159e50 tx=0x7f2b64007960 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:53.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.709+0000 7f2b78ff9640 1 -- 172.21.15.6:0/1752974957 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f2b74095840 con 0x7f2b7c06f860 2024-05-04T00:31:53.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.781+0000 7f2b7bfff640 1 --2- 172.21.15.6:0/1972463039 >> [v2:172.21.15.6:6836/639743836,v1:172.21.15.6:6837/639743836] conn(0x55a4e308c7d0 0x55a4e35e2cc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd560575bfaccc1b server_cookie=a0e05a614f1c753f in_seq=0 out_seq=0 2024-05-04T00:31:53.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:53.781+0000 7f2b5affd640 10 client.4422 ms_handle_connect on v2:172.21.15.6:6836/639743836 2024-05-04T00:31:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.033+0000 7f2b5affd640 1 -- 172.21.15.6:0/1972463039 <== mds.0 v2:172.21.15.6:6836/639743836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a4e337fbe0 con 0x55a4e308c7d0 2024-05-04T00:31:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.033+0000 7f2b5affd640 10 client.4422 handle_command_reply: tid=0 2024-05-04T00:31:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.033+0000 7f2b89a42000 1 client.4422 shutdown 2024-05-04T00:31:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.033+0000 7f2b89a42000 1 -- 172.21.15.6:0/1972463039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e30a77c0 msgr2=0x55a4e35d29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.033+0000 7f2b89a42000 1 --2- 172.21.15.6:0/1972463039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e30a77c0 0x55a4e35d29d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009120 tx=0x7f2b6c0046d0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.033+0000 7f2b89a42000 1 -- 172.21.15.6:0/1972463039 shutdown_connections 2024-05-04T00:31:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.033+0000 7f2b89a42000 1 --2- 172.21.15.6:0/1972463039 >> [v2:172.21.15.6:6836/639743836,v1:172.21.15.6:6837/639743836] conn(0x55a4e308c7d0 0x55a4e35e2cc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.033+0000 7f2b89a42000 1 --2- 172.21.15.6:0/1972463039 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4e348ff80 0x55a4e35e1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.033+0000 7f2b5affd640 0 client.4422 ms_handle_reset on v2:172.21.15.6:6836/639743836 2024-05-04T00:31:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.033+0000 7f2b89a42000 1 --2- 172.21.15.6:0/1972463039 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e34796b0 0x55a4e35d2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.033+0000 7f2b89a42000 1 --2- 172.21.15.6:0/1972463039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e30a77c0 0x55a4e35d29d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.033+0000 7f2b89a42000 1 -- 172.21.15.6:0/1972463039 >> 172.21.15.6:0/1972463039 conn(0x55a4e3566340 msgr2=0x55a4e35d3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.033+0000 7f2b89a42000 1 -- 172.21.15.6:0/1972463039 shutdown_connections 2024-05-04T00:31:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.033+0000 7f2b89a42000 1 -- 172.21.15.6:0/1972463039 wait complete. 2024-05-04T00:31:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.033+0000 7f2b89a42000 20 client.4422 trim_cache size 0 max 16384 2024-05-04T00:31:54.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.089+0000 7f2b89a42000 1 Processor -- start 2024-05-04T00:31:54.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.089+0000 7f2b89a42000 1 -- start start 2024-05-04T00:31:54.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.089+0000 7f2b89a42000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4e30a77c0 0x55a4e35f2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:54.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.089+0000 7f2b89a42000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e34796b0 0x55a4e35f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:54.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.089+0000 7f2b89a42000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e348ff80 0x55a4e35f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:54.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.089+0000 7f2b89a42000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c0cc1f0 con 0x55a4e348ff80 2024-05-04T00:31:54.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.089+0000 7f2b89a42000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c0cc840 con 0x55a4e30a77c0 2024-05-04T00:31:54.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.089+0000 7f2b89a42000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55a4e33eb6c0 con 0x55a4e34796b0 2024-05-04T00:31:54.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.093+0000 7f2b7b7fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e34796b0 0x55a4e35f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:54.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.093+0000 7f2b7bfff640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4e30a77c0 0x55a4e35f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:54.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.093+0000 7f2b7b7fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e34796b0 0x55a4e35f2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:32812/0 (socket says 172.21.15.6:32812) 2024-05-04T00:31:54.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.093+0000 7f2b7b7fe640 1 -- 172.21.15.6:0/3366733504 learned_addr learned my addr 172.21.15.6:0/3366733504 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:54.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.101+0000 7f2b7b7fe640 1 -- 172.21.15.6:0/3366733504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4e30a77c0 msgr2=0x55a4e35f2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:54.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.101+0000 7f2b7b7fe640 1 --2- 172.21.15.6:0/3366733504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4e30a77c0 0x55a4e35f2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.101+0000 7f2b7b7fe640 1 -- 172.21.15.6:0/3366733504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e348ff80 msgr2=0x55a4e35f31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:54.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.101+0000 7f2b7b7fe640 1 --2- 172.21.15.6:0/3366733504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e348ff80 0x55a4e35f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.101+0000 7f2b7b7fe640 1 -- 172.21.15.6:0/3366733504 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4e33c0af0 con 0x55a4e34796b0 2024-05-04T00:31:54.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.105+0000 7f2b7b7fe640 1 --2- 172.21.15.6:0/3366733504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e34796b0 0x55a4e35f2c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2b64005d00 tx=0x7f2b6400f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2e63f99891dba29 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:54.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.125+0000 7f2b717fa640 1 -- 172.21.15.6:0/3366733504 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b64016110 con 0x55a4e34796b0 2024-05-04T00:31:54.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.125+0000 7f2b717fa640 1 -- 172.21.15.6:0/3366733504 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b64007560 con 0x55a4e34796b0 2024-05-04T00:31:54.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.125+0000 7f2b717fa640 1 -- 172.21.15.6:0/3366733504 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b640162b0 con 0x55a4e34796b0 2024-05-04T00:31:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.129+0000 7f2b89a42000 1 -- 172.21.15.6:0/3366733504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e34796b0 msgr2=0x55a4e35f2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.129+0000 7f2b89a42000 1 --2- 172.21.15.6:0/3366733504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e34796b0 0x55a4e35f2c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2b64005d00 tx=0x7f2b6400f000 comp rx=0 tx=0).stop 2024-05-04T00:31:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.129+0000 7f2b89a42000 1 -- 172.21.15.6:0/3366733504 shutdown_connections 2024-05-04T00:31:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.129+0000 7f2b89a42000 1 --2- 172.21.15.6:0/3366733504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e348ff80 0x55a4e35f31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.129+0000 7f2b89a42000 1 --2- 172.21.15.6:0/3366733504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e34796b0 0x55a4e35f2c80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.129+0000 7f2b89a42000 1 --2- 172.21.15.6:0/3366733504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4e30a77c0 0x55a4e35f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.129+0000 7f2b89a42000 1 -- 172.21.15.6:0/3366733504 >> 172.21.15.6:0/3366733504 conn(0x55a4e3566340 msgr2=0x55a4e35ecff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:54.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.129+0000 7f2b89a42000 1 -- 172.21.15.6:0/3366733504 shutdown_connections 2024-05-04T00:31:54.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.129+0000 7f2b89a42000 1 -- 172.21.15.6:0/3366733504 wait complete. 2024-05-04T00:31:54.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.129+0000 7f2b89a42000 1 -- start start 2024-05-04T00:31:54.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.129+0000 7f2b89a42000 1 Processor -- start 2024-05-04T00:31:54.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.133+0000 7f2b89a42000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e30a77c0 0x55a4e35f5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:54.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.133+0000 7f2b89a42000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e34796b0 0x55a4e35f5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:54.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.133+0000 7f2b89a42000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4e348ff80 0x55a4e35f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:54.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.133+0000 7f2b89a42000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a4e337c7d0 con 0x55a4e34796b0 2024-05-04T00:31:54.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.133+0000 7f2b89a42000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55a4e33e3050 con 0x55a4e348ff80 2024-05-04T00:31:54.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.133+0000 7f2b89a42000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55a4e338a7d0 con 0x55a4e30a77c0 2024-05-04T00:31:54.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.133+0000 7f2b89a42000 10 client.0 _ll_register_callbacks cb 0x7f2b6c0be070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-04T00:31:54.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.133+0000 7f2b7b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e34796b0 0x55a4e35f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:54.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.133+0000 7f2b7b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e34796b0 0x55a4e35f5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56764/0 (socket says 172.21.15.6:56764) 2024-05-04T00:31:54.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.133+0000 7f2b7b7fe640 1 -- 172.21.15.6:0/1649089677 learned_addr learned my addr 172.21.15.6:0/1649089677 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:54.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.137+0000 7f2b7b7fe640 1 -- 172.21.15.6:0/1649089677 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e30a77c0 msgr2=0x55a4e35f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:54.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.137+0000 7f2b7b7fe640 1 --2- 172.21.15.6:0/1649089677 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e30a77c0 0x55a4e35f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.137+0000 7f2b7b7fe640 1 -- 172.21.15.6:0/1649089677 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4e348ff80 msgr2=0x55a4e35f5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:54.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.137+0000 7f2b7b7fe640 1 --2- 172.21.15.6:0/1649089677 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4e348ff80 0x55a4e35f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.137+0000 7f2b7b7fe640 1 -- 172.21.15.6:0/1649089677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4e33bfe40 con 0x55a4e34796b0 2024-05-04T00:31:54.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.141+0000 7f2b7b7fe640 1 --2- 172.21.15.6:0/1649089677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e34796b0 0x55a4e35f5770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2b64005890 tx=0x7f2b64001060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf87a14a64e860a server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:54.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.141+0000 7f2b5affd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-04T00:31:54.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.149+0000 7f2b5affd640 1 -- 172.21.15.6:0/1649089677 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b64017e20 con 0x55a4e34796b0 2024-05-04T00:31:54.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.149+0000 7f2b5affd640 1 -- 172.21.15.6:0/1649089677 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f2b64025800 con 0x55a4e34796b0 2024-05-04T00:31:54.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.149+0000 7f2b89a42000 1 -- 172.21.15.6:0/1649089677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b64007560 con 0x55a4e34796b0 2024-05-04T00:31:54.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.149+0000 7f2b5affd640 1 -- 172.21.15.6:0/1649089677 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f2b64005980 con 0x55a4e34796b0 2024-05-04T00:31:54.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.149+0000 7f2b89a42000 10 client.4425 fetch_fsmap learned FSMap version 12 2024-05-04T00:31:54.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.149+0000 7f2b89a42000 1 -- 172.21.15.6:0/1649089677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x55a4e34674e0 con 0x55a4e34796b0 2024-05-04T00:31:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.161+0000 7f2b5affd640 1 -- 172.21.15.6:0/1649089677 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b64007560 con 0x55a4e34796b0 2024-05-04T00:31:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.161+0000 7f2b5affd640 1 -- 172.21.15.6:0/1649089677 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 12) ==== 4744+0+0 (secure 0 0 0) 0x7f2b64025a20 con 0x55a4e34796b0 2024-05-04T00:31:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.161+0000 7f2b89a42000 10 client.4425 fetch_fsmap finished waiting for FSMap version 12 2024-05-04T00:31:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.161+0000 7f2b89a42000 10 client.4425 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-04T00:31:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.161+0000 7f2b89a42000 20 client.4425 populate_metadata read hostname 'smithi006' 2024-05-04T00:31:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.161+0000 7f2b89a42000 1 --2- 172.21.15.6:0/1649089677 >> [v2:172.21.15.6:6836/639743836,v1:172.21.15.6:6837/639743836] conn(0x55a4e307a830 0x55a4e365b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.161+0000 7f2b89a42000 4 client.4425 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-04T00:31:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.161+0000 7f2b89a42000 1 -- 172.21.15.6:0/1649089677 --> [v2:172.21.15.6:6836/639743836,v1:172.21.15.6:6837/639743836] -- command(tid 0: {"prefix": "status"}) -- 0x55a4e33f4ca0 con 0x55a4e307a830 2024-05-04T00:31:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.161+0000 7f2b7bfff640 1 --2- 172.21.15.6:0/1649089677 >> [v2:172.21.15.6:6836/639743836,v1:172.21.15.6:6837/639743836] conn(0x55a4e307a830 0x55a4e365b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:54.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.169+0000 7f2b7bfff640 1 --2- 172.21.15.6:0/1649089677 >> [v2:172.21.15.6:6836/639743836,v1:172.21.15.6:6837/639743836] conn(0x55a4e307a830 0x55a4e365b510 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63cd5b96ef3fc2c server_cookie=18facbc00ec280c6 in_seq=0 out_seq=0 2024-05-04T00:31:54.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.169+0000 7f2b5affd640 10 client.4425 ms_handle_connect on v2:172.21.15.6:6836/639743836 2024-05-04T00:31:54.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.193+0000 7f2b5affd640 1 -- 172.21.15.6:0/1649089677 <== mds.0 v2:172.21.15.6:6836/639743836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55a4e33f4ca0 con 0x55a4e307a830 2024-05-04T00:31:54.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.193+0000 7f2b5affd640 10 client.4425 handle_command_reply: tid=0 2024-05-04T00:31:54.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b89a42000 1 client.4425 shutdown 2024-05-04T00:31:54.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b89a42000 1 -- 172.21.15.6:0/1649089677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e34796b0 msgr2=0x55a4e35f5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:54.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b89a42000 1 --2- 172.21.15.6:0/1649089677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e34796b0 0x55a4e35f5770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2b64005890 tx=0x7f2b64001060 comp rx=0 tx=0).stop 2024-05-04T00:31:54.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b89a42000 1 -- 172.21.15.6:0/1649089677 shutdown_connections 2024-05-04T00:31:54.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b89a42000 1 --2- 172.21.15.6:0/1649089677 >> [v2:172.21.15.6:6836/639743836,v1:172.21.15.6:6837/639743836] conn(0x55a4e307a830 0x55a4e365b510 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b89a42000 1 --2- 172.21.15.6:0/1649089677 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4e348ff80 0x55a4e35f5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b89a42000 1 --2- 172.21.15.6:0/1649089677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4e34796b0 0x55a4e35f5770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b89a42000 1 --2- 172.21.15.6:0/1649089677 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55a4e30a77c0 0x55a4e35f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b5affd640 0 client.4425 ms_handle_reset on v2:172.21.15.6:6836/639743836 2024-05-04T00:31:54.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b89a42000 1 -- 172.21.15.6:0/1649089677 >> 172.21.15.6:0/1649089677 conn(0x55a4e3566340 msgr2=0x55a4e359c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:54.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b89a42000 1 -- 172.21.15.6:0/1649089677 shutdown_connections 2024-05-04T00:31:54.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b89a42000 1 -- 172.21.15.6:0/1649089677 wait complete. 2024-05-04T00:31:54.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b89a42000 20 client.4425 trim_cache size 0 max 16384 2024-05-04T00:31:54.200 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-04T00:31:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "ad5951ed-0d5e-4770-b5d9-995e08a00213", 2024-05-04T00:31:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-05-04T00:31:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4276, 2024-05-04T00:31:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-04T00:31:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-04T00:31:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-04T00:31:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 30.592208389, 2024-05-04T00:31:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 12, 2024-05-04T00:31:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 26, 2024-05-04T00:31:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 26, 2024-05-04T00:31:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 46.825721739999999 2024-05-04T00:31:54.200 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-04T00:31:54.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b826e4640 1 -- 172.21.15.6:0/1752974957 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f2b5c06f3b0 msgr2=0x7f2b5c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:54.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b826e4640 1 --2- 172.21.15.6:0/1752974957 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f2b5c06f3b0 0x7f2b5c0718c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c159e50 tx=0x7f2b64007960 comp rx=0 tx=0).stop 2024-05-04T00:31:54.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b826e4640 1 -- 172.21.15.6:0/1752974957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b7c06f860 msgr2=0x7f2b7c1404b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:54.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b826e4640 1 --2- 172.21.15.6:0/1752974957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b7c06f860 0x7f2b7c1404b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400efc0 tx=0x7f2b7400c490 comp rx=0 tx=0).stop 2024-05-04T00:31:54.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b826e4640 1 -- 172.21.15.6:0/1752974957 shutdown_connections 2024-05-04T00:31:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b826e4640 1 --2- 172.21.15.6:0/1752974957 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f2b5c06f3b0 0x7f2b5c0718c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b826e4640 1 --2- 172.21.15.6:0/1752974957 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2b7c0c7120 0x7f2b7c13e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b826e4640 1 --2- 172.21.15.6:0/1752974957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b7c0726f0 0x7f2b7c147f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b826e4640 1 --2- 172.21.15.6:0/1752974957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b7c06f860 0x7f2b7c1404b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b826e4640 1 -- 172.21.15.6:0/1752974957 >> 172.21.15.6:0/1752974957 conn(0x7f2b7c06cf70 msgr2=0x7f2b7c13f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b826e4640 1 -- 172.21.15.6:0/1752974957 shutdown_connections 2024-05-04T00:31:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.197+0000 7f2b826e4640 1 -- 172.21.15.6:0/1752974957 wait complete. 2024-05-04T00:31:54.226 INFO:teuthology.run_tasks:Running task sequential... 2024-05-04T00:31:54.237 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-04T00:31:54.237 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-04T00:31:54.237 INFO:teuthology.task.print:Enabling mgr modules 2024-05-04T00:31:54.237 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-04T00:31:54.295 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-04T00:31:54.295 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-04T00:31:54.295 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-05-04T00:31:54.295 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-04T00:31:54.295 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-04T00:31:54.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:31:54.295 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-04T00:31:54.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:31:54.303 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2024-05-04T00:31:54.366 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2024-05-04T00:31:54.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T00:31:54.368 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-04T00:31:54.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-04T00:31:54.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.569+0000 7fc35b83b640 1 Processor -- start 2024-05-04T00:31:54.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.569+0000 7fc35b83b640 1 -- start start 2024-05-04T00:31:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.569+0000 7fc35b83b640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc35406d6a0 0x7fc3540ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.569+0000 7fc35b83b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc354156a60 con 0x7fc354156650 2024-05-04T00:31:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.569+0000 7fc35b83b640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc35415c4c0 con 0x7fc3540ca420 2024-05-04T00:31:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.569+0000 7fc35b83b640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fc354070f90 con 0x7fc35406d6a0 2024-05-04T00:31:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.569+0000 7fc3595d7640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc354156650 0x7fc3540cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34182/0 (socket says 172.21.15.6:34182) 2024-05-04T00:31:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.569+0000 7fc3595d7640 1 -- 172.21.15.6:0/2832793226 learned_addr learned my addr 172.21.15.6:0/2832793226 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T00:31:54.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.573+0000 7fc359dd8640 1 --2- 172.21.15.6:0/2832793226 >> v2:172.21.15.163:3300/0 conn(0x7fc35406d6a0 0x7fc3540ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:54.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.573+0000 7fc353fff640 1 -- 172.21.15.6:0/2832793226 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2208507557 0 0) 0x7fc354156a60 con 0x7fc354156650 2024-05-04T00:31:54.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.573+0000 7fc353fff640 1 -- 172.21.15.6:0/2832793226 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc33c003530 con 0x7fc354156650 2024-05-04T00:31:54.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.577+0000 7fc353fff640 1 -- 172.21.15.6:0/2832793226 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1257191442 0 0) 0x7fc33c003530 con 0x7fc354156650 2024-05-04T00:31:54.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.581+0000 7fc353fff640 1 -- 172.21.15.6:0/2832793226 >> v2:172.21.15.163:3300/0 conn(0x7fc35406d6a0 msgr2=0x7fc3540ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:54.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.581+0000 7fc353fff640 1 --2- 172.21.15.6:0/2832793226 >> v2:172.21.15.163:3300/0 conn(0x7fc35406d6a0 0x7fc3540ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.581+0000 7fc353fff640 1 -- 172.21.15.6:0/2832793226 >> v1:172.21.15.163:6789/0 conn(0x7fc3540ca420 legacy=0x7fc35406cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:54.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.581+0000 7fc353fff640 1 -- 172.21.15.6:0/2832793226 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35415c7a0 con 0x7fc354156650 2024-05-04T00:31:54.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.581+0000 7fc353fff640 1 -- 172.21.15.6:0/2832793226 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 557976392 0 0) 0x7fc34c001700 con 0x7fc354156650 2024-05-04T00:31:54.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.581+0000 7fc353fff640 1 -- 172.21.15.6:0/2832793226 >> v1:172.21.15.6:6789/0 conn(0x7fc354156650 legacy=0x7fc3540cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:54.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.581+0000 7fc353fff640 1 --2- 172.21.15.6:0/2832793226 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc33c003a60 0x7fc33c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:54.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.581+0000 7fc353fff640 1 --2- 172.21.15.6:0/2832793226 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc33c004810 0x7fc33c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:54.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.581+0000 7fc353fff640 1 --2- 172.21.15.6:0/2832793226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc33c005280 0x7fc33c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:54.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.581+0000 7fc353fff640 1 -- 172.21.15.6:0/2832793226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c00c1b0 con 0x7fc33c005280 2024-05-04T00:31:54.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.581+0000 7fc353fff640 1 -- 172.21.15.6:0/2832793226 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c00c360 con 0x7fc33c003a60 2024-05-04T00:31:54.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.581+0000 7fc353fff640 1 -- 172.21.15.6:0/2832793226 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fc33c00c560 con 0x7fc33c004810 2024-05-04T00:31:54.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.581+0000 7fc358dd6640 1 --2- 172.21.15.6:0/2832793226 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc33c004810 0x7fc33c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:54.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.581+0000 7fc359dd8640 1 --2- 172.21.15.6:0/2832793226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc33c005280 0x7fc33c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:54.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.585+0000 7fc359dd8640 1 -- 172.21.15.6:0/2832793226 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc33c004810 msgr2=0x7fc33c004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:54.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.585+0000 7fc359dd8640 1 --2- 172.21.15.6:0/2832793226 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc33c004810 0x7fc33c004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.585+0000 7fc359dd8640 1 -- 172.21.15.6:0/2832793226 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc33c003a60 msgr2=0x7fc33c003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T00:31:54.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.585+0000 7fc359dd8640 1 --2- 172.21.15.6:0/2832793226 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc33c003a60 0x7fc33c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.585+0000 7fc359dd8640 1 -- 172.21.15.6:0/2832793226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33c003530 con 0x7fc33c005280 2024-05-04T00:31:54.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.589+0000 7fc359dd8640 1 -- 172.21.15.6:0/2832793226 reap_dead start 2024-05-04T00:31:54.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.589+0000 7fc359dd8640 1 --2- 172.21.15.6:0/2832793226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc33c005280 0x7fc33c00b9d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc344009f90 tx=0x7fc34401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7699d377026dae server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:54.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.593+0000 7fc353fff640 1 -- 172.21.15.6:0/2832793226 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344009c10 con 0x7fc33c005280 2024-05-04T00:31:54.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.593+0000 7fc353fff640 1 -- 172.21.15.6:0/2832793226 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3440a5c90 con 0x7fc33c005280 2024-05-04T00:31:54.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.593+0000 7fc353fff640 1 -- 172.21.15.6:0/2832793226 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344003be0 con 0x7fc33c005280 2024-05-04T00:31:54.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.593+0000 7fc35b83b640 1 -- 172.21.15.6:0/2832793226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc33c005280 msgr2=0x7fc33c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:54.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.593+0000 7fc35b83b640 1 --2- 172.21.15.6:0/2832793226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc33c005280 0x7fc33c00b9d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc344009f90 tx=0x7fc34401cc80 comp rx=0 tx=0).stop 2024-05-04T00:31:54.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.597+0000 7fc35b83b640 1 -- 172.21.15.6:0/2832793226 shutdown_connections 2024-05-04T00:31:54.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.597+0000 7fc35b83b640 1 --2- 172.21.15.6:0/2832793226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc33c005280 0x7fc33c00b9d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.597+0000 7fc35b83b640 1 -- 172.21.15.6:0/2832793226 >> 172.21.15.6:0/2832793226 conn(0x7fc354072ce0 msgr2=0x7fc3540704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:54.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.597+0000 7fc35b83b640 1 -- 172.21.15.6:0/2832793226 shutdown_connections 2024-05-04T00:31:54.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.597+0000 7fc35b83b640 1 -- 172.21.15.6:0/2832793226 wait complete. 2024-05-04T00:31:54.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.597+0000 7fc35b83b640 1 Processor -- start 2024-05-04T00:31:54.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.597+0000 7fc35b83b640 1 -- start start 2024-05-04T00:31:54.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.597+0000 7fc35b83b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc33c005280 0x7fc3540b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:54.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.597+0000 7fc35b83b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3540b2860 0x7fc3541f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:54.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.597+0000 7fc35b83b640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3540b0240 0x7fc35414dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:54.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.597+0000 7fc35b83b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc35415ca80 con 0x7fc3540b2860 2024-05-04T00:31:54.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.597+0000 7fc35b83b640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc35415d0d0 con 0x7fc3540b0240 2024-05-04T00:31:54.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.597+0000 7fc35b83b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fc35415cd60 con 0x7fc33c005280 2024-05-04T00:31:54.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.601+0000 7fc358dd6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3540b2860 0x7fc3541f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:54.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.601+0000 7fc358dd6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3540b2860 0x7fc3541f2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56776/0 (socket says 172.21.15.6:56776) 2024-05-04T00:31:54.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.601+0000 7fc358dd6640 1 -- 172.21.15.6:0/915894943 learned_addr learned my addr 172.21.15.6:0/915894943 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T00:31:54.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.601+0000 7fc3595d7640 1 --2- 172.21.15.6:0/915894943 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc33c005280 0x7fc3540b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:54.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.601+0000 7fc359dd8640 1 --2- 172.21.15.6:0/915894943 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3540b0240 0x7fc35414dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:54.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.605+0000 7fc358dd6640 1 -- 172.21.15.6:0/915894943 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc33c005280 msgr2=0x7fc3540b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:54.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.605+0000 7fc358dd6640 1 --2- 172.21.15.6:0/915894943 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc33c005280 0x7fc3540b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.605+0000 7fc358dd6640 1 -- 172.21.15.6:0/915894943 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3540b0240 msgr2=0x7fc35414dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:54.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.605+0000 7fc358dd6640 1 --2- 172.21.15.6:0/915894943 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3540b0240 0x7fc35414dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:54.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.605+0000 7fc358dd6640 1 -- 172.21.15.6:0/915894943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3541f2670 con 0x7fc3540b2860 2024-05-04T00:31:54.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.605+0000 7fc358dd6640 1 --2- 172.21.15.6:0/915894943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3540b2860 0x7fc3541f2130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc34800f640 tx=0x7fc34800fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:54.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.613+0000 7fc351ffb640 1 -- 172.21.15.6:0/915894943 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348003a80 con 0x7fc3540b2860 2024-05-04T00:31:54.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.613+0000 7fc351ffb640 1 -- 172.21.15.6:0/915894943 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc348003c40 con 0x7fc3540b2860 2024-05-04T00:31:54.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.613+0000 7fc351ffb640 1 -- 172.21.15.6:0/915894943 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348007030 con 0x7fc3540b2860 2024-05-04T00:31:54.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.613+0000 7fc35b83b640 1 -- 172.21.15.6:0/915894943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3540af8b0 con 0x7fc3540b2860 2024-05-04T00:31:54.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.613+0000 7fc35b83b640 1 -- 172.21.15.6:0/915894943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3540b1010 con 0x7fc3540b2860 2024-05-04T00:31:54.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.613+0000 7fc35b83b640 1 -- 172.21.15.6:0/915894943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc354069a50 con 0x7fc3540b2860 2024-05-04T00:31:54.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.637+0000 7fc351ffb640 1 -- 172.21.15.6:0/915894943 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc3480071d0 con 0x7fc3540b2860 2024-05-04T00:31:54.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.637+0000 7fc351ffb640 1 --2- 172.21.15.6:0/915894943 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fc34006f480 0x7fc340071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T00:31:54.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.637+0000 7fc3595d7640 1 --2- 172.21.15.6:0/915894943 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fc34006f480 0x7fc340071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T00:31:54.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.641+0000 7fc3595d7640 1 --2- 172.21.15.6:0/915894943 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fc34006f480 0x7fc340071990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc34c001c30 tx=0x7fc34c001bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T00:31:54.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.989+0000 7fc351ffb640 1 -- 172.21.15.6:0/915894943 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fc348058720 con 0x7fc3540b2860 2024-05-04T00:31:54.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:54.989+0000 7fc351ffb640 1 -- 172.21.15.6:0/915894943 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc34805c490 con 0x7fc3540b2860 2024-05-04T00:31:55.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55.205+0000 7fc35b83b640 1 -- 172.21.15.6:0/915894943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc354070d70 con 0x7fc3540b2860 2024-05-04T00:31:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55.217+0000 7fc351ffb640 1 -- 172.21.15.6:0/915894943 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) ==== 53+0+73 (secure 0 0 0) 0x7fc348060790 con 0x7fc3540b2860 2024-05-04T00:31:55.221 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-04T00:31:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55.221+0000 7fc35b83b640 1 -- 172.21.15.6:0/915894943 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fc34006f480 msgr2=0x7fc340071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55.221+0000 7fc35b83b640 1 --2- 172.21.15.6:0/915894943 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fc34006f480 0x7fc340071990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc34c001c30 tx=0x7fc34c001bc0 comp rx=0 tx=0).stop 2024-05-04T00:31:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55.221+0000 7fc35b83b640 1 -- 172.21.15.6:0/915894943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3540b2860 msgr2=0x7fc3541f2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T00:31:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55.221+0000 7fc35b83b640 1 --2- 172.21.15.6:0/915894943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3540b2860 0x7fc3541f2130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc34800f640 tx=0x7fc34800fb00 comp rx=0 tx=0).stop 2024-05-04T00:31:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55.221+0000 7fc35b83b640 1 -- 172.21.15.6:0/915894943 shutdown_connections 2024-05-04T00:31:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55.221+0000 7fc35b83b640 1 --2- 172.21.15.6:0/915894943 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3540b0240 0x7fc35414dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55.221+0000 7fc35b83b640 1 --2- 172.21.15.6:0/915894943 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fc34006f480 0x7fc340071990 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55.221+0000 7fc35b83b640 1 --2- 172.21.15.6:0/915894943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3540b2860 0x7fc3541f2130 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55.221+0000 7fc35b83b640 1 --2- 172.21.15.6:0/915894943 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc33c005280 0x7fc3540b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T00:31:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55.221+0000 7fc35b83b640 1 -- 172.21.15.6:0/915894943 >> 172.21.15.6:0/915894943 conn(0x7fc354072ce0 msgr2=0x7fc3541522e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T00:31:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55.221+0000 7fc35b83b640 1 -- 172.21.15.6:0/915894943 shutdown_connections 2024-05-04T00:31:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55.221+0000 7fc35b83b640 1 -- 172.21.15.6:0/915894943 wait complete. 2024-05-04T00:31:55.245 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-04T00:31:55.245 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-04T00:31:55.245 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-05-04T00:31:55.246 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-04T00:31:55.246 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-04T00:31:55.246 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-04T00:31:55.246 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-04T00:31:55.246 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-04T00:31:55.246 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-04T00:31:55.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:31:55.247 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-05-04T00:31:55.253 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-04T00:31:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-04T00:31:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-05-04T00:31:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-04T00:31:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-05-04T00:31:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-04T00:31:55.253 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-04T00:31:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-05-04T00:31:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-05-04T00:31:55.253 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-04T00:31:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-05-04T00:31:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-05-04T00:31:55.254 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-04T00:31:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-05-04T00:31:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-05-04T00:31:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-04T00:31:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42093sec preferred_lft 42093sec 2024-05-04T00:31:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2024-05-04T00:31:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-04T00:31:55.254 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-04T00:31:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-05-04T00:31:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-05-04T00:31:55.255 INFO:teuthology.orchestra.run.smithi006.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-04T00:31:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:42:81:24:93:a6 brd ff:ff:ff:ff:ff:ff 2024-05-04T00:31:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-04T00:31:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-04T00:31:55.255 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-04T00:31:55.255 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T00:31:55.255 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-04T00:31:55.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2024-05-04T00:31:55.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2024-05-04T00:31:55.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2024-05-04T00:31:55.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-04T00:31:55.256 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-04T00:31:55.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T00:31:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T00:31:55.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:31:55.383 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-04T00:31:55.434 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-05-04T00:31:55.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:31:55.436 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-05-04T00:31:55.495 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-05-04T00:31:55.495 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-04T00:31:55.495 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-04T00:31:55.495 INFO:teuthology.orchestra.run.smithi006.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-04T00:31:55.496 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-04T00:31:55.496 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-04T00:31:55.496 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T00:31:55.496 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-04T00:31:55.496 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-04T00:31:55.496 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-04T00:31:55.496 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-04T00:31:55.496 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-04T00:31:55.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T00:31:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T00:31:55.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:31:55.610 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-04T00:31:55.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:31:55.659 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2024-05-04T00:31:55.708 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T00:31:55.708 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-04T00:31:55.708 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:31:55.708 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-04T00:31:55.708 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-04T00:31:55.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T00:31:55.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T00:31:55.822 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-04T00:31:55.822 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T00:31:55.822 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-04T00:31:55.823 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-04T00:31:55.823 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-04T00:31:55.823 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-04T00:31:55.823 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-04T00:31:55.823 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-04T00:31:55.823 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-04T00:31:55.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T00:31:55.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T00:31:55.978 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T00:31:55.978 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-04T00:31:55.978 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-05-04T00:31:55.978 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2024-05-04T00:31:55.978 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-04T00:31:56.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T00:31:56.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:31:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T00:31:56.082 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-05-04T00:31:56.083 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-04T00:31:56.083 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-04T00:31:56.130 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-04T00:31:56.131 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-04T00:31:56.131 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-04T00:31:56.177 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-05-04T00:31:56.178 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-05-04T00:31:56.235 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T00:31:56.283 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-05-04T00:31:56.283 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-05-04T00:31:56.283 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-05-04T00:31:56.283 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-05-04T00:31:56.283 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-05-04T00:31:56.283 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-05-04T00:31:56.283 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-05-04T00:31:56.284 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-05-04T00:31:56.284 INFO:teuthology.orchestra.run.smithi006.stdout:/run/lock 2024-05-04T00:31:56.284 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-05-04T00:31:56.284 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-05-04T00:31:56.284 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-05-04T00:31:56.284 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T00:31:56.284 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-05-04T00:31:56.284 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-05-04T00:31:56.284 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-05-04T00:31:56.284 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-05-04T00:31:56.284 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/fs/nfsd 2024-05-04T00:31:56.284 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-05-04T00:31:56.284 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-05-04T00:31:56.284 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysusers.service 2024-05-04T00:31:56.285 INFO:teuthology.orchestra.run.smithi006.stdout:/run/rpc_pipefs 2024-05-04T00:31:56.285 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-05-04T00:31:56.285 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-05-04T00:31:56.285 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T00:31:56.285 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T00:31:56.285 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T00:31:56.285 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T00:31:56.285 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-05-04T00:31:56.285 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:31:56.285 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:31:56.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:31:56.286 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-05-04T00:31:56.335 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-04T00:31:56.335 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-04T00:31:56.380 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-05-04T00:31:56.395 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T00:31:56.447 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-05-04T00:31:56.447 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-05-04T00:31:56.447 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-05-04T00:31:56.447 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-05-04T00:31:56.447 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-05-04T00:31:56.447 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-05-04T00:31:56.447 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-05-04T00:31:56.447 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-05-04T00:31:56.447 INFO:teuthology.orchestra.run.smithi006.stdout:/run/lock 2024-05-04T00:31:56.447 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-05-04T00:31:56.447 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-05-04T00:31:56.448 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-05-04T00:31:56.448 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T00:31:56.448 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-05-04T00:31:56.448 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-05-04T00:31:56.448 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-05-04T00:31:56.448 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-05-04T00:31:56.448 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/fs/nfsd 2024-05-04T00:31:56.448 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-05-04T00:31:56.448 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-05-04T00:31:56.448 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysusers.service 2024-05-04T00:31:56.448 INFO:teuthology.orchestra.run.smithi006.stdout:/run/rpc_pipefs 2024-05-04T00:31:56.448 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-05-04T00:31:56.448 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-05-04T00:31:56.448 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T00:31:56.448 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T00:31:56.449 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T00:31:56.449 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T00:31:56.449 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-05-04T00:31:56.449 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:31:56.449 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:31:56.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:31:56.450 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-05-04T00:31:57.599 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-05-04T00:31:57.614 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T00:31:57.662 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-05-04T00:31:57.663 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-05-04T00:31:57.663 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-05-04T00:31:57.663 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-05-04T00:31:57.663 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-05-04T00:31:57.663 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-05-04T00:31:57.663 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-05-04T00:31:57.663 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-05-04T00:31:57.663 INFO:teuthology.orchestra.run.smithi006.stdout:/run/lock 2024-05-04T00:31:57.663 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-05-04T00:31:57.663 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-05-04T00:31:57.663 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-05-04T00:31:57.664 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T00:31:57.664 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-05-04T00:31:57.664 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-05-04T00:31:57.664 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-05-04T00:31:57.664 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-05-04T00:31:57.664 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/fs/nfsd 2024-05-04T00:31:57.664 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-05-04T00:31:57.664 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-05-04T00:31:57.664 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysusers.service 2024-05-04T00:31:57.664 INFO:teuthology.orchestra.run.smithi006.stdout:/run/rpc_pipefs 2024-05-04T00:31:57.664 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-05-04T00:31:57.664 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-05-04T00:31:57.664 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T00:31:57.664 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T00:31:57.664 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T00:31:57.665 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T00:31:57.665 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-05-04T00:31:57.665 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:31:57.665 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:31:57.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:31:57.666 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-05-04T00:31:58.815 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-05-04T00:31:58.828 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T00:31:58.874 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-05-04T00:31:58.874 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-05-04T00:31:58.874 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-05-04T00:31:58.874 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-05-04T00:31:58.874 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-05-04T00:31:58.874 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-05-04T00:31:58.875 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-05-04T00:31:58.875 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-05-04T00:31:58.875 INFO:teuthology.orchestra.run.smithi006.stdout:/run/lock 2024-05-04T00:31:58.875 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-05-04T00:31:58.875 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-05-04T00:31:58.875 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-05-04T00:31:58.875 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T00:31:58.875 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-05-04T00:31:58.875 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-05-04T00:31:58.875 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-05-04T00:31:58.875 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-05-04T00:31:58.875 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/fs/nfsd 2024-05-04T00:31:58.875 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-05-04T00:31:58.875 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-05-04T00:31:58.876 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysusers.service 2024-05-04T00:31:58.876 INFO:teuthology.orchestra.run.smithi006.stdout:/run/rpc_pipefs 2024-05-04T00:31:58.876 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-05-04T00:31:58.876 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-05-04T00:31:58.876 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T00:31:58.876 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T00:31:58.876 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T00:31:58.876 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T00:31:58.876 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-05-04T00:31:58.876 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:31:58.876 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:31:58.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:31:58.877 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-05-04T00:32:00.027 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-05-04T00:32:00.042 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T00:32:00.090 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-05-04T00:32:00.091 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-05-04T00:32:00.091 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-05-04T00:32:00.091 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-05-04T00:32:00.091 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-05-04T00:32:00.091 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-05-04T00:32:00.091 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-05-04T00:32:00.091 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-05-04T00:32:00.091 INFO:teuthology.orchestra.run.smithi006.stdout:/run/lock 2024-05-04T00:32:00.091 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-05-04T00:32:00.091 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-05-04T00:32:00.091 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-05-04T00:32:00.091 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T00:32:00.092 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-05-04T00:32:00.092 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-05-04T00:32:00.092 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-05-04T00:32:00.092 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-05-04T00:32:00.092 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/fs/nfsd 2024-05-04T00:32:00.092 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-05-04T00:32:00.092 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-05-04T00:32:00.092 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysusers.service 2024-05-04T00:32:00.092 INFO:teuthology.orchestra.run.smithi006.stdout:/run/rpc_pipefs 2024-05-04T00:32:00.092 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-05-04T00:32:00.092 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-05-04T00:32:00.092 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T00:32:00.092 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T00:32:00.093 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T00:32:00.093 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T00:32:00.093 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-05-04T00:32:00.093 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:32:00.093 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:32:00.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:32:00.094 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-05-04T00:32:01.243 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-05-04T00:32:01.259 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T00:32:01.307 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-05-04T00:32:01.307 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-05-04T00:32:01.307 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-05-04T00:32:01.307 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-05-04T00:32:01.307 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-05-04T00:32:01.307 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-05-04T00:32:01.307 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-05-04T00:32:01.307 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-05-04T00:32:01.307 INFO:teuthology.orchestra.run.smithi006.stdout:/run/lock 2024-05-04T00:32:01.307 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-05-04T00:32:01.308 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-05-04T00:32:01.308 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-05-04T00:32:01.308 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T00:32:01.308 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-05-04T00:32:01.308 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-05-04T00:32:01.308 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-05-04T00:32:01.308 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-05-04T00:32:01.308 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/fs/nfsd 2024-05-04T00:32:01.308 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-05-04T00:32:01.308 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-05-04T00:32:01.308 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysusers.service 2024-05-04T00:32:01.308 INFO:teuthology.orchestra.run.smithi006.stdout:/run/rpc_pipefs 2024-05-04T00:32:01.308 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-05-04T00:32:01.309 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-05-04T00:32:01.309 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T00:32:01.309 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T00:32:01.309 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T00:32:01.309 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T00:32:01.309 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-05-04T00:32:01.309 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:32:01.309 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:32:01.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:32:01.310 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-05-04T00:32:02.459 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-05-04T00:32:02.472 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T00:32:02.518 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-05-04T00:32:02.518 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-05-04T00:32:02.519 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-05-04T00:32:02.519 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-05-04T00:32:02.519 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-05-04T00:32:02.519 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-05-04T00:32:02.519 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-05-04T00:32:02.519 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-05-04T00:32:02.519 INFO:teuthology.orchestra.run.smithi006.stdout:/run/lock 2024-05-04T00:32:02.519 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-05-04T00:32:02.519 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-05-04T00:32:02.519 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-05-04T00:32:02.519 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T00:32:02.519 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-05-04T00:32:02.519 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-05-04T00:32:02.520 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-05-04T00:32:02.520 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-05-04T00:32:02.520 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/fs/nfsd 2024-05-04T00:32:02.520 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-05-04T00:32:02.520 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-05-04T00:32:02.520 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysusers.service 2024-05-04T00:32:02.520 INFO:teuthology.orchestra.run.smithi006.stdout:/run/rpc_pipefs 2024-05-04T00:32:02.520 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-05-04T00:32:02.520 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-05-04T00:32:02.520 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T00:32:02.520 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T00:32:02.520 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T00:32:02.520 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T00:32:02.520 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-05-04T00:32:02.520 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:32:02.521 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:32:02.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:32:02.522 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-05-04T00:32:03.670 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-05-04T00:32:03.684 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T00:32:03.730 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-05-04T00:32:03.731 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-05-04T00:32:03.731 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-05-04T00:32:03.731 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-05-04T00:32:03.731 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-05-04T00:32:03.731 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-05-04T00:32:03.731 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-05-04T00:32:03.731 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-05-04T00:32:03.731 INFO:teuthology.orchestra.run.smithi006.stdout:/run/lock 2024-05-04T00:32:03.731 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-05-04T00:32:03.731 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-05-04T00:32:03.731 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-05-04T00:32:03.731 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T00:32:03.732 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-05-04T00:32:03.732 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-05-04T00:32:03.732 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-05-04T00:32:03.732 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-05-04T00:32:03.732 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/fs/nfsd 2024-05-04T00:32:03.732 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-05-04T00:32:03.732 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-05-04T00:32:03.732 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysusers.service 2024-05-04T00:32:03.732 INFO:teuthology.orchestra.run.smithi006.stdout:/run/rpc_pipefs 2024-05-04T00:32:03.732 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-05-04T00:32:03.732 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-05-04T00:32:03.732 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T00:32:03.732 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T00:32:03.732 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T00:32:03.733 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T00:32:03.733 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-05-04T00:32:03.733 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:32:03.733 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:32:03.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:32:03.734 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-05-04T00:32:04.217 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[34637]: starting ceph client 2024-05-04T00:32:04.325 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2024-05-04T00:32:04.093+0000 6a86100 -1 init, newargv = 0xc051c60 newargc=15 2024-05-04T00:32:04.883 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-05-04T00:32:04.899 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T00:32:04.951 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-05-04T00:32:04.951 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-05-04T00:32:04.951 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-05-04T00:32:04.952 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-05-04T00:32:04.952 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-05-04T00:32:04.952 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-05-04T00:32:04.952 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-05-04T00:32:04.952 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-05-04T00:32:04.952 INFO:teuthology.orchestra.run.smithi006.stdout:/run/lock 2024-05-04T00:32:04.952 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-05-04T00:32:04.952 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-05-04T00:32:04.952 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-05-04T00:32:04.952 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T00:32:04.953 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-05-04T00:32:04.953 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-05-04T00:32:04.953 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-05-04T00:32:04.953 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-05-04T00:32:04.953 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/fs/nfsd 2024-05-04T00:32:04.953 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-05-04T00:32:04.953 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-05-04T00:32:04.953 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysusers.service 2024-05-04T00:32:04.953 INFO:teuthology.orchestra.run.smithi006.stdout:/run/rpc_pipefs 2024-05-04T00:32:04.953 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-05-04T00:32:04.953 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-05-04T00:32:04.953 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T00:32:04.953 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T00:32:04.954 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T00:32:04.954 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T00:32:04.954 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-05-04T00:32:04.954 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:32:04.954 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:32:04.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:32:04.955 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-05-04T00:32:05.754 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[34637]: starting fuse 2024-05-04T00:32:06.104 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-05-04T00:32:06.120 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T00:32:06.168 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-05-04T00:32:06.168 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-05-04T00:32:06.169 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-05-04T00:32:06.169 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-05-04T00:32:06.169 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-05-04T00:32:06.169 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-05-04T00:32:06.169 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-05-04T00:32:06.169 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-05-04T00:32:06.169 INFO:teuthology.orchestra.run.smithi006.stdout:/run/lock 2024-05-04T00:32:06.169 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-05-04T00:32:06.169 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-05-04T00:32:06.169 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-05-04T00:32:06.169 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T00:32:06.169 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-05-04T00:32:06.169 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-05-04T00:32:06.170 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-05-04T00:32:06.170 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-05-04T00:32:06.170 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/fs/nfsd 2024-05-04T00:32:06.170 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-05-04T00:32:06.170 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-05-04T00:32:06.170 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysusers.service 2024-05-04T00:32:06.170 INFO:teuthology.orchestra.run.smithi006.stdout:/run/rpc_pipefs 2024-05-04T00:32:06.170 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-05-04T00:32:06.170 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-05-04T00:32:06.170 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T00:32:06.170 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T00:32:06.170 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T00:32:06.170 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T00:32:06.170 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-05-04T00:32:06.173 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:32:06.173 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T00:32:06.173 INFO:teuthology.orchestra.run.smithi006.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-04T00:32:06.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:32:06.174 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-05-04T00:32:06.222 INFO:teuthology.orchestra.run.smithi006.stdout:45 2024-05-04T00:32:06.222 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-05-04T00:32:06.223 DEBUG:teuthology.orchestra.run.smithi006:> sudo stdin-killer -- python3 -c ' 2024-05-04T00:32:06.223 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2024-05-04T00:32:06.223 DEBUG:teuthology.orchestra.run.smithi006:> import re 2024-05-04T00:32:06.223 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-05-04T00:32:06.223 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2024-05-04T00:32:06.223 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-04T00:32:06.223 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2024-05-04T00:32:06.223 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-04T00:32:06.223 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2024-05-04T00:32:06.223 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-04T00:32:06.223 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-04T00:32:06.223 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2024-05-04T00:32:06.223 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2024-05-04T00:32:06.224 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2024-05-04T00:32:06.224 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2024-05-04T00:32:06.224 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-04T00:32:06.224 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2024-05-04T00:32:06.224 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-04T00:32:06.224 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-04T00:32:06.224 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-04T00:32:06.224 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2024-05-04T00:32:06.224 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2024-05-04T00:32:06.224 DEBUG:teuthology.orchestra.run.smithi006:> return f 2024-05-04T00:32:06.224 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-04T00:32:06.224 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-04T00:32:06.224 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2024-05-04T00:32:06.224 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-05-04T00:32:06.350 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.34637.asok 2024-05-04T00:32:06.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T00:32:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T00:32:06.362 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34637.asok 2024-05-04T00:32:06.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:32:06.362 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34637.asok status 2024-05-04T00:32:06.704 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-04T00:32:06.704 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2024-05-04T00:32:06.704 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "bd4e00a39d766328b458e4c953f4d722fed96a31", 2024-05-04T00:32:06.704 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 19.0.0-3522-gbd4e00a3 (bd4e00a39d766328b458e4c953f4d722fed96a31) squid (dev)", 2024-05-04T00:32:06.704 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2024-05-04T00:32:06.704 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2024-05-04T00:32:06.704 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-04T00:32:06.704 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "34637", 2024-05-04T00:32:06.704 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2024-05-04T00:32:06.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-04T00:32:06.704 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2024-05-04T00:32:06.705 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2024-05-04T00:32:06.705 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4437, 2024-05-04T00:32:06.705 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2024-05-04T00:32:06.705 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2024-05-04T00:32:06.705 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-04T00:32:06.705 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 4437 2024-05-04T00:32:06.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-04T00:32:06.705 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-05-04T00:32:06.705 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-05-04T00:32:06.705 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-05-04T00:32:06.705 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 833296085 2024-05-04T00:32:06.705 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-04T00:32:06.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-04T00:32:06.705 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-05-04T00:32:06.705 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-05-04T00:32:06.706 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-05-04T00:32:06.706 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 833296085 2024-05-04T00:32:06.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-04T00:32:06.706 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.4437 192.168.0.1:0/833296085", 2024-05-04T00:32:06.706 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/833296085", 2024-05-04T00:32:06.706 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2024-05-04T00:32:06.706 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 12, 2024-05-04T00:32:06.706 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 26, 2024-05-04T00:32:06.706 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2024-05-04T00:32:06.706 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2024-05-04T00:32:06.706 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2024-05-04T00:32:06.706 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-04T00:32:06.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:32:06.720 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2024-05-04T00:32:06.720 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-04T00:32:06.859 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2024-05-04T00:32:06.859 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-04T00:32:06.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T00:32:06.859 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-04T00:32:07.752 INFO:teuthology.run_tasks:Running task workunit... 2024-05-04T00:32:07.765 INFO:tasks.workunit:Pulling workunits from ref bd4e00a39d766328b458e4c953f4d722fed96a31 2024-05-04T00:32:07.765 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-04T00:32:07.765 INFO:tasks.workunit:timeout=3h 2024-05-04T00:32:07.765 INFO:tasks.workunit:cleanup=True 2024-05-04T00:32:07.765 DEBUG:teuthology.orchestra.run.smithi006:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-04T00:32:07.920 INFO:teuthology.orchestra.run.smithi006.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-04T00:32:07.920 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-04T00:32:07.921 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-05-04T00:32:07.921 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T00:32:07.921 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-04T00:32:07.921 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-05-04 00:31:23.976719688 +0000 2024-05-04T00:32:07.921 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-05-04 00:32:06.939248625 +0000 2024-05-04T00:32:07.921 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-05-04T00:32:07.922 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-04T00:32:07.922 DEBUG:teuthology.orchestra.run.smithi006:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-04T00:32:09.409 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bd4e00a39d766328b458e4c953f4d722fed96a31 2024-05-04T00:32:09.417 INFO:tasks.workunit.client.0.smithi006.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-04T00:32:18.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:32:18.710 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:32:48.849 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:32:48.853 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:33:18.975 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:33:18.979 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:33:37.555 INFO:tasks.workunit.client.0.smithi006.stderr:Updating files: 93% (11532/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-04T00:33:38.299 INFO:tasks.workunit.client.0.smithi006.stderr:Note: switching to 'bd4e00a39d766328b458e4c953f4d722fed96a31'. 2024-05-04T00:33:38.299 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-05-04T00:33:38.299 INFO:tasks.workunit.client.0.smithi006.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-04T00:33:38.299 INFO:tasks.workunit.client.0.smithi006.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-04T00:33:38.299 INFO:tasks.workunit.client.0.smithi006.stderr:state without impacting any branches by switching back to a branch. 2024-05-04T00:33:38.299 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-05-04T00:33:38.299 INFO:tasks.workunit.client.0.smithi006.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-04T00:33:38.299 INFO:tasks.workunit.client.0.smithi006.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-04T00:33:38.299 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-05-04T00:33:38.299 INFO:tasks.workunit.client.0.smithi006.stderr: git switch -c 2024-05-04T00:33:38.299 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-05-04T00:33:38.299 INFO:tasks.workunit.client.0.smithi006.stderr:Or undo this operation with: 2024-05-04T00:33:38.300 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-05-04T00:33:38.300 INFO:tasks.workunit.client.0.smithi006.stderr: git switch - 2024-05-04T00:33:38.300 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-05-04T00:33:38.300 INFO:tasks.workunit.client.0.smithi006.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-04T00:33:38.300 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-05-04T00:33:38.300 INFO:tasks.workunit.client.0.smithi006.stderr:HEAD is now at bd4e00a39d7 Merge PR #54433 into wip-pdonnell-testing-20240503.163550-debug 2024-05-04T00:33:38.306 DEBUG:teuthology.orchestra.run.smithi006:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-04T00:33:38.313 INFO:tasks.workunit.client.0.smithi006.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-04T00:33:38.316 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-04T00:33:38.316 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-04T00:33:39.090 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-04T00:33:39.177 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-04T00:33:39.238 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-04T00:33:39.239 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-04T00:33:39.239 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-04T00:33:39.284 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-04T00:33:39.288 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T00:33:39.288 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-04T00:33:39.334 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-05-04T00:33:39.336 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-05-04T00:33:39.336 DEBUG:teuthology.orchestra.run.smithi006:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bd4e00a39d766328b458e4c953f4d722fed96a31 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-05-04T00:33:39.868 INFO:tasks.workunit.client.0.smithi006.stderr:+ dbench 1 2024-05-04T00:33:39.886 INFO:tasks.workunit.client.0.smithi006.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-05-04T00:33:39.886 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-05-04T00:33:39.886 INFO:tasks.workunit.client.0.smithi006.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-05-04T00:33:39.894 INFO:tasks.workunit.client.0.smithi006.stdout:0 of 1 processes prepared for launch 0 sec 2024-05-04T00:33:39.994 INFO:tasks.workunit.client.0.smithi006.stdout:1 of 1 processes prepared for launch 0 sec 2024-05-04T00:33:39.994 INFO:tasks.workunit.client.0.smithi006.stdout:releasing clients 2024-05-04T00:33:40.994 INFO:tasks.workunit.client.0.smithi006.stdout: 0 7 0.00 MB/sec warmup 1 sec latency 22.601 ms 2024-05-04T00:33:41.994 INFO:tasks.workunit.client.0.smithi006.stdout: 0 10 0.00 MB/sec warmup 2 sec latency 497.370 ms 2024-05-04T00:33:42.994 INFO:tasks.workunit.client.0.smithi006.stdout: 1 31 0.35 MB/sec warmup 3 sec latency 104.880 ms 2024-05-04T00:33:43.994 INFO:tasks.workunit.client.0.smithi006.stdout: 1 51 0.52 MB/sec warmup 4 sec latency 668.389 ms 2024-05-04T00:33:44.995 INFO:tasks.workunit.client.0.smithi006.stdout: 1 78 0.68 MB/sec warmup 5 sec latency 533.401 ms 2024-05-04T00:33:45.995 INFO:tasks.workunit.client.0.smithi006.stdout: 1 110 0.87 MB/sec warmup 6 sec latency 680.695 ms 2024-05-04T00:33:46.995 INFO:tasks.workunit.client.0.smithi006.stdout: 1 121 0.79 MB/sec warmup 7 sec latency 413.223 ms 2024-05-04T00:33:47.998 INFO:tasks.workunit.client.0.smithi006.stdout: 1 137 0.75 MB/sec warmup 8 sec latency 530.698 ms 2024-05-04T00:33:48.995 INFO:tasks.workunit.client.0.smithi006.stdout: 1 147 0.70 MB/sec warmup 9 sec latency 468.863 ms 2024-05-04T00:33:49.129 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:33:49.132 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:33:49.995 INFO:tasks.workunit.client.0.smithi006.stdout: 1 157 0.65 MB/sec warmup 10 sec latency 558.521 ms 2024-05-04T00:33:50.995 INFO:tasks.workunit.client.0.smithi006.stdout: 1 169 0.62 MB/sec warmup 11 sec latency 672.310 ms 2024-05-04T00:33:51.995 INFO:tasks.workunit.client.0.smithi006.stdout: 1 181 0.61 MB/sec warmup 12 sec latency 640.943 ms 2024-05-04T00:33:52.995 INFO:tasks.workunit.client.0.smithi006.stdout: 1 189 0.58 MB/sec warmup 13 sec latency 625.897 ms 2024-05-04T00:33:53.995 INFO:tasks.workunit.client.0.smithi006.stdout: 1 207 0.58 MB/sec warmup 14 sec latency 644.333 ms 2024-05-04T00:33:54.995 INFO:tasks.workunit.client.0.smithi006.stdout: 1 215 0.56 MB/sec warmup 15 sec latency 572.343 ms 2024-05-04T00:33:55.995 INFO:tasks.workunit.client.0.smithi006.stdout: 1 231 0.56 MB/sec warmup 16 sec latency 706.477 ms 2024-05-04T00:33:56.996 INFO:tasks.workunit.client.0.smithi006.stdout: 1 239 0.54 MB/sec warmup 17 sec latency 539.661 ms 2024-05-04T00:33:57.996 INFO:tasks.workunit.client.0.smithi006.stdout: 1 255 0.54 MB/sec warmup 18 sec latency 663.609 ms 2024-05-04T00:33:58.996 INFO:tasks.workunit.client.0.smithi006.stdout: 1 263 0.52 MB/sec warmup 19 sec latency 578.022 ms 2024-05-04T00:33:59.996 INFO:tasks.workunit.client.0.smithi006.stdout: 1 279 0.52 MB/sec warmup 20 sec latency 579.091 ms 2024-05-04T00:34:00.996 INFO:tasks.workunit.client.0.smithi006.stdout: 1 287 0.51 MB/sec warmup 21 sec latency 688.241 ms 2024-05-04T00:34:01.996 INFO:tasks.workunit.client.0.smithi006.stdout: 1 302 0.50 MB/sec warmup 22 sec latency 775.397 ms 2024-05-04T00:34:02.996 INFO:tasks.workunit.client.0.smithi006.stdout: 1 313 0.50 MB/sec warmup 23 sec latency 514.233 ms 2024-05-04T00:34:03.996 INFO:tasks.workunit.client.0.smithi006.stdout: 1 323 0.49 MB/sec warmup 24 sec latency 582.411 ms 2024-05-04T00:34:04.996 INFO:tasks.workunit.client.0.smithi006.stdout: 1 339 0.49 MB/sec warmup 25 sec latency 815.533 ms 2024-05-04T00:34:05.996 INFO:tasks.workunit.client.0.smithi006.stdout: 1 341 0.47 MB/sec warmup 26 sec latency 587.427 ms 2024-05-04T00:34:06.997 INFO:tasks.workunit.client.0.smithi006.stdout: 1 354 0.47 MB/sec warmup 27 sec latency 915.856 ms 2024-05-04T00:34:07.996 INFO:tasks.workunit.client.0.smithi006.stdout: 1 365 0.47 MB/sec warmup 28 sec latency 510.079 ms 2024-05-04T00:34:08.997 INFO:tasks.workunit.client.0.smithi006.stdout: 1 381 0.47 MB/sec warmup 29 sec latency 587.070 ms 2024-05-04T00:34:09.997 INFO:tasks.workunit.client.0.smithi006.stdout: 1 391 0.46 MB/sec warmup 30 sec latency 577.429 ms 2024-05-04T00:34:10.997 INFO:tasks.workunit.client.0.smithi006.stdout: 1 405 0.46 MB/sec warmup 31 sec latency 608.124 ms 2024-05-04T00:34:11.997 INFO:tasks.workunit.client.0.smithi006.stdout: 1 421 0.46 MB/sec warmup 32 sec latency 573.156 ms 2024-05-04T00:34:12.997 INFO:tasks.workunit.client.0.smithi006.stdout: 1 429 0.46 MB/sec warmup 33 sec latency 555.327 ms 2024-05-04T00:34:13.997 INFO:tasks.workunit.client.0.smithi006.stdout: 1 445 0.46 MB/sec warmup 34 sec latency 628.932 ms 2024-05-04T00:34:14.997 INFO:tasks.workunit.client.0.smithi006.stdout: 1 461 0.46 MB/sec warmup 35 sec latency 559.879 ms 2024-05-04T00:34:15.997 INFO:tasks.workunit.client.0.smithi006.stdout: 1 469 0.46 MB/sec warmup 36 sec latency 671.159 ms 2024-05-04T00:34:16.997 INFO:tasks.workunit.client.0.smithi006.stdout: 1 477 0.45 MB/sec warmup 37 sec latency 792.362 ms 2024-05-04T00:34:17.997 INFO:tasks.workunit.client.0.smithi006.stdout: 1 485 0.45 MB/sec warmup 38 sec latency 723.826 ms 2024-05-04T00:34:18.997 INFO:tasks.workunit.client.0.smithi006.stdout: 1 501 0.45 MB/sec warmup 39 sec latency 669.062 ms 2024-05-04T00:34:19.253 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:34:19.256 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:34:19.998 INFO:tasks.workunit.client.0.smithi006.stdout: 1 511 0.44 MB/sec warmup 40 sec latency 488.023 ms 2024-05-04T00:34:20.998 INFO:tasks.workunit.client.0.smithi006.stdout: 1 522 0.44 MB/sec warmup 41 sec latency 661.237 ms 2024-05-04T00:34:21.998 INFO:tasks.workunit.client.0.smithi006.stdout: 1 542 0.45 MB/sec warmup 42 sec latency 683.323 ms 2024-05-04T00:34:22.998 INFO:tasks.workunit.client.0.smithi006.stdout: 1 603 0.49 MB/sec warmup 43 sec latency 570.243 ms 2024-05-04T00:34:23.998 INFO:tasks.workunit.client.0.smithi006.stdout: 1 607 0.48 MB/sec warmup 44 sec latency 947.124 ms 2024-05-04T00:34:24.998 INFO:tasks.workunit.client.0.smithi006.stdout: 1 609 0.47 MB/sec warmup 45 sec latency 703.283 ms 2024-05-04T00:34:25.998 INFO:tasks.workunit.client.0.smithi006.stdout: 1 614 0.46 MB/sec warmup 46 sec latency 1504.281 ms 2024-05-04T00:34:26.998 INFO:tasks.workunit.client.0.smithi006.stdout: 1 614 0.45 MB/sec warmup 47 sec latency 1113.162 ms 2024-05-04T00:34:27.998 INFO:tasks.workunit.client.0.smithi006.stdout: 1 644 0.44 MB/sec warmup 48 sec latency 1432.275 ms 2024-05-04T00:34:28.998 INFO:tasks.workunit.client.0.smithi006.stdout: 1 645 0.43 MB/sec warmup 49 sec latency 1207.324 ms 2024-05-04T00:34:29.998 INFO:tasks.workunit.client.0.smithi006.stdout: 1 645 0.42 MB/sec warmup 50 sec latency 1100.532 ms 2024-05-04T00:34:30.999 INFO:tasks.workunit.client.0.smithi006.stdout: 1 652 0.41 MB/sec warmup 51 sec latency 1150.193 ms 2024-05-04T00:34:31.998 INFO:tasks.workunit.client.0.smithi006.stdout: 1 653 0.41 MB/sec warmup 52 sec latency 925.573 ms 2024-05-04T00:34:32.999 INFO:tasks.workunit.client.0.smithi006.stdout: 1 655 0.40 MB/sec warmup 53 sec latency 1114.408 ms 2024-05-04T00:34:33.999 INFO:tasks.workunit.client.0.smithi006.stdout: 1 676 0.39 MB/sec warmup 54 sec latency 359.095 ms 2024-05-04T00:34:34.999 INFO:tasks.workunit.client.0.smithi006.stdout: 1 680 0.39 MB/sec warmup 55 sec latency 786.913 ms 2024-05-04T00:34:35.999 INFO:tasks.workunit.client.0.smithi006.stdout: 1 682 0.38 MB/sec warmup 56 sec latency 1438.414 ms 2024-05-04T00:34:36.999 INFO:tasks.workunit.client.0.smithi006.stdout: 1 682 0.37 MB/sec warmup 57 sec latency 1300.732 ms 2024-05-04T00:34:37.999 INFO:tasks.workunit.client.0.smithi006.stdout: 1 699 0.37 MB/sec warmup 58 sec latency 1351.601 ms 2024-05-04T00:34:38.999 INFO:tasks.workunit.client.0.smithi006.stdout: 1 710 0.36 MB/sec warmup 59 sec latency 442.218 ms 2024-05-04T00:34:39.999 INFO:tasks.workunit.client.0.smithi006.stdout: 1 712 0.35 MB/sec warmup 60 sec latency 847.468 ms 2024-05-04T00:34:40.999 INFO:tasks.workunit.client.0.smithi006.stdout: 1 733 0.35 MB/sec warmup 61 sec latency 399.159 ms 2024-05-04T00:34:42.000 INFO:tasks.workunit.client.0.smithi006.stdout: 1 744 0.34 MB/sec warmup 62 sec latency 221.027 ms 2024-05-04T00:34:43.000 INFO:tasks.workunit.client.0.smithi006.stdout: 1 746 0.34 MB/sec warmup 63 sec latency 1098.304 ms 2024-05-04T00:34:44.000 INFO:tasks.workunit.client.0.smithi006.stdout: 1 746 0.33 MB/sec warmup 64 sec latency 1109.984 ms 2024-05-04T00:34:45.000 INFO:tasks.workunit.client.0.smithi006.stdout: 1 769 0.33 MB/sec warmup 65 sec latency 1303.167 ms 2024-05-04T00:34:46.000 INFO:tasks.workunit.client.0.smithi006.stdout: 1 778 0.32 MB/sec warmup 66 sec latency 452.574 ms 2024-05-04T00:34:47.000 INFO:tasks.workunit.client.0.smithi006.stdout: 1 780 0.32 MB/sec warmup 67 sec latency 744.344 ms 2024-05-04T00:34:48.000 INFO:tasks.workunit.client.0.smithi006.stdout: 1 798 0.32 MB/sec warmup 68 sec latency 341.498 ms 2024-05-04T00:34:49.000 INFO:tasks.workunit.client.0.smithi006.stdout: 1 812 0.31 MB/sec warmup 69 sec latency 198.954 ms 2024-05-04T00:34:49.367 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:34:49.370 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:34:50.000 INFO:tasks.workunit.client.0.smithi006.stdout: 1 813 0.31 MB/sec warmup 70 sec latency 1067.975 ms 2024-05-04T00:34:51.000 INFO:tasks.workunit.client.0.smithi006.stdout: 1 813 0.30 MB/sec warmup 71 sec latency 1119.963 ms 2024-05-04T00:34:52.000 INFO:tasks.workunit.client.0.smithi006.stdout: 1 818 0.30 MB/sec warmup 72 sec latency 1231.397 ms 2024-05-04T00:34:53.000 INFO:tasks.workunit.client.0.smithi006.stdout: 1 823 0.29 MB/sec warmup 73 sec latency 1218.663 ms 2024-05-04T00:34:54.001 INFO:tasks.workunit.client.0.smithi006.stdout: 1 823 0.29 MB/sec warmup 74 sec latency 1058.589 ms 2024-05-04T00:34:55.000 INFO:tasks.workunit.client.0.smithi006.stdout: 1 853 0.29 MB/sec warmup 75 sec latency 1080.953 ms 2024-05-04T00:34:56.001 INFO:tasks.workunit.client.0.smithi006.stdout: 1 854 0.28 MB/sec warmup 76 sec latency 1247.894 ms 2024-05-04T00:34:57.001 INFO:tasks.workunit.client.0.smithi006.stdout: 1 856 0.28 MB/sec warmup 77 sec latency 1374.364 ms 2024-05-04T00:34:58.001 INFO:tasks.workunit.client.0.smithi006.stdout: 1 862 0.28 MB/sec warmup 78 sec latency 335.709 ms 2024-05-04T00:34:59.001 INFO:tasks.workunit.client.0.smithi006.stdout: 1 863 0.27 MB/sec warmup 79 sec latency 1137.343 ms 2024-05-04T00:35:00.001 INFO:tasks.workunit.client.0.smithi006.stdout: 1 874 0.27 MB/sec warmup 80 sec latency 473.668 ms 2024-05-04T00:35:01.001 INFO:tasks.workunit.client.0.smithi006.stdout: 1 880 0.27 MB/sec warmup 81 sec latency 804.996 ms 2024-05-04T00:35:02.001 INFO:tasks.workunit.client.0.smithi006.stdout: 1 892 0.26 MB/sec warmup 82 sec latency 1062.286 ms 2024-05-04T00:35:03.001 INFO:tasks.workunit.client.0.smithi006.stdout: 1 902 0.26 MB/sec warmup 83 sec latency 545.669 ms 2024-05-04T00:35:04.003 INFO:tasks.workunit.client.0.smithi006.stdout: 1 910 0.26 MB/sec warmup 84 sec latency 738.682 ms 2024-05-04T00:35:05.002 INFO:tasks.workunit.client.0.smithi006.stdout: 1 927 0.26 MB/sec warmup 85 sec latency 201.782 ms 2024-05-04T00:35:06.002 INFO:tasks.workunit.client.0.smithi006.stdout: 1 927 0.25 MB/sec warmup 86 sec latency 1009.460 ms 2024-05-04T00:35:07.002 INFO:tasks.workunit.client.0.smithi006.stdout: 1 928 0.25 MB/sec warmup 87 sec latency 1490.638 ms 2024-05-04T00:35:08.002 INFO:tasks.workunit.client.0.smithi006.stdout: 1 929 0.25 MB/sec warmup 88 sec latency 1281.838 ms 2024-05-04T00:35:09.002 INFO:tasks.workunit.client.0.smithi006.stdout: 1 930 0.24 MB/sec warmup 89 sec latency 668.928 ms 2024-05-04T00:35:10.002 INFO:tasks.workunit.client.0.smithi006.stdout: 1 931 0.24 MB/sec warmup 90 sec latency 932.189 ms 2024-05-04T00:35:11.002 INFO:tasks.workunit.client.0.smithi006.stdout: 1 936 0.24 MB/sec warmup 91 sec latency 1179.071 ms 2024-05-04T00:35:12.002 INFO:tasks.workunit.client.0.smithi006.stdout: 1 937 0.24 MB/sec warmup 92 sec latency 934.374 ms 2024-05-04T00:35:13.002 INFO:tasks.workunit.client.0.smithi006.stdout: 1 942 0.23 MB/sec warmup 93 sec latency 1138.042 ms 2024-05-04T00:35:14.002 INFO:tasks.workunit.client.0.smithi006.stdout: 1 959 0.23 MB/sec warmup 94 sec latency 1130.438 ms 2024-05-04T00:35:15.002 INFO:tasks.workunit.client.0.smithi006.stdout: 1 969 0.23 MB/sec warmup 95 sec latency 566.171 ms 2024-05-04T00:35:16.002 INFO:tasks.workunit.client.0.smithi006.stdout: 1 977 0.23 MB/sec warmup 96 sec latency 744.471 ms 2024-05-04T00:35:17.002 INFO:tasks.workunit.client.0.smithi006.stdout: 1 993 0.23 MB/sec warmup 97 sec latency 281.811 ms 2024-05-04T00:35:18.002 INFO:tasks.workunit.client.0.smithi006.stdout: 1 994 0.22 MB/sec warmup 98 sec latency 969.040 ms 2024-05-04T00:35:19.003 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1027 0.23 MB/sec warmup 99 sec latency 1047.571 ms 2024-05-04T00:35:19.497 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:35:19.500 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:35:20.003 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1027 0.23 MB/sec warmup 100 sec latency 1023.381 ms 2024-05-04T00:35:21.003 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1033 0.23 MB/sec warmup 101 sec latency 1165.475 ms 2024-05-04T00:35:22.003 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1033 0.22 MB/sec warmup 102 sec latency 1004.444 ms 2024-05-04T00:35:23.003 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1046 0.22 MB/sec warmup 103 sec latency 1078.641 ms 2024-05-04T00:35:24.003 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1047 0.22 MB/sec warmup 104 sec latency 1139.094 ms 2024-05-04T00:35:25.003 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1047 0.22 MB/sec warmup 105 sec latency 1089.478 ms 2024-05-04T00:35:26.003 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1048 0.22 MB/sec warmup 106 sec latency 1142.843 ms 2024-05-04T00:35:27.003 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1053 0.21 MB/sec warmup 107 sec latency 1295.112 ms 2024-05-04T00:35:28.003 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1063 0.21 MB/sec warmup 108 sec latency 409.055 ms 2024-05-04T00:35:29.003 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1081 0.21 MB/sec warmup 109 sec latency 351.116 ms 2024-05-04T00:35:30.004 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1088 0.21 MB/sec warmup 110 sec latency 438.682 ms 2024-05-04T00:35:31.003 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1088 0.21 MB/sec warmup 111 sec latency 1339.055 ms 2024-05-04T00:35:32.004 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1100 0.20 MB/sec warmup 112 sec latency 1402.149 ms 2024-05-04T00:35:33.004 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1100 0.20 MB/sec warmup 113 sec latency 1061.135 ms 2024-05-04T00:35:34.004 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1114 0.20 MB/sec warmup 114 sec latency 1273.463 ms 2024-05-04T00:35:35.004 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1116 0.20 MB/sec warmup 115 sec latency 1177.390 ms 2024-05-04T00:35:36.004 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1128 0.20 MB/sec warmup 116 sec latency 334.271 ms 2024-05-04T00:35:37.004 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1139 0.20 MB/sec warmup 117 sec latency 449.060 ms 2024-05-04T00:35:38.006 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1149 0.19 MB/sec warmup 118 sec latency 690.745 ms 2024-05-04T00:35:39.004 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1157 0.19 MB/sec warmup 119 sec latency 500.349 ms 2024-05-04T00:35:41.004 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1168 0.00 MB/sec execute 1 sec latency 1069.721 ms 2024-05-04T00:35:42.004 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1169 0.00 MB/sec execute 2 sec latency 1313.973 ms 2024-05-04T00:35:43.004 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1170 0.00 MB/sec execute 3 sec latency 1280.193 ms 2024-05-04T00:35:44.005 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1170 0.00 MB/sec execute 4 sec latency 1041.279 ms 2024-05-04T00:35:45.005 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1176 0.00 MB/sec execute 5 sec latency 1290.194 ms 2024-05-04T00:35:46.006 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1179 0.00 MB/sec execute 6 sec latency 583.715 ms 2024-05-04T00:35:47.005 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1190 0.00 MB/sec execute 7 sec latency 417.751 ms 2024-05-04T00:35:48.005 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1204 0.01 MB/sec execute 8 sec latency 344.358 ms 2024-05-04T00:35:49.005 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1207 0.00 MB/sec execute 9 sec latency 1104.572 ms 2024-05-04T00:35:49.645 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:35:49.648 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:35:50.005 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1215 0.00 MB/sec execute 10 sec latency 333.100 ms 2024-05-04T00:35:51.005 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1229 0.01 MB/sec execute 11 sec latency 485.326 ms 2024-05-04T00:35:52.005 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1244 0.01 MB/sec execute 12 sec latency 415.989 ms 2024-05-04T00:35:53.005 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1248 0.01 MB/sec execute 13 sec latency 711.160 ms 2024-05-04T00:35:54.005 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1251 0.01 MB/sec execute 14 sec latency 1086.794 ms 2024-05-04T00:35:55.006 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1266 0.01 MB/sec execute 15 sec latency 416.963 ms 2024-05-04T00:35:56.006 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1278 0.01 MB/sec execute 16 sec latency 322.878 ms 2024-05-04T00:35:57.006 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1278 0.01 MB/sec execute 17 sec latency 1322.938 ms 2024-05-04T00:35:58.006 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1280 0.01 MB/sec execute 18 sec latency 1398.971 ms 2024-05-04T00:35:59.006 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1281 0.01 MB/sec execute 19 sec latency 1132.517 ms 2024-05-04T00:36:00.006 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1284 0.01 MB/sec execute 20 sec latency 1158.530 ms 2024-05-04T00:36:01.006 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1318 0.05 MB/sec execute 21 sec latency 1121.573 ms 2024-05-04T00:36:02.006 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1376 0.14 MB/sec execute 22 sec latency 750.302 ms 2024-05-04T00:36:03.006 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1377 0.13 MB/sec execute 23 sec latency 1492.040 ms 2024-05-04T00:36:04.006 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1378 0.12 MB/sec execute 24 sec latency 1034.095 ms 2024-05-04T00:36:05.006 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1381 0.12 MB/sec execute 25 sec latency 627.242 ms 2024-05-04T00:36:06.006 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1385 0.11 MB/sec execute 26 sec latency 1175.901 ms 2024-05-04T00:36:07.007 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1387 0.11 MB/sec execute 27 sec latency 1165.187 ms 2024-05-04T00:36:08.007 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1395 0.11 MB/sec execute 28 sec latency 230.964 ms 2024-05-04T00:36:09.007 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1397 0.10 MB/sec execute 29 sec latency 503.935 ms 2024-05-04T00:36:10.007 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1403 0.10 MB/sec execute 30 sec latency 1115.674 ms 2024-05-04T00:36:11.007 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1417 0.10 MB/sec execute 31 sec latency 637.587 ms 2024-05-04T00:36:12.007 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1417 0.09 MB/sec execute 32 sec latency 1334.087 ms 2024-05-04T00:36:13.007 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1426 0.09 MB/sec execute 33 sec latency 1420.331 ms 2024-05-04T00:36:14.007 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1441 0.09 MB/sec execute 34 sec latency 479.069 ms 2024-05-04T00:36:15.007 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1448 0.09 MB/sec execute 35 sec latency 543.546 ms 2024-05-04T00:36:16.007 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1448 0.08 MB/sec execute 36 sec latency 1118.389 ms 2024-05-04T00:36:17.007 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1462 0.08 MB/sec execute 37 sec latency 1206.056 ms 2024-05-04T00:36:18.007 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1466 0.08 MB/sec execute 38 sec latency 318.384 ms 2024-05-04T00:36:19.007 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1471 0.08 MB/sec execute 39 sec latency 1162.770 ms 2024-05-04T00:36:19.699 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:36:19.702 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:36:20.007 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1485 0.08 MB/sec execute 40 sec latency 478.532 ms 2024-05-04T00:36:21.008 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1486 0.07 MB/sec execute 41 sec latency 1084.927 ms 2024-05-04T00:36:22.008 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1490 0.07 MB/sec execute 42 sec latency 429.198 ms 2024-05-04T00:36:23.008 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1492 0.07 MB/sec execute 43 sec latency 1110.495 ms 2024-05-04T00:36:24.008 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1501 0.07 MB/sec execute 44 sec latency 631.384 ms 2024-05-04T00:36:25.008 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1512 0.07 MB/sec execute 45 sec latency 391.377 ms 2024-05-04T00:36:26.008 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1523 0.07 MB/sec execute 46 sec latency 460.037 ms 2024-05-04T00:36:27.008 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1526 0.07 MB/sec execute 47 sec latency 596.348 ms 2024-05-04T00:36:28.008 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1530 0.06 MB/sec execute 48 sec latency 1106.489 ms 2024-05-04T00:36:29.008 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1535 0.06 MB/sec execute 49 sec latency 1123.951 ms 2024-05-04T00:36:30.008 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1553 0.06 MB/sec execute 50 sec latency 415.924 ms 2024-05-04T00:36:31.008 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1555 0.06 MB/sec execute 51 sec latency 884.716 ms 2024-05-04T00:36:32.008 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1566 0.06 MB/sec execute 52 sec latency 1132.858 ms 2024-05-04T00:36:33.009 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1578 0.06 MB/sec execute 53 sec latency 181.651 ms 2024-05-04T00:36:34.009 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1587 0.06 MB/sec execute 54 sec latency 204.975 ms 2024-05-04T00:36:35.009 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1589 0.06 MB/sec execute 55 sec latency 539.909 ms 2024-05-04T00:36:36.009 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1599 0.06 MB/sec execute 56 sec latency 1325.300 ms 2024-05-04T00:36:37.009 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1606 0.06 MB/sec execute 57 sec latency 606.351 ms 2024-05-04T00:36:38.009 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1607 0.05 MB/sec execute 58 sec latency 1130.377 ms 2024-05-04T00:36:39.009 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1610 0.05 MB/sec execute 59 sec latency 785.129 ms 2024-05-04T00:36:40.009 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1615 0.05 MB/sec execute 60 sec latency 1101.765 ms 2024-05-04T00:36:41.009 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1617 0.05 MB/sec execute 61 sec latency 555.340 ms 2024-05-04T00:36:42.009 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1630 0.05 MB/sec execute 62 sec latency 1231.227 ms 2024-05-04T00:36:43.009 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1641 0.05 MB/sec execute 63 sec latency 610.965 ms 2024-05-04T00:36:44.009 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1643 0.05 MB/sec execute 64 sec latency 1146.204 ms 2024-05-04T00:36:45.010 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1644 0.05 MB/sec execute 65 sec latency 911.418 ms 2024-05-04T00:36:46.010 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1653 0.05 MB/sec execute 66 sec latency 1083.052 ms 2024-05-04T00:36:47.010 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1675 0.05 MB/sec execute 67 sec latency 754.176 ms 2024-05-04T00:36:48.010 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1686 0.05 MB/sec execute 68 sec latency 601.189 ms 2024-05-04T00:36:49.010 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1691 0.05 MB/sec execute 69 sec latency 825.366 ms 2024-05-04T00:36:49.746 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:36:49.750 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:36:50.010 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1700 0.05 MB/sec execute 70 sec latency 500.350 ms 2024-05-04T00:36:51.010 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1701 0.05 MB/sec execute 71 sec latency 974.076 ms 2024-05-04T00:36:52.010 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1707 0.04 MB/sec execute 72 sec latency 1343.276 ms 2024-05-04T00:36:53.010 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1715 0.04 MB/sec execute 73 sec latency 1172.531 ms 2024-05-04T00:36:54.010 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1721 0.04 MB/sec execute 74 sec latency 491.289 ms 2024-05-04T00:36:55.010 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1734 0.04 MB/sec execute 75 sec latency 190.895 ms 2024-05-04T00:36:56.010 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1769 0.04 MB/sec execute 76 sec latency 216.591 ms 2024-05-04T00:36:57.011 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1772 0.04 MB/sec execute 77 sec latency 613.530 ms 2024-05-04T00:36:58.011 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1775 0.04 MB/sec execute 78 sec latency 1039.808 ms 2024-05-04T00:36:59.011 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1801 0.04 MB/sec execute 79 sec latency 144.253 ms 2024-05-04T00:37:00.011 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1806 0.04 MB/sec execute 80 sec latency 369.234 ms 2024-05-04T00:37:01.011 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1814 0.04 MB/sec execute 81 sec latency 909.298 ms 2024-05-04T00:37:02.011 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1821 0.04 MB/sec execute 82 sec latency 730.128 ms 2024-05-04T00:37:03.011 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1822 0.04 MB/sec execute 83 sec latency 795.715 ms 2024-05-04T00:37:04.011 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1826 0.04 MB/sec execute 84 sec latency 1137.980 ms 2024-05-04T00:37:05.011 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1832 0.04 MB/sec execute 85 sec latency 1048.392 ms 2024-05-04T00:37:06.011 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1839 0.04 MB/sec execute 86 sec latency 214.453 ms 2024-05-04T00:37:07.011 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1841 0.04 MB/sec execute 87 sec latency 501.702 ms 2024-05-04T00:37:08.012 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1853 0.04 MB/sec execute 88 sec latency 1217.151 ms 2024-05-04T00:37:09.012 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1858 0.04 MB/sec execute 89 sec latency 569.303 ms 2024-05-04T00:37:10.012 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1859 0.04 MB/sec execute 90 sec latency 1145.488 ms 2024-05-04T00:37:11.012 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1862 0.04 MB/sec execute 91 sec latency 900.099 ms 2024-05-04T00:37:12.012 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1866 0.04 MB/sec execute 92 sec latency 1384.527 ms 2024-05-04T00:37:13.012 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1869 0.04 MB/sec execute 93 sec latency 386.822 ms 2024-05-04T00:37:14.012 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1882 0.04 MB/sec execute 94 sec latency 1067.358 ms 2024-05-04T00:37:15.012 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1898 0.04 MB/sec execute 95 sec latency 419.008 ms 2024-05-04T00:37:16.012 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1903 0.04 MB/sec execute 96 sec latency 1116.790 ms 2024-05-04T00:37:17.012 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1903 0.04 MB/sec execute 97 sec latency 1089.885 ms 2024-05-04T00:37:18.012 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1912 0.04 MB/sec execute 98 sec latency 1132.029 ms 2024-05-04T00:37:19.012 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1912 0.03 MB/sec execute 99 sec latency 1062.005 ms 2024-05-04T00:37:19.802 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:37:19.805 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:37:20.013 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1920 0.03 MB/sec execute 100 sec latency 1181.251 ms 2024-05-04T00:37:21.013 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1936 0.03 MB/sec execute 101 sec latency 1190.533 ms 2024-05-04T00:37:22.013 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1965 0.03 MB/sec execute 102 sec latency 313.852 ms 2024-05-04T00:37:23.013 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1975 0.03 MB/sec execute 103 sec latency 493.612 ms 2024-05-04T00:37:24.013 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1975 0.03 MB/sec execute 104 sec latency 1044.224 ms 2024-05-04T00:37:25.013 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1989 0.03 MB/sec execute 105 sec latency 1167.446 ms 2024-05-04T00:37:26.013 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1997 0.03 MB/sec execute 106 sec latency 691.954 ms 2024-05-04T00:37:27.013 INFO:tasks.workunit.client.0.smithi006.stdout: 1 1998 0.03 MB/sec execute 107 sec latency 1225.453 ms 2024-05-04T00:37:28.013 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2010 0.03 MB/sec execute 108 sec latency 539.700 ms 2024-05-04T00:37:29.013 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2022 0.03 MB/sec execute 109 sec latency 212.499 ms 2024-05-04T00:37:30.013 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2033 0.03 MB/sec execute 110 sec latency 220.002 ms 2024-05-04T00:37:31.013 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2034 0.03 MB/sec execute 111 sec latency 981.914 ms 2024-05-04T00:37:32.013 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2042 0.03 MB/sec execute 112 sec latency 1664.516 ms 2024-05-04T00:37:33.014 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2043 0.03 MB/sec execute 113 sec latency 868.768 ms 2024-05-04T00:37:34.014 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2051 0.03 MB/sec execute 114 sec latency 1063.491 ms 2024-05-04T00:37:35.014 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2053 0.03 MB/sec execute 115 sec latency 1113.313 ms 2024-05-04T00:37:36.014 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2056 0.03 MB/sec execute 116 sec latency 1108.691 ms 2024-05-04T00:37:37.014 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2061 0.03 MB/sec execute 117 sec latency 344.485 ms 2024-05-04T00:37:38.014 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2061 0.03 MB/sec execute 118 sec latency 1040.731 ms 2024-05-04T00:37:39.014 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2079 0.03 MB/sec execute 119 sec latency 1257.828 ms 2024-05-04T00:37:40.014 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2080 0.03 MB/sec execute 120 sec latency 1217.986 ms 2024-05-04T00:37:41.014 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2081 0.03 MB/sec execute 121 sec latency 970.923 ms 2024-05-04T00:37:42.014 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2088 0.03 MB/sec execute 122 sec latency 1564.540 ms 2024-05-04T00:37:43.014 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2093 0.03 MB/sec execute 123 sec latency 687.154 ms 2024-05-04T00:37:44.014 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2096 0.03 MB/sec execute 124 sec latency 1187.088 ms 2024-05-04T00:37:45.015 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2103 0.03 MB/sec execute 125 sec latency 1209.780 ms 2024-05-04T00:37:46.015 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2137 0.03 MB/sec execute 126 sec latency 263.419 ms 2024-05-04T00:37:47.015 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2140 0.03 MB/sec execute 127 sec latency 589.098 ms 2024-05-04T00:37:48.015 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2145 0.03 MB/sec execute 128 sec latency 1087.567 ms 2024-05-04T00:37:49.015 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2146 0.03 MB/sec execute 129 sec latency 991.186 ms 2024-05-04T00:37:49.852 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:37:49.855 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:37:50.015 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2173 0.03 MB/sec execute 130 sec latency 1048.710 ms 2024-05-04T00:37:51.015 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2173 0.03 MB/sec execute 131 sec latency 1084.844 ms 2024-05-04T00:37:52.015 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2175 0.03 MB/sec execute 132 sec latency 1729.313 ms 2024-05-04T00:37:53.015 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2176 0.03 MB/sec execute 133 sec latency 1154.211 ms 2024-05-04T00:37:54.015 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2181 0.03 MB/sec execute 134 sec latency 222.693 ms 2024-05-04T00:37:55.015 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2183 0.03 MB/sec execute 135 sec latency 663.645 ms 2024-05-04T00:37:56.015 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2198 0.03 MB/sec execute 136 sec latency 1139.992 ms 2024-05-04T00:37:57.016 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2201 0.03 MB/sec execute 137 sec latency 572.013 ms 2024-05-04T00:37:58.016 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2221 0.03 MB/sec execute 138 sec latency 343.078 ms 2024-05-04T00:37:59.016 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2224 0.03 MB/sec execute 139 sec latency 1127.453 ms 2024-05-04T00:38:00.016 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2258 0.03 MB/sec execute 140 sec latency 192.630 ms 2024-05-04T00:38:01.016 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2291 0.03 MB/sec execute 141 sec latency 238.604 ms 2024-05-04T00:38:02.016 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2292 0.03 MB/sec execute 142 sec latency 953.460 ms 2024-05-04T00:38:03.016 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2299 0.03 MB/sec execute 143 sec latency 1142.010 ms 2024-05-04T00:38:04.016 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2303 0.03 MB/sec execute 144 sec latency 503.497 ms 2024-05-04T00:38:05.016 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2306 0.03 MB/sec execute 145 sec latency 1189.922 ms 2024-05-04T00:38:06.016 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2306 0.03 MB/sec execute 146 sec latency 1272.384 ms 2024-05-04T00:38:07.016 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2306 0.03 MB/sec execute 147 sec latency 2272.451 ms 2024-05-04T00:38:08.016 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2307 0.03 MB/sec execute 148 sec latency 2307.691 ms 2024-05-04T00:38:09.017 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2321 0.03 MB/sec execute 149 sec latency 1165.583 ms 2024-05-04T00:38:10.017 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2324 0.03 MB/sec execute 150 sec latency 1162.161 ms 2024-05-04T00:38:11.017 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2327 0.03 MB/sec execute 151 sec latency 1091.177 ms 2024-05-04T00:38:12.017 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2335 0.03 MB/sec execute 152 sec latency 371.576 ms 2024-05-04T00:38:13.017 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2336 0.03 MB/sec execute 153 sec latency 1134.598 ms 2024-05-04T00:38:14.017 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2340 0.03 MB/sec execute 154 sec latency 602.859 ms 2024-05-04T00:38:15.017 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2350 0.03 MB/sec execute 155 sec latency 1132.565 ms 2024-05-04T00:38:16.017 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2361 0.03 MB/sec execute 156 sec latency 385.457 ms 2024-05-04T00:38:17.017 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2361 0.03 MB/sec execute 157 sec latency 1044.920 ms 2024-05-04T00:38:18.017 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2362 0.03 MB/sec execute 158 sec latency 1398.304 ms 2024-05-04T00:38:19.017 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2364 0.03 MB/sec execute 159 sec latency 1092.489 ms 2024-05-04T00:38:19.962 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:38:19.965 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:38:20.017 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2366 0.03 MB/sec execute 160 sec latency 1092.200 ms 2024-05-04T00:38:21.017 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2367 0.03 MB/sec execute 161 sec latency 1141.000 ms 2024-05-04T00:38:22.017 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2371 0.03 MB/sec execute 162 sec latency 640.824 ms 2024-05-04T00:38:23.018 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2383 0.03 MB/sec execute 163 sec latency 1192.491 ms 2024-05-04T00:38:24.018 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2389 0.03 MB/sec execute 164 sec latency 639.732 ms 2024-05-04T00:38:25.018 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2391 0.03 MB/sec execute 165 sec latency 932.906 ms 2024-05-04T00:38:26.018 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2396 0.03 MB/sec execute 166 sec latency 1111.476 ms 2024-05-04T00:38:27.018 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2401 0.03 MB/sec execute 167 sec latency 391.231 ms 2024-05-04T00:38:28.027 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2410 0.03 MB/sec execute 168 sec latency 342.350 ms 2024-05-04T00:38:29.018 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2413 0.03 MB/sec execute 169 sec latency 1163.638 ms 2024-05-04T00:38:30.018 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2428 0.03 MB/sec execute 170 sec latency 283.944 ms 2024-05-04T00:38:31.018 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2431 0.03 MB/sec execute 171 sec latency 641.701 ms 2024-05-04T00:38:32.018 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2432 0.03 MB/sec execute 172 sec latency 1321.745 ms 2024-05-04T00:38:33.019 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2432 0.03 MB/sec execute 173 sec latency 1148.292 ms 2024-05-04T00:38:34.019 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2439 0.03 MB/sec execute 174 sec latency 1196.008 ms 2024-05-04T00:38:35.019 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2441 0.03 MB/sec execute 175 sec latency 489.579 ms 2024-05-04T00:38:36.019 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2452 0.03 MB/sec execute 176 sec latency 375.594 ms 2024-05-04T00:38:37.019 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2457 0.03 MB/sec execute 177 sec latency 490.325 ms 2024-05-04T00:38:38.019 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2470 0.03 MB/sec execute 178 sec latency 382.386 ms 2024-05-04T00:38:39.019 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2474 0.03 MB/sec execute 179 sec latency 1145.546 ms 2024-05-04T00:38:40.019 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2489 0.03 MB/sec execute 180 sec latency 288.963 ms 2024-05-04T00:38:41.022 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2492 0.03 MB/sec execute 181 sec latency 686.715 ms 2024-05-04T00:38:42.019 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2492 0.03 MB/sec execute 182 sec latency 1382.243 ms 2024-05-04T00:38:43.019 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2494 0.03 MB/sec execute 183 sec latency 1561.683 ms 2024-05-04T00:38:44.019 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2499 0.03 MB/sec execute 184 sec latency 1252.033 ms 2024-05-04T00:38:45.020 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2506 0.03 MB/sec execute 185 sec latency 218.874 ms 2024-05-04T00:38:46.020 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2506 0.03 MB/sec execute 186 sec latency 1070.225 ms 2024-05-04T00:38:47.020 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2549 0.03 MB/sec execute 187 sec latency 1214.711 ms 2024-05-04T00:38:48.020 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2551 0.03 MB/sec execute 188 sec latency 1088.492 ms 2024-05-04T00:38:49.020 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2558 0.03 MB/sec execute 189 sec latency 1099.813 ms 2024-05-04T00:38:50.020 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2560 0.03 MB/sec execute 190 sec latency 502.933 ms 2024-05-04T00:38:50.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:38:50.070 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:38:51.020 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2562 0.03 MB/sec execute 191 sec latency 1107.146 ms 2024-05-04T00:38:52.020 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2576 0.03 MB/sec execute 192 sec latency 375.575 ms 2024-05-04T00:38:53.020 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2580 0.03 MB/sec execute 193 sec latency 660.349 ms 2024-05-04T00:38:54.020 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2581 0.03 MB/sec execute 194 sec latency 1073.437 ms 2024-05-04T00:38:55.020 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2582 0.03 MB/sec execute 195 sec latency 1123.046 ms 2024-05-04T00:38:56.020 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2596 0.03 MB/sec execute 196 sec latency 505.310 ms 2024-05-04T00:38:57.021 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2600 0.03 MB/sec execute 197 sec latency 697.713 ms 2024-05-04T00:38:58.021 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2602 0.03 MB/sec execute 198 sec latency 1215.569 ms 2024-05-04T00:38:59.022 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2608 0.03 MB/sec execute 199 sec latency 346.420 ms 2024-05-04T00:39:00.021 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2615 0.03 MB/sec execute 200 sec latency 434.881 ms 2024-05-04T00:39:01.021 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2617 0.03 MB/sec execute 201 sec latency 1129.370 ms 2024-05-04T00:39:02.021 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2617 0.03 MB/sec execute 202 sec latency 1123.299 ms 2024-05-04T00:39:03.021 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2618 0.03 MB/sec execute 203 sec latency 1182.801 ms 2024-05-04T00:39:04.021 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2621 0.03 MB/sec execute 204 sec latency 1155.544 ms 2024-05-04T00:39:05.021 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2717 0.04 MB/sec execute 205 sec latency 1112.842 ms 2024-05-04T00:39:06.021 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2718 0.04 MB/sec execute 206 sec latency 889.287 ms 2024-05-04T00:39:07.021 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2745 0.04 MB/sec execute 207 sec latency 1152.483 ms 2024-05-04T00:39:08.021 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2745 0.04 MB/sec execute 208 sec latency 1130.754 ms 2024-05-04T00:39:09.022 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2754 0.04 MB/sec execute 209 sec latency 1155.734 ms 2024-05-04T00:39:10.022 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2760 0.04 MB/sec execute 210 sec latency 786.251 ms 2024-05-04T00:39:11.022 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2763 0.04 MB/sec execute 211 sec latency 1062.651 ms 2024-05-04T00:39:12.022 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2773 0.04 MB/sec execute 212 sec latency 338.636 ms 2024-05-04T00:39:13.022 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2780 0.04 MB/sec execute 213 sec latency 436.983 ms 2024-05-04T00:39:14.022 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2780 0.04 MB/sec execute 214 sec latency 1000.956 ms 2024-05-04T00:39:15.022 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2798 0.04 MB/sec execute 215 sec latency 1113.490 ms 2024-05-04T00:39:16.022 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2872 0.04 MB/sec execute 216 sec latency 920.893 ms 2024-05-04T00:39:17.022 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2876 0.04 MB/sec execute 217 sec latency 1182.646 ms 2024-05-04T00:39:18.022 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2881 0.04 MB/sec execute 218 sec latency 379.750 ms 2024-05-04T00:39:19.022 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2898 0.04 MB/sec execute 219 sec latency 321.090 ms 2024-05-04T00:39:20.022 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2903 0.04 MB/sec execute 220 sec latency 421.552 ms 2024-05-04T00:39:20.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:39:20.142 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:39:21.023 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2922 0.05 MB/sec execute 221 sec latency 401.575 ms 2024-05-04T00:39:22.022 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2931 0.05 MB/sec execute 222 sec latency 456.637 ms 2024-05-04T00:39:23.023 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2938 0.05 MB/sec execute 223 sec latency 467.420 ms 2024-05-04T00:39:24.023 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2940 0.05 MB/sec execute 224 sec latency 1166.844 ms 2024-05-04T00:39:25.023 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2966 0.05 MB/sec execute 225 sec latency 710.700 ms 2024-05-04T00:39:26.023 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2969 0.05 MB/sec execute 226 sec latency 1235.292 ms 2024-05-04T00:39:27.023 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2974 0.05 MB/sec execute 227 sec latency 479.747 ms 2024-05-04T00:39:28.023 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2975 0.05 MB/sec execute 228 sec latency 1034.415 ms 2024-05-04T00:39:29.023 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2982 0.05 MB/sec execute 229 sec latency 370.840 ms 2024-05-04T00:39:29.448 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:09:34.210 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:39:29.529 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:09:34.291 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:39:29.639 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:09:34.352 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:39:29.657 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:09:34.362 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:39:29.783 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:09:34.496 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:39:29.794 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:09:34.503 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:39:30.027 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2993 0.05 MB/sec execute 230 sec latency 376.262 ms 2024-05-04T00:39:30.143 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:09:34.905 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:39:30.235 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:09:34.948 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:39:30.308 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:09:35.020 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:39:31.024 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2994 0.05 MB/sec execute 231 sec latency 708.147 ms 2024-05-04T00:39:32.023 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3000 0.05 MB/sec execute 232 sec latency 1108.161 ms 2024-05-04T00:39:33.024 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3012 0.05 MB/sec execute 233 sec latency 390.813 ms 2024-05-04T00:39:34.024 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3018 0.04 MB/sec execute 234 sec latency 649.327 ms 2024-05-04T00:39:35.024 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3024 0.04 MB/sec execute 235 sec latency 347.187 ms 2024-05-04T00:39:36.024 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3031 0.04 MB/sec execute 236 sec latency 505.721 ms 2024-05-04T00:39:37.024 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3167 0.05 MB/sec execute 237 sec latency 1304.476 ms 2024-05-04T00:39:38.024 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3169 0.05 MB/sec execute 238 sec latency 1138.517 ms 2024-05-04T00:39:39.024 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3175 0.05 MB/sec execute 239 sec latency 342.813 ms 2024-05-04T00:39:40.024 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3187 0.05 MB/sec execute 240 sec latency 449.133 ms 2024-05-04T00:39:41.024 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3188 0.05 MB/sec execute 241 sec latency 876.726 ms 2024-05-04T00:39:42.024 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3190 0.05 MB/sec execute 242 sec latency 1201.597 ms 2024-05-04T00:39:43.024 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3209 0.05 MB/sec execute 243 sec latency 295.392 ms 2024-05-04T00:39:44.025 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3224 0.05 MB/sec execute 244 sec latency 690.216 ms 2024-05-04T00:39:45.025 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3266 0.05 MB/sec execute 245 sec latency 235.595 ms 2024-05-04T00:39:46.025 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3266 0.05 MB/sec execute 246 sec latency 1146.471 ms 2024-05-04T00:39:47.025 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3268 0.05 MB/sec execute 247 sec latency 1381.565 ms 2024-05-04T00:39:48.025 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3273 0.05 MB/sec execute 248 sec latency 1338.412 ms 2024-05-04T00:39:49.025 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3280 0.05 MB/sec execute 249 sec latency 470.667 ms 2024-05-04T00:39:50.025 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3281 0.05 MB/sec execute 250 sec latency 1181.069 ms 2024-05-04T00:39:50.195 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:39:50.198 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:39:51.025 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3282 0.05 MB/sec execute 251 sec latency 1257.813 ms 2024-05-04T00:39:52.025 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3282 0.05 MB/sec execute 252 sec latency 1032.025 ms 2024-05-04T00:39:53.025 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3283 0.05 MB/sec execute 253 sec latency 1422.404 ms 2024-05-04T00:39:54.025 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3285 0.05 MB/sec execute 254 sec latency 1118.929 ms 2024-05-04T00:39:55.025 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3286 0.05 MB/sec execute 255 sec latency 1163.532 ms 2024-05-04T00:39:56.025 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3287 0.05 MB/sec execute 256 sec latency 1130.350 ms 2024-05-04T00:39:57.026 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3287 0.05 MB/sec execute 257 sec latency 1176.287 ms 2024-05-04T00:39:58.026 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3290 0.05 MB/sec execute 258 sec latency 1391.037 ms 2024-05-04T00:39:59.026 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3291 0.05 MB/sec execute 259 sec latency 1141.252 ms 2024-05-04T00:40:00.026 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3292 0.05 MB/sec execute 260 sec latency 1108.263 ms 2024-05-04T00:40:01.026 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3293 0.05 MB/sec execute 261 sec latency 1099.495 ms 2024-05-04T00:40:02.026 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3294 0.05 MB/sec execute 262 sec latency 1111.582 ms 2024-05-04T00:40:03.026 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3295 0.05 MB/sec execute 263 sec latency 1118.151 ms 2024-05-04T00:40:04.026 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3297 0.05 MB/sec execute 264 sec latency 1137.622 ms 2024-05-04T00:40:05.026 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3298 0.05 MB/sec execute 265 sec latency 836.297 ms 2024-05-04T00:40:06.026 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3299 0.05 MB/sec execute 266 sec latency 1081.681 ms 2024-05-04T00:40:07.026 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3303 0.05 MB/sec execute 267 sec latency 1053.536 ms 2024-05-04T00:40:08.026 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3306 0.05 MB/sec execute 268 sec latency 1125.385 ms 2024-05-04T00:40:09.026 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3307 0.05 MB/sec execute 269 sec latency 1085.165 ms 2024-05-04T00:40:10.027 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3308 0.05 MB/sec execute 270 sec latency 1108.406 ms 2024-05-04T00:40:11.027 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3308 0.05 MB/sec execute 271 sec latency 1118.790 ms 2024-05-04T00:40:12.027 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3309 0.05 MB/sec execute 272 sec latency 1126.934 ms 2024-05-04T00:40:13.027 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3310 0.05 MB/sec execute 273 sec latency 1051.624 ms 2024-05-04T00:40:14.027 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3311 0.05 MB/sec execute 274 sec latency 1127.398 ms 2024-05-04T00:40:15.027 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3312 0.04 MB/sec execute 275 sec latency 1126.819 ms 2024-05-04T00:40:16.027 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3313 0.04 MB/sec execute 276 sec latency 1082.556 ms 2024-05-04T00:40:17.027 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3314 0.04 MB/sec execute 277 sec latency 1107.172 ms 2024-05-04T00:40:18.027 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3316 0.04 MB/sec execute 278 sec latency 1108.840 ms 2024-05-04T00:40:19.027 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3317 0.04 MB/sec execute 279 sec latency 1068.962 ms 2024-05-04T00:40:20.028 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3318 0.04 MB/sec execute 280 sec latency 1038.402 ms 2024-05-04T00:40:20.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:40:20.304 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:40:21.028 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3319 0.04 MB/sec execute 281 sec latency 1153.044 ms 2024-05-04T00:40:22.028 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3320 0.04 MB/sec execute 282 sec latency 1087.456 ms 2024-05-04T00:40:23.028 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3320 0.04 MB/sec execute 283 sec latency 1023.092 ms 2024-05-04T00:40:24.028 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3322 0.04 MB/sec execute 284 sec latency 1105.782 ms 2024-05-04T00:40:25.028 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3323 0.04 MB/sec execute 285 sec latency 1102.920 ms 2024-05-04T00:40:26.028 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3324 0.04 MB/sec execute 286 sec latency 1105.701 ms 2024-05-04T00:40:27.028 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3325 0.04 MB/sec execute 287 sec latency 1093.424 ms 2024-05-04T00:40:28.028 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3326 0.04 MB/sec execute 288 sec latency 1074.772 ms 2024-05-04T00:40:29.028 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3327 0.04 MB/sec execute 289 sec latency 1105.046 ms 2024-05-04T00:40:30.028 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3330 0.04 MB/sec execute 290 sec latency 1136.121 ms 2024-05-04T00:40:31.028 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3330 0.04 MB/sec execute 291 sec latency 1072.790 ms 2024-05-04T00:40:32.029 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3331 0.04 MB/sec execute 292 sec latency 1121.028 ms 2024-05-04T00:40:33.029 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3332 0.04 MB/sec execute 293 sec latency 1106.154 ms 2024-05-04T00:40:34.029 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3333 0.04 MB/sec execute 294 sec latency 1103.522 ms 2024-05-04T00:40:35.029 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3334 0.04 MB/sec execute 295 sec latency 1124.313 ms 2024-05-04T00:40:36.029 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3335 0.04 MB/sec execute 296 sec latency 1084.056 ms 2024-05-04T00:40:37.029 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3336 0.04 MB/sec execute 297 sec latency 1085.534 ms 2024-05-04T00:40:38.029 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3337 0.04 MB/sec execute 298 sec latency 1082.278 ms 2024-05-04T00:40:39.029 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3341 0.04 MB/sec execute 299 sec latency 1101.883 ms 2024-05-04T00:40:40.029 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3352 0.04 MB/sec execute 300 sec latency 290.175 ms 2024-05-04T00:40:41.029 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3359 0.04 MB/sec execute 301 sec latency 437.193 ms 2024-05-04T00:40:42.029 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3365 0.04 MB/sec execute 302 sec latency 363.275 ms 2024-05-04T00:40:43.029 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3372 0.04 MB/sec execute 303 sec latency 417.357 ms 2024-05-04T00:40:44.029 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3378 0.04 MB/sec execute 304 sec latency 393.227 ms 2024-05-04T00:40:45.030 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3391 0.04 MB/sec execute 305 sec latency 419.313 ms 2024-05-04T00:40:46.030 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3391 0.04 MB/sec execute 306 sec latency 1093.701 ms 2024-05-04T00:40:47.030 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3393 0.04 MB/sec execute 307 sec latency 1477.611 ms 2024-05-04T00:40:48.030 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3395 0.04 MB/sec execute 308 sec latency 1442.965 ms 2024-05-04T00:40:49.030 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3395 0.04 MB/sec execute 309 sec latency 1117.272 ms 2024-05-04T00:40:50.030 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3398 0.04 MB/sec execute 310 sec latency 1226.161 ms 2024-05-04T00:40:50.372 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:40:50.375 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:40:51.030 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3432 0.04 MB/sec execute 311 sec latency 1326.240 ms 2024-05-04T00:40:52.030 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3501 0.05 MB/sec execute 312 sec latency 298.895 ms 2024-05-04T00:40:53.030 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3513 0.05 MB/sec execute 313 sec latency 280.927 ms 2024-05-04T00:40:54.030 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3523 0.05 MB/sec execute 314 sec latency 351.757 ms 2024-05-04T00:40:55.030 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3531 0.05 MB/sec execute 315 sec latency 405.593 ms 2024-05-04T00:40:56.031 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3533 0.05 MB/sec execute 316 sec latency 1120.939 ms 2024-05-04T00:40:57.031 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3548 0.05 MB/sec execute 317 sec latency 385.307 ms 2024-05-04T00:40:58.031 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3551 0.05 MB/sec execute 318 sec latency 501.841 ms 2024-05-04T00:40:59.031 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3557 0.05 MB/sec execute 319 sec latency 704.692 ms 2024-05-04T00:41:00.031 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3558 0.05 MB/sec execute 320 sec latency 1298.960 ms 2024-05-04T00:41:01.031 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3563 0.05 MB/sec execute 321 sec latency 567.977 ms 2024-05-04T00:41:02.032 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3573 0.05 MB/sec execute 322 sec latency 411.316 ms 2024-05-04T00:41:03.032 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3576 0.05 MB/sec execute 323 sec latency 1236.257 ms 2024-05-04T00:41:04.031 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3588 0.05 MB/sec execute 324 sec latency 218.807 ms 2024-05-04T00:41:05.031 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3588 0.05 MB/sec execute 325 sec latency 1022.992 ms 2024-05-04T00:41:06.031 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3624 0.05 MB/sec execute 326 sec latency 1280.032 ms 2024-05-04T00:41:07.031 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3627 0.05 MB/sec execute 327 sec latency 496.638 ms 2024-05-04T00:41:08.032 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3633 0.05 MB/sec execute 328 sec latency 774.461 ms 2024-05-04T00:41:09.032 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3642 0.05 MB/sec execute 329 sec latency 435.343 ms 2024-05-04T00:41:10.032 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3642 0.05 MB/sec execute 330 sec latency 1066.559 ms 2024-05-04T00:41:11.032 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3650 0.05 MB/sec execute 331 sec latency 1192.249 ms 2024-05-04T00:41:12.032 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3664 0.05 MB/sec execute 332 sec latency 479.523 ms 2024-05-04T00:41:13.032 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3672 0.05 MB/sec execute 333 sec latency 359.145 ms 2024-05-04T00:41:14.032 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3672 0.05 MB/sec execute 334 sec latency 1185.500 ms 2024-05-04T00:41:15.032 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3676 0.05 MB/sec execute 335 sec latency 1202.864 ms 2024-05-04T00:41:16.032 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3686 0.05 MB/sec execute 336 sec latency 321.236 ms 2024-05-04T00:41:17.032 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3686 0.05 MB/sec execute 337 sec latency 1142.760 ms 2024-05-04T00:41:18.032 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3695 0.05 MB/sec execute 338 sec latency 1368.389 ms 2024-05-04T00:41:19.033 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3697 0.05 MB/sec execute 339 sec latency 541.213 ms 2024-05-04T00:41:20.033 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3707 0.05 MB/sec execute 340 sec latency 437.746 ms 2024-05-04T00:41:20.469 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:41:20.472 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:41:21.033 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3716 0.05 MB/sec execute 341 sec latency 464.864 ms 2024-05-04T00:41:22.033 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3724 0.05 MB/sec execute 342 sec latency 330.501 ms 2024-05-04T00:41:23.033 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3758 0.05 MB/sec execute 343 sec latency 272.740 ms 2024-05-04T00:41:24.033 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3760 0.05 MB/sec execute 344 sec latency 1148.143 ms 2024-05-04T00:41:25.033 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3768 0.05 MB/sec execute 345 sec latency 440.369 ms 2024-05-04T00:41:26.033 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3773 0.05 MB/sec execute 346 sec latency 722.012 ms 2024-05-04T00:41:27.033 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3779 0.05 MB/sec execute 347 sec latency 418.048 ms 2024-05-04T00:41:28.033 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3781 0.05 MB/sec execute 348 sec latency 527.619 ms 2024-05-04T00:41:29.033 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3788 0.05 MB/sec execute 349 sec latency 498.265 ms 2024-05-04T00:41:30.033 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3790 0.05 MB/sec execute 350 sec latency 782.350 ms 2024-05-04T00:41:31.034 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3792 0.05 MB/sec execute 351 sec latency 608.844 ms 2024-05-04T00:41:32.034 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3796 0.05 MB/sec execute 352 sec latency 715.958 ms 2024-05-04T00:41:33.034 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3797 0.05 MB/sec execute 353 sec latency 696.134 ms 2024-05-04T00:41:34.034 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3804 0.05 MB/sec execute 354 sec latency 544.018 ms 2024-05-04T00:41:35.034 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3808 0.05 MB/sec execute 355 sec latency 426.885 ms 2024-05-04T00:41:36.034 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3813 0.05 MB/sec execute 356 sec latency 400.568 ms 2024-05-04T00:41:37.034 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3820 0.05 MB/sec execute 357 sec latency 370.515 ms 2024-05-04T00:41:38.034 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3822 0.05 MB/sec execute 358 sec latency 826.887 ms 2024-05-04T00:41:39.035 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3828 0.05 MB/sec execute 359 sec latency 318.822 ms 2024-05-04T00:41:40.034 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3832 0.05 MB/sec execute 360 sec latency 443.967 ms 2024-05-04T00:41:41.034 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3838 0.05 MB/sec execute 361 sec latency 394.962 ms 2024-05-04T00:41:42.035 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3844 0.05 MB/sec execute 362 sec latency 342.347 ms 2024-05-04T00:41:43.034 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3848 0.05 MB/sec execute 363 sec latency 359.995 ms 2024-05-04T00:41:44.035 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3855 0.05 MB/sec execute 364 sec latency 354.007 ms 2024-05-04T00:41:45.035 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3860 0.05 MB/sec execute 365 sec latency 403.784 ms 2024-05-04T00:41:46.035 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3867 0.05 MB/sec execute 366 sec latency 499.113 ms 2024-05-04T00:41:47.035 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3870 0.05 MB/sec execute 367 sec latency 455.169 ms 2024-05-04T00:41:48.035 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3870 0.05 MB/sec execute 368 sec latency 1207.281 ms 2024-05-04T00:41:49.035 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3876 0.05 MB/sec execute 369 sec latency 1494.298 ms 2024-05-04T00:41:50.036 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3876 0.05 MB/sec execute 370 sec latency 1129.271 ms 2024-05-04T00:41:50.524 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:41:50.527 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:41:51.035 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3883 0.05 MB/sec execute 371 sec latency 1157.314 ms 2024-05-04T00:41:52.035 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3896 0.05 MB/sec execute 372 sec latency 359.652 ms 2024-05-04T00:41:53.036 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3896 0.05 MB/sec execute 373 sec latency 1145.292 ms 2024-05-04T00:41:54.036 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3898 0.05 MB/sec execute 374 sec latency 1223.438 ms 2024-05-04T00:41:55.036 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3901 0.05 MB/sec execute 375 sec latency 1114.494 ms 2024-05-04T00:41:56.036 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3914 0.05 MB/sec execute 376 sec latency 279.395 ms 2024-05-04T00:41:57.036 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3915 0.05 MB/sec execute 377 sec latency 1081.471 ms 2024-05-04T00:41:58.036 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3920 0.05 MB/sec execute 378 sec latency 420.937 ms 2024-05-04T00:41:59.036 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3927 0.04 MB/sec execute 379 sec latency 519.814 ms 2024-05-04T00:42:00.036 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3931 0.04 MB/sec execute 380 sec latency 441.790 ms 2024-05-04T00:42:01.036 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3936 0.04 MB/sec execute 381 sec latency 598.969 ms 2024-05-04T00:42:02.036 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3938 0.04 MB/sec execute 382 sec latency 579.782 ms 2024-05-04T00:42:03.037 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3939 0.04 MB/sec execute 383 sec latency 754.634 ms 2024-05-04T00:42:04.037 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3944 0.04 MB/sec execute 384 sec latency 545.953 ms 2024-05-04T00:42:05.037 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3948 0.04 MB/sec execute 385 sec latency 667.098 ms 2024-05-04T00:42:06.037 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3953 0.04 MB/sec execute 386 sec latency 544.002 ms 2024-05-04T00:42:07.037 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3959 0.04 MB/sec execute 387 sec latency 301.292 ms 2024-05-04T00:42:08.037 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3963 0.04 MB/sec execute 388 sec latency 427.431 ms 2024-05-04T00:42:09.037 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3968 0.04 MB/sec execute 389 sec latency 482.197 ms 2024-05-04T00:42:10.037 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3975 0.04 MB/sec execute 390 sec latency 333.249 ms 2024-05-04T00:42:11.037 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3979 0.04 MB/sec execute 391 sec latency 459.012 ms 2024-05-04T00:42:11.404 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:12:16.165 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:42:11.419 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:12:16.181 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:42:11.454 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:12:16.166 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:42:11.454 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:12:16.167 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:42:11.466 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:12:16.179 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:42:11.466 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:12:16.179 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:42:11.587 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:12:16.299 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:42:11.776 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:12:16.489 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:42:11.825 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:12:16.587 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:42:12.037 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3984 0.04 MB/sec execute 392 sec latency 459.164 ms 2024-05-04T00:42:13.037 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3991 0.04 MB/sec execute 393 sec latency 255.932 ms 2024-05-04T00:42:14.037 INFO:tasks.workunit.client.0.smithi006.stdout: 1 3995 0.04 MB/sec execute 394 sec latency 449.021 ms 2024-05-04T00:42:15.038 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4000 0.04 MB/sec execute 395 sec latency 485.318 ms 2024-05-04T00:42:16.038 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4006 0.04 MB/sec execute 396 sec latency 346.688 ms 2024-05-04T00:42:17.037 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4010 0.04 MB/sec execute 397 sec latency 453.495 ms 2024-05-04T00:42:18.038 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4014 0.04 MB/sec execute 398 sec latency 416.522 ms 2024-05-04T00:42:19.038 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4021 0.04 MB/sec execute 399 sec latency 401.646 ms 2024-05-04T00:42:20.038 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4026 0.04 MB/sec execute 400 sec latency 389.928 ms 2024-05-04T00:42:20.578 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:42:20.581 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:42:21.038 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4027 0.04 MB/sec execute 401 sec latency 891.633 ms 2024-05-04T00:42:22.038 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4031 0.04 MB/sec execute 402 sec latency 1081.351 ms 2024-05-04T00:42:23.038 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4032 0.04 MB/sec execute 403 sec latency 950.805 ms 2024-05-04T00:42:24.038 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4035 0.04 MB/sec execute 404 sec latency 1339.757 ms 2024-05-04T00:42:25.038 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4036 0.04 MB/sec execute 405 sec latency 1177.426 ms 2024-05-04T00:42:26.038 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4042 0.04 MB/sec execute 406 sec latency 206.109 ms 2024-05-04T00:42:27.038 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4047 0.04 MB/sec execute 407 sec latency 238.143 ms 2024-05-04T00:42:28.038 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4047 0.04 MB/sec execute 408 sec latency 1238.200 ms 2024-05-04T00:42:29.038 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4058 0.04 MB/sec execute 409 sec latency 1460.402 ms 2024-05-04T00:42:30.039 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4060 0.04 MB/sec execute 410 sec latency 1157.753 ms 2024-05-04T00:42:31.039 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4064 0.04 MB/sec execute 411 sec latency 596.151 ms 2024-05-04T00:42:32.039 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4070 0.04 MB/sec execute 412 sec latency 199.240 ms 2024-05-04T00:42:33.039 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4071 0.04 MB/sec execute 413 sec latency 856.024 ms 2024-05-04T00:42:34.039 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4082 0.04 MB/sec execute 414 sec latency 1071.089 ms 2024-05-04T00:42:35.039 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4085 0.04 MB/sec execute 415 sec latency 1091.848 ms 2024-05-04T00:42:36.039 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4096 0.04 MB/sec execute 416 sec latency 388.706 ms 2024-05-04T00:42:37.039 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4110 0.04 MB/sec execute 417 sec latency 169.329 ms 2024-05-04T00:42:38.039 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4112 0.04 MB/sec execute 418 sec latency 911.663 ms 2024-05-04T00:42:39.040 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4120 0.04 MB/sec execute 419 sec latency 971.533 ms 2024-05-04T00:42:40.040 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4130 0.04 MB/sec execute 420 sec latency 204.868 ms 2024-05-04T00:42:41.040 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4138 0.04 MB/sec execute 421 sec latency 461.744 ms 2024-05-04T00:42:42.040 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4150 0.04 MB/sec execute 422 sec latency 256.718 ms 2024-05-04T00:42:43.040 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4153 0.04 MB/sec execute 423 sec latency 765.404 ms 2024-05-04T00:42:44.040 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4159 0.04 MB/sec execute 424 sec latency 1241.562 ms 2024-05-04T00:42:45.040 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4165 0.04 MB/sec execute 425 sec latency 393.434 ms 2024-05-04T00:42:46.040 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4173 0.04 MB/sec execute 426 sec latency 358.050 ms 2024-05-04T00:42:47.040 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4173 0.04 MB/sec execute 427 sec latency 1094.535 ms 2024-05-04T00:42:48.040 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4176 0.04 MB/sec execute 428 sec latency 1127.116 ms 2024-05-04T00:42:49.040 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4178 0.04 MB/sec execute 429 sec latency 1910.113 ms 2024-05-04T00:42:50.040 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4181 0.04 MB/sec execute 430 sec latency 515.590 ms 2024-05-04T00:42:50.634 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:42:50.637 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:42:51.040 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4186 0.04 MB/sec execute 431 sec latency 1152.691 ms 2024-05-04T00:42:52.040 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4213 0.04 MB/sec execute 432 sec latency 1040.392 ms 2024-05-04T00:42:53.041 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4216 0.04 MB/sec execute 433 sec latency 918.443 ms 2024-05-04T00:42:54.041 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4217 0.04 MB/sec execute 434 sec latency 1232.861 ms 2024-05-04T00:42:55.041 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4224 0.04 MB/sec execute 435 sec latency 1077.205 ms 2024-05-04T00:42:56.041 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4225 0.04 MB/sec execute 436 sec latency 873.840 ms 2024-05-04T00:42:57.041 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4233 0.04 MB/sec execute 437 sec latency 1026.505 ms 2024-05-04T00:42:58.041 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4246 0.04 MB/sec execute 438 sec latency 286.147 ms 2024-05-04T00:42:59.041 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4252 0.04 MB/sec execute 439 sec latency 796.064 ms 2024-05-04T00:43:00.041 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4254 0.04 MB/sec execute 440 sec latency 1082.911 ms 2024-05-04T00:43:01.041 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4270 0.04 MB/sec execute 441 sec latency 1056.193 ms 2024-05-04T00:43:02.041 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4281 0.04 MB/sec execute 442 sec latency 408.282 ms 2024-05-04T00:43:03.041 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4283 0.04 MB/sec execute 443 sec latency 699.713 ms 2024-05-04T00:43:04.042 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4306 0.04 MB/sec execute 444 sec latency 345.644 ms 2024-05-04T00:43:05.042 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4315 0.04 MB/sec execute 445 sec latency 356.102 ms 2024-05-04T00:43:06.042 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4317 0.04 MB/sec execute 446 sec latency 1004.768 ms 2024-05-04T00:43:07.042 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4318 0.04 MB/sec execute 447 sec latency 1187.459 ms 2024-05-04T00:43:08.042 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4344 0.04 MB/sec execute 448 sec latency 488.473 ms 2024-05-04T00:43:09.042 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4350 0.04 MB/sec execute 449 sec latency 705.492 ms 2024-05-04T00:43:10.042 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4362 0.04 MB/sec execute 450 sec latency 335.990 ms 2024-05-04T00:43:11.042 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4382 0.04 MB/sec execute 451 sec latency 178.548 ms 2024-05-04T00:43:12.042 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4383 0.04 MB/sec execute 452 sec latency 905.988 ms 2024-05-04T00:43:13.042 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4384 0.04 MB/sec execute 453 sec latency 1151.962 ms 2024-05-04T00:43:14.043 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4387 0.04 MB/sec execute 454 sec latency 1403.650 ms 2024-05-04T00:43:15.043 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4388 0.04 MB/sec execute 455 sec latency 810.188 ms 2024-05-04T00:43:16.043 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4393 0.04 MB/sec execute 456 sec latency 1148.535 ms 2024-05-04T00:43:17.043 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4423 0.04 MB/sec execute 457 sec latency 1167.827 ms 2024-05-04T00:43:18.043 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4423 0.04 MB/sec execute 458 sec latency 1052.776 ms 2024-05-04T00:43:19.043 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4424 0.04 MB/sec execute 459 sec latency 1361.630 ms 2024-05-04T00:43:20.043 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4429 0.04 MB/sec execute 460 sec latency 1136.260 ms 2024-05-04T00:43:20.733 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:43:20.736 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:43:21.043 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4432 0.04 MB/sec execute 461 sec latency 832.027 ms 2024-05-04T00:43:22.043 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4434 0.04 MB/sec execute 462 sec latency 1053.658 ms 2024-05-04T00:43:23.043 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4450 0.04 MB/sec execute 463 sec latency 416.089 ms 2024-05-04T00:43:24.043 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4462 0.04 MB/sec execute 464 sec latency 1100.128 ms 2024-05-04T00:43:25.046 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4472 0.04 MB/sec execute 465 sec latency 451.985 ms 2024-05-04T00:43:26.044 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4474 0.04 MB/sec execute 466 sec latency 683.968 ms 2024-05-04T00:43:27.044 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4493 0.04 MB/sec execute 467 sec latency 317.097 ms 2024-05-04T00:43:28.044 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4497 0.04 MB/sec execute 468 sec latency 772.574 ms 2024-05-04T00:43:29.044 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4498 0.04 MB/sec execute 469 sec latency 1453.062 ms 2024-05-04T00:43:30.044 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4499 0.04 MB/sec execute 470 sec latency 1273.953 ms 2024-05-04T00:43:31.044 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4500 0.04 MB/sec execute 471 sec latency 634.561 ms 2024-05-04T00:43:32.045 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4501 0.04 MB/sec execute 472 sec latency 755.812 ms 2024-05-04T00:43:33.045 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4504 0.04 MB/sec execute 473 sec latency 1326.076 ms 2024-05-04T00:43:34.044 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4506 0.04 MB/sec execute 474 sec latency 733.222 ms 2024-05-04T00:43:35.044 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4511 0.04 MB/sec execute 475 sec latency 1212.327 ms 2024-05-04T00:43:36.044 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4526 0.04 MB/sec execute 476 sec latency 1119.884 ms 2024-05-04T00:43:37.044 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4538 0.04 MB/sec execute 477 sec latency 342.630 ms 2024-05-04T00:43:38.045 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4540 0.04 MB/sec execute 478 sec latency 762.828 ms 2024-05-04T00:43:39.045 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4559 0.04 MB/sec execute 479 sec latency 276.590 ms 2024-05-04T00:43:40.045 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4563 0.04 MB/sec execute 480 sec latency 623.870 ms 2024-05-04T00:43:41.045 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4569 0.04 MB/sec execute 481 sec latency 1085.556 ms 2024-05-04T00:43:42.045 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4596 0.04 MB/sec execute 482 sec latency 654.966 ms 2024-05-04T00:43:43.046 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4597 0.04 MB/sec execute 483 sec latency 1418.587 ms 2024-05-04T00:43:44.045 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4602 0.04 MB/sec execute 484 sec latency 510.289 ms 2024-05-04T00:43:45.045 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4609 0.04 MB/sec execute 485 sec latency 1127.392 ms 2024-05-04T00:43:46.045 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4614 0.04 MB/sec execute 486 sec latency 673.521 ms 2024-05-04T00:43:47.045 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4615 0.04 MB/sec execute 487 sec latency 1140.238 ms 2024-05-04T00:43:48.046 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4616 0.04 MB/sec execute 488 sec latency 1438.581 ms 2024-05-04T00:43:49.046 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4616 0.04 MB/sec execute 489 sec latency 1094.945 ms 2024-05-04T00:43:50.046 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4628 0.04 MB/sec execute 490 sec latency 1100.501 ms 2024-05-04T00:43:50.787 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:43:50.791 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:43:51.046 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4632 0.04 MB/sec execute 491 sec latency 453.891 ms 2024-05-04T00:43:52.046 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4652 0.04 MB/sec execute 492 sec latency 394.341 ms 2024-05-04T00:43:53.046 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4656 0.04 MB/sec execute 493 sec latency 616.855 ms 2024-05-04T00:43:54.046 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4659 0.04 MB/sec execute 494 sec latency 1423.356 ms 2024-05-04T00:43:55.046 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4668 0.04 MB/sec execute 495 sec latency 334.455 ms 2024-05-04T00:43:56.046 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4668 0.04 MB/sec execute 496 sec latency 1327.284 ms 2024-05-04T00:43:57.046 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4681 0.04 MB/sec execute 497 sec latency 1397.397 ms 2024-05-04T00:43:58.046 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4684 0.04 MB/sec execute 498 sec latency 1154.452 ms 2024-05-04T00:43:59.046 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4695 0.04 MB/sec execute 499 sec latency 344.245 ms 2024-05-04T00:44:00.047 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4712 0.04 MB/sec execute 500 sec latency 453.121 ms 2024-05-04T00:44:01.047 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4723 0.04 MB/sec execute 501 sec latency 636.179 ms 2024-05-04T00:44:02.047 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4724 0.04 MB/sec execute 502 sec latency 699.485 ms 2024-05-04T00:44:03.047 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4729 0.04 MB/sec execute 503 sec latency 1147.034 ms 2024-05-04T00:44:04.047 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4734 0.04 MB/sec execute 504 sec latency 709.075 ms 2024-05-04T00:44:05.047 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4735 0.04 MB/sec execute 505 sec latency 1113.907 ms 2024-05-04T00:44:06.047 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4736 0.04 MB/sec execute 506 sec latency 1212.400 ms 2024-05-04T00:44:07.047 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4738 0.04 MB/sec execute 507 sec latency 1192.005 ms 2024-05-04T00:44:08.047 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4743 0.04 MB/sec execute 508 sec latency 447.010 ms 2024-05-04T00:44:09.047 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4747 0.04 MB/sec execute 509 sec latency 383.809 ms 2024-05-04T00:44:10.048 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4766 0.04 MB/sec execute 510 sec latency 379.516 ms 2024-05-04T00:44:11.048 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4770 0.04 MB/sec execute 511 sec latency 650.802 ms 2024-05-04T00:44:12.048 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4780 0.04 MB/sec execute 512 sec latency 1112.935 ms 2024-05-04T00:44:13.048 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4781 0.04 MB/sec execute 513 sec latency 580.286 ms 2024-05-04T00:44:14.049 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4797 0.04 MB/sec execute 514 sec latency 545.295 ms 2024-05-04T00:44:15.048 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4810 0.04 MB/sec execute 515 sec latency 420.650 ms 2024-05-04T00:44:16.048 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4814 0.04 MB/sec execute 516 sec latency 706.157 ms 2024-05-04T00:44:17.048 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4818 0.04 MB/sec execute 517 sec latency 1119.814 ms 2024-05-04T00:44:18.048 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4839 0.04 MB/sec execute 518 sec latency 339.881 ms 2024-05-04T00:44:19.048 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4844 0.04 MB/sec execute 519 sec latency 515.368 ms 2024-05-04T00:44:20.048 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4846 0.04 MB/sec execute 520 sec latency 1185.696 ms 2024-05-04T00:44:20.927 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:44:20.932 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:44:21.048 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4847 0.04 MB/sec execute 521 sec latency 1104.384 ms 2024-05-04T00:44:22.048 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4850 0.04 MB/sec execute 522 sec latency 1079.304 ms 2024-05-04T00:44:23.049 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4850 0.04 MB/sec execute 523 sec latency 1054.030 ms 2024-05-04T00:44:24.049 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4851 0.04 MB/sec execute 524 sec latency 1813.726 ms 2024-05-04T00:44:25.049 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4942 0.04 MB/sec execute 525 sec latency 683.036 ms 2024-05-04T00:44:26.049 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4943 0.04 MB/sec execute 526 sec latency 1252.240 ms 2024-05-04T00:44:27.049 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4944 0.04 MB/sec execute 527 sec latency 1141.467 ms 2024-05-04T00:44:28.049 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4947 0.04 MB/sec execute 528 sec latency 702.592 ms 2024-05-04T00:44:29.049 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4951 0.04 MB/sec execute 529 sec latency 1208.396 ms 2024-05-04T00:44:30.050 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4953 0.04 MB/sec execute 530 sec latency 1121.227 ms 2024-05-04T00:44:31.049 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4962 0.04 MB/sec execute 531 sec latency 194.493 ms 2024-05-04T00:44:32.049 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4963 0.04 MB/sec execute 532 sec latency 741.048 ms 2024-05-04T00:44:33.050 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4969 0.04 MB/sec execute 533 sec latency 1089.624 ms 2024-05-04T00:44:34.049 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4983 0.04 MB/sec execute 534 sec latency 759.241 ms 2024-05-04T00:44:35.050 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4984 0.04 MB/sec execute 535 sec latency 1105.354 ms 2024-05-04T00:44:36.050 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4994 0.04 MB/sec execute 536 sec latency 520.020 ms 2024-05-04T00:44:37.050 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5011 0.04 MB/sec execute 537 sec latency 524.714 ms 2024-05-04T00:44:38.050 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5014 0.04 MB/sec execute 538 sec latency 496.587 ms 2024-05-04T00:44:39.050 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5017 0.04 MB/sec execute 539 sec latency 1104.916 ms 2024-05-04T00:44:40.050 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5030 0.04 MB/sec execute 540 sec latency 230.833 ms 2024-05-04T00:44:41.050 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5032 0.04 MB/sec execute 541 sec latency 522.567 ms 2024-05-04T00:44:42.050 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5047 0.04 MB/sec execute 542 sec latency 1156.553 ms 2024-05-04T00:44:43.050 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5051 0.04 MB/sec execute 543 sec latency 778.149 ms 2024-05-04T00:44:44.050 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5052 0.04 MB/sec execute 544 sec latency 1629.204 ms 2024-05-04T00:44:45.050 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5055 0.04 MB/sec execute 545 sec latency 392.706 ms 2024-05-04T00:44:46.050 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5056 0.04 MB/sec execute 546 sec latency 948.019 ms 2024-05-04T00:44:47.050 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5066 0.04 MB/sec execute 547 sec latency 1169.261 ms 2024-05-04T00:44:48.050 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5078 0.04 MB/sec execute 548 sec latency 391.028 ms 2024-05-04T00:44:49.051 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5089 0.04 MB/sec execute 549 sec latency 426.144 ms 2024-05-04T00:44:50.051 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5092 0.04 MB/sec execute 550 sec latency 476.660 ms 2024-05-04T00:44:51.015 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:44:51.019 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:44:51.051 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5096 0.04 MB/sec execute 551 sec latency 1071.589 ms 2024-05-04T00:44:52.051 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5100 0.04 MB/sec execute 552 sec latency 1069.409 ms 2024-05-04T00:44:53.051 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5118 0.04 MB/sec execute 553 sec latency 430.393 ms 2024-05-04T00:44:54.051 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5120 0.04 MB/sec execute 554 sec latency 717.484 ms 2024-05-04T00:44:55.051 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5129 0.04 MB/sec execute 555 sec latency 1103.055 ms 2024-05-04T00:44:56.051 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5141 0.04 MB/sec execute 556 sec latency 182.391 ms 2024-05-04T00:44:57.051 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5151 0.04 MB/sec execute 557 sec latency 206.156 ms 2024-05-04T00:44:58.052 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5154 0.04 MB/sec execute 558 sec latency 337.262 ms 2024-05-04T00:44:59.051 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5154 0.04 MB/sec execute 559 sec latency 1293.306 ms 2024-05-04T00:45:00.051 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5171 0.04 MB/sec execute 560 sec latency 1367.768 ms 2024-05-04T00:45:01.052 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5171 0.04 MB/sec execute 561 sec latency 1073.297 ms 2024-05-04T00:45:02.052 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5175 0.04 MB/sec execute 562 sec latency 1223.283 ms 2024-05-04T00:45:03.052 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5178 0.04 MB/sec execute 563 sec latency 1229.237 ms 2024-05-04T00:45:04.052 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5181 0.04 MB/sec execute 564 sec latency 520.478 ms 2024-05-04T00:45:05.052 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5182 0.04 MB/sec execute 565 sec latency 872.404 ms 2024-05-04T00:45:06.052 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5206 0.04 MB/sec execute 566 sec latency 1074.420 ms 2024-05-04T00:45:07.052 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5206 0.04 MB/sec execute 567 sec latency 1015.146 ms 2024-05-04T00:45:08.052 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5209 0.04 MB/sec execute 568 sec latency 1130.460 ms 2024-05-04T00:45:09.052 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5216 0.04 MB/sec execute 569 sec latency 1207.091 ms 2024-05-04T00:45:10.052 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5227 0.04 MB/sec execute 570 sec latency 592.804 ms 2024-05-04T00:45:11.053 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5251 0.04 MB/sec execute 571 sec latency 487.784 ms 2024-05-04T00:45:12.053 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5254 0.04 MB/sec execute 572 sec latency 865.032 ms 2024-05-04T00:45:13.053 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5263 0.04 MB/sec execute 573 sec latency 584.391 ms 2024-05-04T00:45:14.053 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5266 0.04 MB/sec execute 574 sec latency 466.289 ms 2024-05-04T00:45:15.053 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5271 0.04 MB/sec execute 575 sec latency 1182.858 ms 2024-05-04T00:45:16.053 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5272 0.04 MB/sec execute 576 sec latency 990.618 ms 2024-05-04T00:45:17.053 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5280 0.04 MB/sec execute 577 sec latency 1102.473 ms 2024-05-04T00:45:18.053 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5292 0.04 MB/sec execute 578 sec latency 181.480 ms 2024-05-04T00:45:19.053 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5323 0.04 MB/sec execute 579 sec latency 220.337 ms 2024-05-04T00:45:20.053 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5335 0.04 MB/sec execute 580 sec latency 391.645 ms 2024-05-04T00:45:21.053 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5337 0.04 MB/sec execute 581 sec latency 746.932 ms 2024-05-04T00:45:21.120 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:45:21.123 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:45:22.053 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5356 0.04 MB/sec execute 582 sec latency 1006.800 ms 2024-05-04T00:45:23.054 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5369 0.04 MB/sec execute 583 sec latency 207.447 ms 2024-05-04T00:45:24.054 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5371 0.04 MB/sec execute 584 sec latency 470.843 ms 2024-05-04T00:45:25.054 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5382 0.04 MB/sec execute 585 sec latency 1154.343 ms 2024-05-04T00:45:26.054 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5387 0.04 MB/sec execute 586 sec latency 473.252 ms 2024-05-04T00:45:27.054 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5390 0.04 MB/sec execute 587 sec latency 1129.198 ms 2024-05-04T00:45:28.054 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5391 0.04 MB/sec execute 588 sec latency 925.861 ms 2024-05-04T00:45:29.054 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5401 0.04 MB/sec execute 589 sec latency 1156.560 ms 2024-05-04T00:45:30.054 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5405 0.04 MB/sec execute 590 sec latency 327.785 ms 2024-05-04T00:45:31.054 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5406 0.04 MB/sec execute 591 sec latency 960.408 ms 2024-05-04T00:45:32.054 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5422 0.04 MB/sec execute 592 sec latency 1123.229 ms 2024-05-04T00:45:33.055 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5423 0.04 MB/sec execute 593 sec latency 967.781 ms 2024-05-04T00:45:34.055 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5427 0.04 MB/sec execute 594 sec latency 1343.544 ms 2024-05-04T00:45:35.055 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5430 0.04 MB/sec execute 595 sec latency 1104.815 ms 2024-05-04T00:45:36.055 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5434 0.04 MB/sec execute 596 sec latency 376.982 ms 2024-05-04T00:45:37.055 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5434 0.04 MB/sec execute 597 sec latency 1063.166 ms 2024-05-04T00:45:38.055 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5461 0.04 MB/sec execute 598 sec latency 1120.175 ms 2024-05-04T00:45:39.055 INFO:tasks.workunit.client.0.smithi006.stdout: 1 5463 0.04 MB/sec execute 599 sec latency 968.167 ms 2024-05-04T00:45:40.055 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 600 sec 2024-05-04T00:45:41.055 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 601 sec 2024-05-04T00:45:42.058 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 602 sec 2024-05-04T00:45:43.055 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 603 sec 2024-05-04T00:45:44.055 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 604 sec 2024-05-04T00:45:45.056 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 605 sec 2024-05-04T00:45:46.056 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 606 sec 2024-05-04T00:45:47.056 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 607 sec 2024-05-04T00:45:48.056 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 608 sec 2024-05-04T00:45:49.056 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 609 sec 2024-05-04T00:45:50.056 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 610 sec 2024-05-04T00:45:51.057 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 611 sec 2024-05-04T00:45:51.185 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:45:51.188 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:45:52.056 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 612 sec 2024-05-04T00:45:53.056 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 613 sec 2024-05-04T00:45:54.057 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 614 sec 2024-05-04T00:45:55.057 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 615 sec 2024-05-04T00:45:56.056 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 616 sec 2024-05-04T00:45:57.057 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 617 sec 2024-05-04T00:45:58.057 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 618 sec 2024-05-04T00:45:59.057 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 619 sec 2024-05-04T00:46:00.057 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 620 sec 2024-05-04T00:46:01.057 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 621 sec 2024-05-04T00:46:01.204 INFO:tasks.workunit.client.0.smithi006.stdout: 0 cleanup 621 sec 2024-05-04T00:46:01.205 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-05-04T00:46:01.205 INFO:tasks.workunit.client.0.smithi006.stdout: Operation Count AvgLat MaxLat 2024-05-04T00:46:01.205 INFO:tasks.workunit.client.0.smithi006.stdout: ---------------------------------------- 2024-05-04T00:46:01.205 INFO:tasks.workunit.client.0.smithi006.stdout: NTCreateX 771 207.264 826.869 2024-05-04T00:46:01.205 INFO:tasks.workunit.client.0.smithi006.stdout: Close 561 4.185 34.786 2024-05-04T00:46:01.205 INFO:tasks.workunit.client.0.smithi006.stdout: Rename 30 565.904 865.016 2024-05-04T00:46:01.205 INFO:tasks.workunit.client.0.smithi006.stdout: Unlink 136 200.112 527.596 2024-05-04T00:46:01.205 INFO:tasks.workunit.client.0.smithi006.stdout: Qpathinfo 711 110.888 730.111 2024-05-04T00:46:01.205 INFO:tasks.workunit.client.0.smithi006.stdout: Qfileinfo 125 3.253 6.083 2024-05-04T00:46:01.206 INFO:tasks.workunit.client.0.smithi006.stdout: Qfsinfo 108 28.592 138.773 2024-05-04T00:46:01.206 INFO:tasks.workunit.client.0.smithi006.stdout: Sfileinfo 59 39.583 49.593 2024-05-04T00:46:01.206 INFO:tasks.workunit.client.0.smithi006.stdout: Find 255 1164.065 2307.675 2024-05-04T00:46:01.206 INFO:tasks.workunit.client.0.smithi006.stdout: WriteX 359 12.834 227.886 2024-05-04T00:46:01.206 INFO:tasks.workunit.client.0.smithi006.stdout: ReadX 1140 0.116 7.658 2024-05-04T00:46:01.206 INFO:tasks.workunit.client.0.smithi006.stdout: LockX 2 98.058 138.800 2024-05-04T00:46:01.206 INFO:tasks.workunit.client.0.smithi006.stdout: UnlockX 2 152.633 200.685 2024-05-04T00:46:01.206 INFO:tasks.workunit.client.0.smithi006.stdout: Flush 49 155.330 288.951 2024-05-04T00:46:01.206 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-05-04T00:46:01.206 INFO:tasks.workunit.client.0.smithi006.stdout:Throughput 0.0375607 MB/sec 1 clients 1 procs max_latency=2307.691 ms 2024-05-04T00:46:01.207 INFO:tasks.workunit.client.0.smithi006.stderr:+ dbench 10 2024-05-04T00:46:01.207 INFO:tasks.workunit.client.0.smithi006.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-05-04T00:46:01.207 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-05-04T00:46:01.208 INFO:tasks.workunit.client.0.smithi006.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-05-04T00:46:01.208 INFO:tasks.workunit.client.0.smithi006.stdout:8 of 10 processes prepared for launch 0 sec 2024-05-04T00:46:01.307 INFO:tasks.workunit.client.0.smithi006.stdout:10 of 10 processes prepared for launch 0 sec 2024-05-04T00:46:01.309 INFO:tasks.workunit.client.0.smithi006.stdout:releasing clients 2024-05-04T00:46:02.307 INFO:tasks.workunit.client.0.smithi006.stdout: 0 2 0.00 MB/sec warmup 1 sec latency 999.838 ms 2024-05-04T00:46:03.307 INFO:tasks.workunit.client.0.smithi006.stdout: 0 2 0.00 MB/sec warmup 2 sec latency 1999.947 ms 2024-05-04T00:46:04.307 INFO:tasks.workunit.client.0.smithi006.stdout: 0 2 0.00 MB/sec warmup 3 sec latency 3000.048 ms 2024-05-04T00:46:05.307 INFO:tasks.workunit.client.0.smithi006.stdout: 0 2 0.00 MB/sec warmup 4 sec latency 4000.128 ms 2024-05-04T00:46:06.307 INFO:tasks.workunit.client.0.smithi006.stdout: 0 4 0.00 MB/sec warmup 5 sec latency 5000.190 ms 2024-05-04T00:46:07.307 INFO:tasks.workunit.client.0.smithi006.stdout: 0 5 0.00 MB/sec warmup 6 sec latency 6000.285 ms 2024-05-04T00:46:08.307 INFO:tasks.workunit.client.0.smithi006.stdout: 0 6 0.00 MB/sec warmup 7 sec latency 7000.344 ms 2024-05-04T00:46:09.307 INFO:tasks.workunit.client.0.smithi006.stdout: 0 7 0.00 MB/sec warmup 8 sec latency 1572.823 ms 2024-05-04T00:46:10.308 INFO:tasks.workunit.client.0.smithi006.stdout: 1 9 0.00 MB/sec warmup 9 sec latency 999.863 ms 2024-05-04T00:46:11.307 INFO:tasks.workunit.client.0.smithi006.stdout: 4 13 0.14 MB/sec warmup 10 sec latency 1263.256 ms 2024-05-04T00:46:12.308 INFO:tasks.workunit.client.0.smithi006.stdout: 6 18 0.36 MB/sec warmup 11 sec latency 1544.593 ms 2024-05-04T00:46:13.308 INFO:tasks.workunit.client.0.smithi006.stdout: 6 22 0.51 MB/sec warmup 12 sec latency 1734.037 ms 2024-05-04T00:46:14.308 INFO:tasks.workunit.client.0.smithi006.stdout: 9 27 0.62 MB/sec warmup 13 sec latency 1976.266 ms 2024-05-04T00:46:15.308 INFO:tasks.workunit.client.0.smithi006.stdout: 10 33 0.81 MB/sec warmup 14 sec latency 2047.136 ms 2024-05-04T00:46:16.308 INFO:tasks.workunit.client.0.smithi006.stdout: 10 40 1.00 MB/sec warmup 15 sec latency 1724.849 ms 2024-05-04T00:46:17.308 INFO:tasks.workunit.client.0.smithi006.stdout: 10 44 1.10 MB/sec warmup 16 sec latency 1752.095 ms 2024-05-04T00:46:18.309 INFO:tasks.workunit.client.0.smithi006.stdout: 10 48 1.13 MB/sec warmup 17 sec latency 2295.530 ms 2024-05-04T00:46:19.308 INFO:tasks.workunit.client.0.smithi006.stdout: 10 53 1.23 MB/sec warmup 18 sec latency 2595.663 ms 2024-05-04T00:46:20.216 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:16:24.978 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:46:20.232 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:16:24.994 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:46:20.308 INFO:tasks.workunit.client.0.smithi006.stdout: 10 58 1.30 MB/sec warmup 19 sec latency 2728.375 ms 2024-05-04T00:46:20.374 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:16:25.086 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:46:20.376 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:16:25.088 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:46:20.378 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:16:25.090 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:46:20.414 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:16:25.127 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:46:20.428 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:16:25.190 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:46:20.517 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:16:25.229 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:46:20.528 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:16:25.240 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:46:21.299 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:46:21.302 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:46:21.308 INFO:tasks.workunit.client.0.smithi006.stdout: 10 64 1.40 MB/sec warmup 20 sec latency 2649.572 ms 2024-05-04T00:46:22.309 INFO:tasks.workunit.client.0.smithi006.stdout: 10 71 1.49 MB/sec warmup 21 sec latency 2105.733 ms 2024-05-04T00:46:23.309 INFO:tasks.workunit.client.0.smithi006.stdout: 10 74 1.50 MB/sec warmup 22 sec latency 2757.047 ms 2024-05-04T00:46:24.309 INFO:tasks.workunit.client.0.smithi006.stdout: 10 79 1.55 MB/sec warmup 23 sec latency 3055.896 ms 2024-05-04T00:46:25.309 INFO:tasks.workunit.client.0.smithi006.stdout: 10 84 1.61 MB/sec warmup 24 sec latency 3164.739 ms 2024-05-04T00:46:26.309 INFO:tasks.workunit.client.0.smithi006.stdout: 10 88 1.61 MB/sec warmup 25 sec latency 3146.425 ms 2024-05-04T00:46:27.309 INFO:tasks.workunit.client.0.smithi006.stdout: 10 94 1.68 MB/sec warmup 26 sec latency 2753.598 ms 2024-05-04T00:46:28.309 INFO:tasks.workunit.client.0.smithi006.stdout: 10 99 1.70 MB/sec warmup 27 sec latency 2572.929 ms 2024-05-04T00:46:29.309 INFO:tasks.workunit.client.0.smithi006.stdout: 10 102 1.71 MB/sec warmup 28 sec latency 2136.666 ms 2024-05-04T00:46:30.309 INFO:tasks.workunit.client.0.smithi006.stdout: 10 105 1.71 MB/sec warmup 29 sec latency 2945.682 ms 2024-05-04T00:46:31.309 INFO:tasks.workunit.client.0.smithi006.stdout: 10 110 1.72 MB/sec warmup 30 sec latency 3306.982 ms 2024-05-04T00:46:32.310 INFO:tasks.workunit.client.0.smithi006.stdout: 10 113 1.70 MB/sec warmup 31 sec latency 3378.662 ms 2024-05-04T00:46:33.310 INFO:tasks.workunit.client.0.smithi006.stdout: 10 113 1.65 MB/sec warmup 32 sec latency 3420.723 ms 2024-05-04T00:46:34.309 INFO:tasks.workunit.client.0.smithi006.stdout: 10 115 1.62 MB/sec warmup 33 sec latency 2564.013 ms 2024-05-04T00:46:35.310 INFO:tasks.workunit.client.0.smithi006.stdout: 10 117 1.58 MB/sec warmup 34 sec latency 3252.672 ms 2024-05-04T00:46:36.310 INFO:tasks.workunit.client.0.smithi006.stdout: 10 119 1.55 MB/sec warmup 35 sec latency 4047.649 ms 2024-05-04T00:46:37.310 INFO:tasks.workunit.client.0.smithi006.stdout: 10 121 1.54 MB/sec warmup 36 sec latency 2971.762 ms 2024-05-04T00:46:38.310 INFO:tasks.workunit.client.0.smithi006.stdout: 10 126 1.53 MB/sec warmup 37 sec latency 3245.771 ms 2024-05-04T00:46:39.310 INFO:tasks.workunit.client.0.smithi006.stdout: 10 127 1.50 MB/sec warmup 38 sec latency 2821.688 ms 2024-05-04T00:46:40.310 INFO:tasks.workunit.client.0.smithi006.stdout: 10 130 1.48 MB/sec warmup 39 sec latency 3141.800 ms 2024-05-04T00:46:41.310 INFO:tasks.workunit.client.0.smithi006.stdout: 10 133 1.48 MB/sec warmup 40 sec latency 2822.123 ms 2024-05-04T00:46:42.310 INFO:tasks.workunit.client.0.smithi006.stdout: 10 135 1.45 MB/sec warmup 41 sec latency 2378.768 ms 2024-05-04T00:46:43.310 INFO:tasks.workunit.client.0.smithi006.stdout: 10 137 1.43 MB/sec warmup 42 sec latency 2600.903 ms 2024-05-04T00:46:44.310 INFO:tasks.workunit.client.0.smithi006.stdout: 10 140 1.41 MB/sec warmup 43 sec latency 3058.264 ms 2024-05-04T00:46:45.310 INFO:tasks.workunit.client.0.smithi006.stdout: 10 140 1.38 MB/sec warmup 44 sec latency 2751.084 ms 2024-05-04T00:46:46.311 INFO:tasks.workunit.client.0.smithi006.stdout: 10 140 1.36 MB/sec warmup 45 sec latency 3751.178 ms 2024-05-04T00:46:47.311 INFO:tasks.workunit.client.0.smithi006.stdout: 10 142 1.34 MB/sec warmup 46 sec latency 4562.421 ms 2024-05-04T00:46:48.311 INFO:tasks.workunit.client.0.smithi006.stdout: 10 143 1.31 MB/sec warmup 47 sec latency 4687.645 ms 2024-05-04T00:46:49.311 INFO:tasks.workunit.client.0.smithi006.stdout: 10 143 1.29 MB/sec warmup 48 sec latency 5364.624 ms 2024-05-04T00:46:50.311 INFO:tasks.workunit.client.0.smithi006.stdout: 10 146 1.28 MB/sec warmup 49 sec latency 6189.729 ms 2024-05-04T00:46:51.311 INFO:tasks.workunit.client.0.smithi006.stdout: 10 146 1.25 MB/sec warmup 50 sec latency 7189.805 ms 2024-05-04T00:46:51.430 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:46:51.433 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:46:52.311 INFO:tasks.workunit.client.0.smithi006.stdout: 10 147 1.24 MB/sec warmup 51 sec latency 8189.895 ms 2024-05-04T00:46:53.311 INFO:tasks.workunit.client.0.smithi006.stdout: 10 150 1.23 MB/sec warmup 52 sec latency 8267.040 ms 2024-05-04T00:46:54.311 INFO:tasks.workunit.client.0.smithi006.stdout: 10 153 1.22 MB/sec warmup 53 sec latency 4197.206 ms 2024-05-04T00:46:55.311 INFO:tasks.workunit.client.0.smithi006.stdout: 10 156 1.22 MB/sec warmup 54 sec latency 3371.942 ms 2024-05-04T00:46:56.311 INFO:tasks.workunit.client.0.smithi006.stdout: 10 157 1.20 MB/sec warmup 55 sec latency 3156.870 ms 2024-05-04T00:46:57.311 INFO:tasks.workunit.client.0.smithi006.stdout: 10 157 1.18 MB/sec warmup 56 sec latency 3428.919 ms 2024-05-04T00:46:58.311 INFO:tasks.workunit.client.0.smithi006.stdout: 10 162 1.18 MB/sec warmup 57 sec latency 3605.070 ms 2024-05-04T00:46:59.312 INFO:tasks.workunit.client.0.smithi006.stdout: 10 164 1.17 MB/sec warmup 58 sec latency 1794.490 ms 2024-05-04T00:47:00.312 INFO:tasks.workunit.client.0.smithi006.stdout: 10 164 1.15 MB/sec warmup 59 sec latency 2794.581 ms 2024-05-04T00:47:01.312 INFO:tasks.workunit.client.0.smithi006.stdout: 10 165 1.14 MB/sec warmup 60 sec latency 3534.729 ms 2024-05-04T00:47:02.312 INFO:tasks.workunit.client.0.smithi006.stdout: 10 167 1.13 MB/sec warmup 61 sec latency 4179.083 ms 2024-05-04T00:47:03.312 INFO:tasks.workunit.client.0.smithi006.stdout: 10 173 1.14 MB/sec warmup 62 sec latency 4487.331 ms 2024-05-04T00:47:04.312 INFO:tasks.workunit.client.0.smithi006.stdout: 10 174 1.13 MB/sec warmup 63 sec latency 2154.877 ms 2024-05-04T00:47:05.312 INFO:tasks.workunit.client.0.smithi006.stdout: 10 176 1.12 MB/sec warmup 64 sec latency 2758.914 ms 2024-05-04T00:47:06.312 INFO:tasks.workunit.client.0.smithi006.stdout: 10 177 1.11 MB/sec warmup 65 sec latency 3307.056 ms 2024-05-04T00:47:07.312 INFO:tasks.workunit.client.0.smithi006.stdout: 10 178 1.09 MB/sec warmup 66 sec latency 4307.160 ms 2024-05-04T00:47:08.312 INFO:tasks.workunit.client.0.smithi006.stdout: 10 181 1.09 MB/sec warmup 67 sec latency 4775.425 ms 2024-05-04T00:47:09.313 INFO:tasks.workunit.client.0.smithi006.stdout: 10 185 1.10 MB/sec warmup 68 sec latency 3665.437 ms 2024-05-04T00:47:10.312 INFO:tasks.workunit.client.0.smithi006.stdout: 10 186 1.08 MB/sec warmup 69 sec latency 3491.783 ms 2024-05-04T00:47:11.313 INFO:tasks.workunit.client.0.smithi006.stdout: 10 188 1.08 MB/sec warmup 70 sec latency 3216.250 ms 2024-05-04T00:47:12.313 INFO:tasks.workunit.client.0.smithi006.stdout: 10 189 1.07 MB/sec warmup 71 sec latency 3640.053 ms 2024-05-04T00:47:13.313 INFO:tasks.workunit.client.0.smithi006.stdout: 10 192 1.06 MB/sec warmup 72 sec latency 4140.090 ms 2024-05-04T00:47:14.313 INFO:tasks.workunit.client.0.smithi006.stdout: 10 195 1.06 MB/sec warmup 73 sec latency 3841.830 ms 2024-05-04T00:47:15.313 INFO:tasks.workunit.client.0.smithi006.stdout: 10 199 1.07 MB/sec warmup 74 sec latency 3304.832 ms 2024-05-04T00:47:16.313 INFO:tasks.workunit.client.0.smithi006.stdout: 10 199 1.06 MB/sec warmup 75 sec latency 2733.326 ms 2024-05-04T00:47:17.313 INFO:tasks.workunit.client.0.smithi006.stdout: 10 200 1.04 MB/sec warmup 76 sec latency 3733.410 ms 2024-05-04T00:47:18.313 INFO:tasks.workunit.client.0.smithi006.stdout: 10 201 1.03 MB/sec warmup 77 sec latency 4424.210 ms 2024-05-04T00:47:19.313 INFO:tasks.workunit.client.0.smithi006.stdout: 10 203 1.03 MB/sec warmup 78 sec latency 4671.038 ms 2024-05-04T00:47:20.313 INFO:tasks.workunit.client.0.smithi006.stdout: 10 206 1.02 MB/sec warmup 79 sec latency 2811.696 ms 2024-05-04T00:47:21.313 INFO:tasks.workunit.client.0.smithi006.stdout: 10 206 1.01 MB/sec warmup 80 sec latency 2753.369 ms 2024-05-04T00:47:21.484 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:47:21.487 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:47:22.314 INFO:tasks.workunit.client.0.smithi006.stdout: 10 207 1.00 MB/sec warmup 81 sec latency 3535.142 ms 2024-05-04T00:47:23.313 INFO:tasks.workunit.client.0.smithi006.stdout: 10 210 1.00 MB/sec warmup 82 sec latency 3889.655 ms 2024-05-04T00:47:24.314 INFO:tasks.workunit.client.0.smithi006.stdout: 10 214 1.00 MB/sec warmup 83 sec latency 3578.137 ms 2024-05-04T00:47:25.314 INFO:tasks.workunit.client.0.smithi006.stdout: 10 215 1.00 MB/sec warmup 84 sec latency 2748.106 ms 2024-05-04T00:47:26.314 INFO:tasks.workunit.client.0.smithi006.stdout: 10 218 1.00 MB/sec warmup 85 sec latency 2949.721 ms 2024-05-04T00:47:27.314 INFO:tasks.workunit.client.0.smithi006.stdout: 10 222 1.00 MB/sec warmup 86 sec latency 3039.752 ms 2024-05-04T00:47:28.314 INFO:tasks.workunit.client.0.smithi006.stdout: 10 224 1.00 MB/sec warmup 87 sec latency 2718.192 ms 2024-05-04T00:47:29.314 INFO:tasks.workunit.client.0.smithi006.stdout: 10 227 0.99 MB/sec warmup 88 sec latency 2397.064 ms 2024-05-04T00:47:30.314 INFO:tasks.workunit.client.0.smithi006.stdout: 10 230 1.00 MB/sec warmup 89 sec latency 3078.898 ms 2024-05-04T00:47:31.314 INFO:tasks.workunit.client.0.smithi006.stdout: 10 231 0.99 MB/sec warmup 90 sec latency 3010.016 ms 2024-05-04T00:47:32.314 INFO:tasks.workunit.client.0.smithi006.stdout: 10 231 0.98 MB/sec warmup 91 sec latency 3947.869 ms 2024-05-04T00:47:33.314 INFO:tasks.workunit.client.0.smithi006.stdout: 10 235 0.98 MB/sec warmup 92 sec latency 4102.381 ms 2024-05-04T00:47:34.314 INFO:tasks.workunit.client.0.smithi006.stdout: 10 239 0.98 MB/sec warmup 93 sec latency 3143.639 ms 2024-05-04T00:47:35.314 INFO:tasks.workunit.client.0.smithi006.stdout: 10 239 0.98 MB/sec warmup 94 sec latency 2596.583 ms 2024-05-04T00:47:36.314 INFO:tasks.workunit.client.0.smithi006.stdout: 10 239 0.97 MB/sec warmup 95 sec latency 3264.270 ms 2024-05-04T00:47:37.315 INFO:tasks.workunit.client.0.smithi006.stdout: 10 243 0.97 MB/sec warmup 96 sec latency 3963.589 ms 2024-05-04T00:47:38.315 INFO:tasks.workunit.client.0.smithi006.stdout: 10 245 0.96 MB/sec warmup 97 sec latency 4618.835 ms 2024-05-04T00:47:39.315 INFO:tasks.workunit.client.0.smithi006.stdout: 10 246 0.96 MB/sec warmup 98 sec latency 5483.290 ms 2024-05-04T00:47:40.315 INFO:tasks.workunit.client.0.smithi006.stdout: 10 246 0.95 MB/sec warmup 99 sec latency 6483.361 ms 2024-05-04T00:47:41.315 INFO:tasks.workunit.client.0.smithi006.stdout: 10 247 0.94 MB/sec warmup 100 sec latency 6509.471 ms 2024-05-04T00:47:42.315 INFO:tasks.workunit.client.0.smithi006.stdout: 10 249 0.94 MB/sec warmup 101 sec latency 5355.038 ms 2024-05-04T00:47:43.315 INFO:tasks.workunit.client.0.smithi006.stdout: 10 253 0.94 MB/sec warmup 102 sec latency 6095.524 ms 2024-05-04T00:47:44.315 INFO:tasks.workunit.client.0.smithi006.stdout: 10 254 0.94 MB/sec warmup 103 sec latency 6152.607 ms 2024-05-04T00:47:45.315 INFO:tasks.workunit.client.0.smithi006.stdout: 10 254 0.93 MB/sec warmup 104 sec latency 4881.862 ms 2024-05-04T00:47:46.315 INFO:tasks.workunit.client.0.smithi006.stdout: 10 255 0.92 MB/sec warmup 105 sec latency 5881.963 ms 2024-05-04T00:47:47.315 INFO:tasks.workunit.client.0.smithi006.stdout: 10 258 0.92 MB/sec warmup 106 sec latency 6213.231 ms 2024-05-04T00:47:48.316 INFO:tasks.workunit.client.0.smithi006.stdout: 10 261 0.92 MB/sec warmup 107 sec latency 5216.884 ms 2024-05-04T00:47:49.265 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:17:54.027 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:47:49.283 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:17:54.045 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:47:49.316 INFO:tasks.workunit.client.0.smithi006.stdout: 10 261 0.91 MB/sec warmup 108 sec latency 5830.339 ms 2024-05-04T00:47:49.359 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:17:54.121 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:47:49.421 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:17:54.133 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:47:49.424 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:17:54.136 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:47:49.425 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:17:54.137 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:47:49.428 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:17:54.140 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:47:49.469 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:17:54.181 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:47:49.480 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:17:54.191 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:47:50.316 INFO:tasks.workunit.client.0.smithi006.stdout: 10 263 0.91 MB/sec warmup 109 sec latency 6050.932 ms 2024-05-04T00:47:51.316 INFO:tasks.workunit.client.0.smithi006.stdout: 10 268 0.92 MB/sec warmup 110 sec latency 4501.108 ms 2024-05-04T00:47:51.528 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:47:51.531 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:47:52.316 INFO:tasks.workunit.client.0.smithi006.stdout: 10 270 0.92 MB/sec warmup 111 sec latency 2632.314 ms 2024-05-04T00:47:53.316 INFO:tasks.workunit.client.0.smithi006.stdout: 10 270 0.91 MB/sec warmup 112 sec latency 3592.603 ms 2024-05-04T00:47:54.316 INFO:tasks.workunit.client.0.smithi006.stdout: 10 276 0.91 MB/sec warmup 113 sec latency 2955.174 ms 2024-05-04T00:47:55.316 INFO:tasks.workunit.client.0.smithi006.stdout: 10 278 0.91 MB/sec warmup 114 sec latency 2862.154 ms 2024-05-04T00:47:56.316 INFO:tasks.workunit.client.0.smithi006.stdout: 10 279 0.91 MB/sec warmup 115 sec latency 2459.889 ms 2024-05-04T00:47:57.316 INFO:tasks.workunit.client.0.smithi006.stdout: 10 280 0.90 MB/sec warmup 116 sec latency 3459.951 ms 2024-05-04T00:47:58.316 INFO:tasks.workunit.client.0.smithi006.stdout: 10 282 0.90 MB/sec warmup 117 sec latency 4316.502 ms 2024-05-04T00:47:59.316 INFO:tasks.workunit.client.0.smithi006.stdout: 10 285 0.90 MB/sec warmup 118 sec latency 4666.357 ms 2024-05-04T00:48:00.316 INFO:tasks.workunit.client.0.smithi006.stdout: 10 287 0.90 MB/sec warmup 119 sec latency 5004.400 ms 2024-05-04T00:48:02.316 INFO:tasks.workunit.client.0.smithi006.stdout: 10 287 0.00 MB/sec execute 1 sec latency 3978.153 ms 2024-05-04T00:48:03.317 INFO:tasks.workunit.client.0.smithi006.stdout: 10 290 0.26 MB/sec execute 2 sec latency 4802.373 ms 2024-05-04T00:48:04.317 INFO:tasks.workunit.client.0.smithi006.stdout: 10 293 0.61 MB/sec execute 3 sec latency 3791.739 ms 2024-05-04T00:48:05.317 INFO:tasks.workunit.client.0.smithi006.stdout: 10 294 0.49 MB/sec execute 4 sec latency 1882.691 ms 2024-05-04T00:48:06.317 INFO:tasks.workunit.client.0.smithi006.stdout: 10 294 0.42 MB/sec execute 5 sec latency 2833.736 ms 2024-05-04T00:48:07.317 INFO:tasks.workunit.client.0.smithi006.stdout: 10 295 0.39 MB/sec execute 6 sec latency 3833.825 ms 2024-05-04T00:48:08.317 INFO:tasks.workunit.client.0.smithi006.stdout: 10 299 0.45 MB/sec execute 7 sec latency 4180.111 ms 2024-05-04T00:48:09.317 INFO:tasks.workunit.client.0.smithi006.stdout: 10 299 0.39 MB/sec execute 8 sec latency 3938.566 ms 2024-05-04T00:48:10.317 INFO:tasks.workunit.client.0.smithi006.stdout: 10 301 0.41 MB/sec execute 9 sec latency 4907.753 ms 2024-05-04T00:48:11.317 INFO:tasks.workunit.client.0.smithi006.stdout: 10 304 0.49 MB/sec execute 10 sec latency 3743.388 ms 2024-05-04T00:48:12.317 INFO:tasks.workunit.client.0.smithi006.stdout: 10 308 0.57 MB/sec execute 11 sec latency 3939.025 ms 2024-05-04T00:48:13.317 INFO:tasks.workunit.client.0.smithi006.stdout: 10 310 0.56 MB/sec execute 12 sec latency 2571.341 ms 2024-05-04T00:48:14.318 INFO:tasks.workunit.client.0.smithi006.stdout: 10 314 0.62 MB/sec execute 13 sec latency 2315.800 ms 2024-05-04T00:48:15.318 INFO:tasks.workunit.client.0.smithi006.stdout: 10 317 0.63 MB/sec execute 14 sec latency 2361.352 ms 2024-05-04T00:48:16.318 INFO:tasks.workunit.client.0.smithi006.stdout: 10 320 0.65 MB/sec execute 15 sec latency 2382.244 ms 2024-05-04T00:48:17.318 INFO:tasks.workunit.client.0.smithi006.stdout: 10 320 0.62 MB/sec execute 16 sec latency 3027.092 ms 2024-05-04T00:48:18.318 INFO:tasks.workunit.client.0.smithi006.stdout: 10 320 0.58 MB/sec execute 17 sec latency 4027.170 ms 2024-05-04T00:48:19.318 INFO:tasks.workunit.client.0.smithi006.stdout: 10 321 0.56 MB/sec execute 18 sec latency 4488.384 ms 2024-05-04T00:48:20.318 INFO:tasks.workunit.client.0.smithi006.stdout: 10 323 0.56 MB/sec execute 19 sec latency 5112.267 ms 2024-05-04T00:48:21.318 INFO:tasks.workunit.client.0.smithi006.stdout: 10 325 0.56 MB/sec execute 20 sec latency 5085.541 ms 2024-05-04T00:48:21.579 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:48:21.586 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:48:22.318 INFO:tasks.workunit.client.0.smithi006.stdout: 10 326 0.54 MB/sec execute 21 sec latency 2888.141 ms 2024-05-04T00:48:23.318 INFO:tasks.workunit.client.0.smithi006.stdout: 10 330 0.58 MB/sec execute 22 sec latency 2981.326 ms 2024-05-04T00:48:24.318 INFO:tasks.workunit.client.0.smithi006.stdout: 10 334 0.61 MB/sec execute 23 sec latency 2881.335 ms 2024-05-04T00:48:25.318 INFO:tasks.workunit.client.0.smithi006.stdout: 10 335 0.59 MB/sec execute 24 sec latency 2551.366 ms 2024-05-04T00:48:26.318 INFO:tasks.workunit.client.0.smithi006.stdout: 10 338 0.60 MB/sec execute 25 sec latency 2378.606 ms 2024-05-04T00:48:27.318 INFO:tasks.workunit.client.0.smithi006.stdout: 10 341 0.62 MB/sec execute 26 sec latency 2955.480 ms 2024-05-04T00:48:28.319 INFO:tasks.workunit.client.0.smithi006.stdout: 10 341 0.60 MB/sec execute 27 sec latency 2824.576 ms 2024-05-04T00:48:29.319 INFO:tasks.workunit.client.0.smithi006.stdout: 10 341 0.58 MB/sec execute 28 sec latency 3824.642 ms 2024-05-04T00:48:30.319 INFO:tasks.workunit.client.0.smithi006.stdout: 10 345 0.60 MB/sec execute 29 sec latency 4362.506 ms 2024-05-04T00:48:31.319 INFO:tasks.workunit.client.0.smithi006.stdout: 10 346 0.59 MB/sec execute 30 sec latency 4079.049 ms 2024-05-04T00:48:32.319 INFO:tasks.workunit.client.0.smithi006.stdout: 10 348 0.60 MB/sec execute 31 sec latency 5078.835 ms 2024-05-04T00:48:33.319 INFO:tasks.workunit.client.0.smithi006.stdout: 10 348 0.58 MB/sec execute 32 sec latency 5602.568 ms 2024-05-04T00:48:34.319 INFO:tasks.workunit.client.0.smithi006.stdout: 10 349 0.57 MB/sec execute 33 sec latency 4083.855 ms 2024-05-04T00:48:35.319 INFO:tasks.workunit.client.0.smithi006.stdout: 10 352 0.58 MB/sec execute 34 sec latency 5083.938 ms 2024-05-04T00:48:36.319 INFO:tasks.workunit.client.0.smithi006.stdout: 10 353 0.56 MB/sec execute 35 sec latency 5867.175 ms 2024-05-04T00:48:37.320 INFO:tasks.workunit.client.0.smithi006.stdout: 10 353 0.55 MB/sec execute 36 sec latency 4813.409 ms 2024-05-04T00:48:38.320 INFO:tasks.workunit.client.0.smithi006.stdout: 10 354 0.54 MB/sec execute 37 sec latency 3951.690 ms 2024-05-04T00:48:39.320 INFO:tasks.workunit.client.0.smithi006.stdout: 10 356 0.54 MB/sec execute 38 sec latency 4600.351 ms 2024-05-04T00:48:40.320 INFO:tasks.workunit.client.0.smithi006.stdout: 10 359 0.55 MB/sec execute 39 sec latency 4972.452 ms 2024-05-04T00:48:41.320 INFO:tasks.workunit.client.0.smithi006.stdout: 10 361 0.56 MB/sec execute 40 sec latency 5041.512 ms 2024-05-04T00:48:42.320 INFO:tasks.workunit.client.0.smithi006.stdout: 10 362 0.55 MB/sec execute 41 sec latency 4136.631 ms 2024-05-04T00:48:43.320 INFO:tasks.workunit.client.0.smithi006.stdout: 10 367 0.57 MB/sec execute 42 sec latency 3387.144 ms 2024-05-04T00:48:44.320 INFO:tasks.workunit.client.0.smithi006.stdout: 10 370 0.59 MB/sec execute 43 sec latency 2804.517 ms 2024-05-04T00:48:45.320 INFO:tasks.workunit.client.0.smithi006.stdout: 10 372 0.59 MB/sec execute 44 sec latency 2498.674 ms 2024-05-04T00:48:46.320 INFO:tasks.workunit.client.0.smithi006.stdout: 10 375 0.59 MB/sec execute 45 sec latency 3204.506 ms 2024-05-04T00:48:47.320 INFO:tasks.workunit.client.0.smithi006.stdout: 10 377 0.59 MB/sec execute 46 sec latency 3165.146 ms 2024-05-04T00:48:48.320 INFO:tasks.workunit.client.0.smithi006.stdout: 10 380 0.61 MB/sec execute 47 sec latency 3285.215 ms 2024-05-04T00:48:49.320 INFO:tasks.workunit.client.0.smithi006.stdout: 10 381 0.60 MB/sec execute 48 sec latency 2938.308 ms 2024-05-04T00:48:50.320 INFO:tasks.workunit.client.0.smithi006.stdout: 10 381 0.59 MB/sec execute 49 sec latency 3938.398 ms 2024-05-04T00:48:51.320 INFO:tasks.workunit.client.0.smithi006.stdout: 10 384 0.59 MB/sec execute 50 sec latency 4661.680 ms 2024-05-04T00:48:51.725 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:48:51.727 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:48:52.321 INFO:tasks.workunit.client.0.smithi006.stdout: 10 389 0.62 MB/sec execute 51 sec latency 4069.660 ms 2024-05-04T00:48:53.321 INFO:tasks.workunit.client.0.smithi006.stdout: 10 389 0.61 MB/sec execute 52 sec latency 2391.071 ms 2024-05-04T00:48:54.321 INFO:tasks.workunit.client.0.smithi006.stdout: 10 389 0.59 MB/sec execute 53 sec latency 3391.168 ms 2024-05-04T00:48:55.321 INFO:tasks.workunit.client.0.smithi006.stdout: 10 391 0.58 MB/sec execute 54 sec latency 4277.269 ms 2024-05-04T00:48:56.321 INFO:tasks.workunit.client.0.smithi006.stdout: 10 393 0.60 MB/sec execute 55 sec latency 4910.824 ms 2024-05-04T00:48:57.321 INFO:tasks.workunit.client.0.smithi006.stdout: 10 397 0.61 MB/sec execute 56 sec latency 5256.468 ms 2024-05-04T00:48:58.321 INFO:tasks.workunit.client.0.smithi006.stdout: 10 397 0.60 MB/sec execute 57 sec latency 2631.471 ms 2024-05-04T00:48:59.321 INFO:tasks.workunit.client.0.smithi006.stdout: 10 397 0.59 MB/sec execute 58 sec latency 3631.573 ms 2024-05-04T00:49:00.321 INFO:tasks.workunit.client.0.smithi006.stdout: 10 399 0.59 MB/sec execute 59 sec latency 4631.649 ms 2024-05-04T00:49:01.321 INFO:tasks.workunit.client.0.smithi006.stdout: 10 403 0.59 MB/sec execute 60 sec latency 4902.377 ms 2024-05-04T00:49:02.321 INFO:tasks.workunit.client.0.smithi006.stdout: 10 405 0.60 MB/sec execute 61 sec latency 5181.967 ms 2024-05-04T00:49:03.321 INFO:tasks.workunit.client.0.smithi006.stdout: 10 405 0.59 MB/sec execute 62 sec latency 3062.734 ms 2024-05-04T00:49:04.322 INFO:tasks.workunit.client.0.smithi006.stdout: 10 406 0.59 MB/sec execute 63 sec latency 3907.487 ms 2024-05-04T00:49:05.321 INFO:tasks.workunit.client.0.smithi006.stdout: 10 409 0.59 MB/sec execute 64 sec latency 4317.208 ms 2024-05-04T00:49:06.322 INFO:tasks.workunit.client.0.smithi006.stdout: 10 411 0.59 MB/sec execute 65 sec latency 5317.309 ms 2024-05-04T00:49:07.322 INFO:tasks.workunit.client.0.smithi006.stdout: 10 414 0.60 MB/sec execute 66 sec latency 5384.234 ms 2024-05-04T00:49:08.322 INFO:tasks.workunit.client.0.smithi006.stdout: 10 414 0.59 MB/sec execute 67 sec latency 3506.849 ms 2024-05-04T00:49:09.322 INFO:tasks.workunit.client.0.smithi006.stdout: 10 417 0.59 MB/sec execute 68 sec latency 4051.626 ms 2024-05-04T00:49:10.322 INFO:tasks.workunit.client.0.smithi006.stdout: 10 419 0.60 MB/sec execute 69 sec latency 3663.720 ms 2024-05-04T00:49:11.322 INFO:tasks.workunit.client.0.smithi006.stdout: 10 423 0.61 MB/sec execute 70 sec latency 3996.358 ms 2024-05-04T00:49:12.322 INFO:tasks.workunit.client.0.smithi006.stdout: 10 423 0.60 MB/sec execute 71 sec latency 2872.453 ms 2024-05-04T00:49:13.322 INFO:tasks.workunit.client.0.smithi006.stdout: 10 425 0.60 MB/sec execute 72 sec latency 3842.880 ms 2024-05-04T00:49:14.322 INFO:tasks.workunit.client.0.smithi006.stdout: 10 426 0.59 MB/sec execute 73 sec latency 4224.601 ms 2024-05-04T00:49:15.322 INFO:tasks.workunit.client.0.smithi006.stdout: 10 429 0.60 MB/sec execute 74 sec latency 4643.916 ms 2024-05-04T00:49:16.322 INFO:tasks.workunit.client.0.smithi006.stdout: 10 430 0.60 MB/sec execute 75 sec latency 5473.261 ms 2024-05-04T00:49:17.322 INFO:tasks.workunit.client.0.smithi006.stdout: 10 434 0.61 MB/sec execute 76 sec latency 5750.471 ms 2024-05-04T00:49:18.323 INFO:tasks.workunit.client.0.smithi006.stdout: 10 434 0.60 MB/sec execute 77 sec latency 3191.833 ms 2024-05-04T00:49:19.323 INFO:tasks.workunit.client.0.smithi006.stdout: 10 434 0.59 MB/sec execute 78 sec latency 4191.897 ms 2024-05-04T00:49:20.323 INFO:tasks.workunit.client.0.smithi006.stdout: 10 437 0.59 MB/sec execute 79 sec latency 5130.367 ms 2024-05-04T00:49:21.323 INFO:tasks.workunit.client.0.smithi006.stdout: 10 438 0.59 MB/sec execute 80 sec latency 5112.818 ms 2024-05-04T00:49:21.765 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:49:21.768 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:49:22.323 INFO:tasks.workunit.client.0.smithi006.stdout: 10 441 0.60 MB/sec execute 81 sec latency 5187.562 ms 2024-05-04T00:49:23.323 INFO:tasks.workunit.client.0.smithi006.stdout: 10 444 0.60 MB/sec execute 82 sec latency 5091.200 ms 2024-05-04T00:49:24.323 INFO:tasks.workunit.client.0.smithi006.stdout: 10 444 0.59 MB/sec execute 83 sec latency 4165.699 ms 2024-05-04T00:49:25.323 INFO:tasks.workunit.client.0.smithi006.stdout: 10 445 0.59 MB/sec execute 84 sec latency 4460.903 ms 2024-05-04T00:49:26.323 INFO:tasks.workunit.client.0.smithi006.stdout: 10 448 0.59 MB/sec execute 85 sec latency 5030.464 ms 2024-05-04T00:49:27.323 INFO:tasks.workunit.client.0.smithi006.stdout: 10 451 0.60 MB/sec execute 86 sec latency 4795.162 ms 2024-05-04T00:49:28.323 INFO:tasks.workunit.client.0.smithi006.stdout: 10 453 0.60 MB/sec execute 87 sec latency 4864.743 ms 2024-05-04T00:49:29.324 INFO:tasks.workunit.client.0.smithi006.stdout: 10 453 0.59 MB/sec execute 88 sec latency 4450.158 ms 2024-05-04T00:49:30.324 INFO:tasks.workunit.client.0.smithi006.stdout: 10 456 0.59 MB/sec execute 89 sec latency 3937.849 ms 2024-05-04T00:49:31.324 INFO:tasks.workunit.client.0.smithi006.stdout: 10 460 0.60 MB/sec execute 90 sec latency 3832.099 ms 2024-05-04T00:49:32.324 INFO:tasks.workunit.client.0.smithi006.stdout: 10 461 0.60 MB/sec execute 91 sec latency 3873.852 ms 2024-05-04T00:49:33.329 INFO:tasks.workunit.client.0.smithi006.stdout: 10 462 0.60 MB/sec execute 92 sec latency 3384.395 ms 2024-05-04T00:49:34.324 INFO:tasks.workunit.client.0.smithi006.stdout: 10 462 0.59 MB/sec execute 93 sec latency 4384.458 ms 2024-05-04T00:49:35.324 INFO:tasks.workunit.client.0.smithi006.stdout: 10 466 0.60 MB/sec execute 94 sec latency 4448.830 ms 2024-05-04T00:49:36.324 INFO:tasks.workunit.client.0.smithi006.stdout: 10 469 0.60 MB/sec execute 95 sec latency 4838.248 ms 2024-05-04T00:49:37.324 INFO:tasks.workunit.client.0.smithi006.stdout: 10 470 0.60 MB/sec execute 96 sec latency 3614.716 ms 2024-05-04T00:49:38.324 INFO:tasks.workunit.client.0.smithi006.stdout: 10 472 0.60 MB/sec execute 97 sec latency 3504.896 ms 2024-05-04T00:49:39.324 INFO:tasks.workunit.client.0.smithi006.stdout: 10 472 0.60 MB/sec execute 98 sec latency 4418.651 ms 2024-05-04T00:49:40.324 INFO:tasks.workunit.client.0.smithi006.stdout: 10 476 0.60 MB/sec execute 99 sec latency 4606.790 ms 2024-05-04T00:49:41.324 INFO:tasks.workunit.client.0.smithi006.stdout: 10 483 0.62 MB/sec execute 100 sec latency 4134.566 ms 2024-05-04T00:49:42.325 INFO:tasks.workunit.client.0.smithi006.stdout: 10 485 0.62 MB/sec execute 101 sec latency 2514.051 ms 2024-05-04T00:49:43.325 INFO:tasks.workunit.client.0.smithi006.stdout: 10 488 0.63 MB/sec execute 102 sec latency 3097.473 ms 2024-05-04T00:49:44.325 INFO:tasks.workunit.client.0.smithi006.stdout: 10 488 0.62 MB/sec execute 103 sec latency 3863.830 ms 2024-05-04T00:49:45.326 INFO:tasks.workunit.client.0.smithi006.stdout: 10 492 0.62 MB/sec execute 104 sec latency 4324.980 ms 2024-05-04T00:49:46.325 INFO:tasks.workunit.client.0.smithi006.stdout: 10 493 0.62 MB/sec execute 105 sec latency 4557.561 ms 2024-05-04T00:49:47.326 INFO:tasks.workunit.client.0.smithi006.stdout: 10 496 0.62 MB/sec execute 106 sec latency 5557.663 ms 2024-05-04T00:49:48.325 INFO:tasks.workunit.client.0.smithi006.stdout: 10 496 0.62 MB/sec execute 107 sec latency 6557.752 ms 2024-05-04T00:49:49.325 INFO:tasks.workunit.client.0.smithi006.stdout: 10 497 0.62 MB/sec execute 108 sec latency 7557.828 ms 2024-05-04T00:49:50.325 INFO:tasks.workunit.client.0.smithi006.stdout: 10 499 0.62 MB/sec execute 109 sec latency 8557.952 ms 2024-05-04T00:49:51.325 INFO:tasks.workunit.client.0.smithi006.stdout: 10 501 0.62 MB/sec execute 110 sec latency 9558.012 ms 2024-05-04T00:49:51.820 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:49:51.823 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:49:52.326 INFO:tasks.workunit.client.0.smithi006.stdout: 10 501 0.61 MB/sec execute 111 sec latency 10558.089 ms 2024-05-04T00:49:53.326 INFO:tasks.workunit.client.0.smithi006.stdout: 10 501 0.61 MB/sec execute 112 sec latency 11456.503 ms 2024-05-04T00:49:54.326 INFO:tasks.workunit.client.0.smithi006.stdout: 10 506 0.61 MB/sec execute 113 sec latency 6263.510 ms 2024-05-04T00:49:55.326 INFO:tasks.workunit.client.0.smithi006.stdout: 10 507 0.61 MB/sec execute 114 sec latency 5165.420 ms 2024-05-04T00:49:56.326 INFO:tasks.workunit.client.0.smithi006.stdout: 10 508 0.61 MB/sec execute 115 sec latency 4598.003 ms 2024-05-04T00:49:57.326 INFO:tasks.workunit.client.0.smithi006.stdout: 10 509 0.60 MB/sec execute 116 sec latency 3765.347 ms 2024-05-04T00:49:58.326 INFO:tasks.workunit.client.0.smithi006.stdout: 10 511 0.60 MB/sec execute 117 sec latency 4509.294 ms 2024-05-04T00:49:59.326 INFO:tasks.workunit.client.0.smithi006.stdout: 10 513 0.60 MB/sec execute 118 sec latency 4303.948 ms 2024-05-04T00:50:00.326 INFO:tasks.workunit.client.0.smithi006.stdout: 10 513 0.60 MB/sec execute 119 sec latency 4151.050 ms 2024-05-04T00:50:01.326 INFO:tasks.workunit.client.0.smithi006.stdout: 10 513 0.59 MB/sec execute 120 sec latency 4670.229 ms 2024-05-04T00:50:02.326 INFO:tasks.workunit.client.0.smithi006.stdout: 10 515 0.59 MB/sec execute 121 sec latency 5670.331 ms 2024-05-04T00:50:03.326 INFO:tasks.workunit.client.0.smithi006.stdout: 10 519 0.60 MB/sec execute 122 sec latency 6670.381 ms 2024-05-04T00:50:04.326 INFO:tasks.workunit.client.0.smithi006.stdout: 10 519 0.59 MB/sec execute 123 sec latency 7670.470 ms 2024-05-04T00:50:05.327 INFO:tasks.workunit.client.0.smithi006.stdout: 10 522 0.60 MB/sec execute 124 sec latency 8670.550 ms 2024-05-04T00:50:06.327 INFO:tasks.workunit.client.0.smithi006.stdout: 10 524 0.60 MB/sec execute 125 sec latency 8712.033 ms 2024-05-04T00:50:07.330 INFO:tasks.workunit.client.0.smithi006.stdout: 10 526 0.60 MB/sec execute 126 sec latency 3600.592 ms 2024-05-04T00:50:08.327 INFO:tasks.workunit.client.0.smithi006.stdout: 10 531 0.60 MB/sec execute 127 sec latency 2741.526 ms 2024-05-04T00:50:09.327 INFO:tasks.workunit.client.0.smithi006.stdout: 10 537 0.62 MB/sec execute 128 sec latency 3543.246 ms 2024-05-04T00:50:10.328 INFO:tasks.workunit.client.0.smithi006.stdout: 10 542 0.63 MB/sec execute 129 sec latency 4543.312 ms 2024-05-04T00:50:11.327 INFO:tasks.workunit.client.0.smithi006.stdout: 10 544 0.63 MB/sec execute 130 sec latency 5543.390 ms 2024-05-04T00:50:12.327 INFO:tasks.workunit.client.0.smithi006.stdout: 10 552 0.65 MB/sec execute 131 sec latency 6543.480 ms 2024-05-04T00:50:13.327 INFO:tasks.workunit.client.0.smithi006.stdout: 10 559 0.65 MB/sec execute 132 sec latency 7539.714 ms 2024-05-04T00:50:14.327 INFO:tasks.workunit.client.0.smithi006.stdout: 10 568 0.67 MB/sec execute 133 sec latency 5123.651 ms 2024-05-04T00:50:15.327 INFO:tasks.workunit.client.0.smithi006.stdout: 10 573 0.68 MB/sec execute 134 sec latency 5972.544 ms 2024-05-04T00:50:16.328 INFO:tasks.workunit.client.0.smithi006.stdout: 10 578 0.68 MB/sec execute 135 sec latency 3985.498 ms 2024-05-04T00:50:17.328 INFO:tasks.workunit.client.0.smithi006.stdout: 10 582 0.69 MB/sec execute 136 sec latency 4985.544 ms 2024-05-04T00:50:18.328 INFO:tasks.workunit.client.0.smithi006.stdout: 10 585 0.69 MB/sec execute 137 sec latency 5985.618 ms 2024-05-04T00:50:19.328 INFO:tasks.workunit.client.0.smithi006.stdout: 10 585 0.69 MB/sec execute 138 sec latency 6042.231 ms 2024-05-04T00:50:20.328 INFO:tasks.workunit.client.0.smithi006.stdout: 10 589 0.70 MB/sec execute 139 sec latency 5332.318 ms 2024-05-04T00:50:21.328 INFO:tasks.workunit.client.0.smithi006.stdout: 10 594 0.70 MB/sec execute 140 sec latency 6060.476 ms 2024-05-04T00:50:21.875 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:50:21.878 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:50:22.328 INFO:tasks.workunit.client.0.smithi006.stdout: 10 597 0.70 MB/sec execute 141 sec latency 6823.849 ms 2024-05-04T00:50:23.328 INFO:tasks.workunit.client.0.smithi006.stdout: 10 605 0.70 MB/sec execute 142 sec latency 6877.893 ms 2024-05-04T00:50:24.328 INFO:tasks.workunit.client.0.smithi006.stdout: 10 610 0.72 MB/sec execute 143 sec latency 6551.160 ms 2024-05-04T00:50:25.328 INFO:tasks.workunit.client.0.smithi006.stdout: 10 611 0.71 MB/sec execute 144 sec latency 7505.321 ms 2024-05-04T00:50:26.329 INFO:tasks.workunit.client.0.smithi006.stdout: 10 611 0.71 MB/sec execute 145 sec latency 5315.679 ms 2024-05-04T00:50:27.256 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:20:32.017 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:50:27.260 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:20:32.022 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:50:27.328 INFO:tasks.workunit.client.0.smithi006.stdout: 10 612 0.70 MB/sec execute 146 sec latency 5812.671 ms 2024-05-04T00:50:27.394 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:20:32.156 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:50:27.397 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:20:32.108 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:50:27.398 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:20:32.109 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:50:27.402 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:20:32.113 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:50:27.409 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:20:32.120 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:50:27.510 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:20:32.221 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:50:27.514 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:20:32.224 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:50:28.329 INFO:tasks.workunit.client.0.smithi006.stdout: 10 612 0.70 MB/sec execute 147 sec latency 5946.514 ms 2024-05-04T00:50:29.328 INFO:tasks.workunit.client.0.smithi006.stdout: 10 613 0.69 MB/sec execute 148 sec latency 6831.045 ms 2024-05-04T00:50:30.329 INFO:tasks.workunit.client.0.smithi006.stdout: 10 614 0.69 MB/sec execute 149 sec latency 5962.788 ms 2024-05-04T00:50:31.329 INFO:tasks.workunit.client.0.smithi006.stdout: 10 618 0.69 MB/sec execute 150 sec latency 5742.305 ms 2024-05-04T00:50:32.329 INFO:tasks.workunit.client.0.smithi006.stdout: 10 619 0.68 MB/sec execute 151 sec latency 5196.774 ms 2024-05-04T00:50:33.343 INFO:tasks.workunit.client.0.smithi006.stdout: 10 619 0.68 MB/sec execute 152 sec latency 6035.160 ms 2024-05-04T00:50:34.329 INFO:tasks.workunit.client.0.smithi006.stdout: 10 622 0.67 MB/sec execute 153 sec latency 5107.001 ms 2024-05-04T00:50:35.329 INFO:tasks.workunit.client.0.smithi006.stdout: 10 625 0.67 MB/sec execute 154 sec latency 5032.859 ms 2024-05-04T00:50:36.329 INFO:tasks.workunit.client.0.smithi006.stdout: 10 625 0.66 MB/sec execute 155 sec latency 5580.918 ms 2024-05-04T00:50:37.329 INFO:tasks.workunit.client.0.smithi006.stdout: 10 631 0.66 MB/sec execute 156 sec latency 5970.165 ms 2024-05-04T00:50:38.329 INFO:tasks.workunit.client.0.smithi006.stdout: 10 635 0.66 MB/sec execute 157 sec latency 3917.165 ms 2024-05-04T00:50:39.329 INFO:tasks.workunit.client.0.smithi006.stdout: 10 636 0.65 MB/sec execute 158 sec latency 4553.798 ms 2024-05-04T00:50:40.329 INFO:tasks.workunit.client.0.smithi006.stdout: 10 636 0.65 MB/sec execute 159 sec latency 5553.854 ms 2024-05-04T00:50:41.330 INFO:tasks.workunit.client.0.smithi006.stdout: 10 639 0.65 MB/sec execute 160 sec latency 6120.679 ms 2024-05-04T00:50:42.330 INFO:tasks.workunit.client.0.smithi006.stdout: 10 640 0.64 MB/sec execute 161 sec latency 5219.482 ms 2024-05-04T00:50:43.330 INFO:tasks.workunit.client.0.smithi006.stdout: 10 641 0.64 MB/sec execute 162 sec latency 6219.557 ms 2024-05-04T00:50:44.330 INFO:tasks.workunit.client.0.smithi006.stdout: 10 641 0.64 MB/sec execute 163 sec latency 7219.639 ms 2024-05-04T00:50:45.330 INFO:tasks.workunit.client.0.smithi006.stdout: 10 643 0.63 MB/sec execute 164 sec latency 7425.819 ms 2024-05-04T00:50:46.330 INFO:tasks.workunit.client.0.smithi006.stdout: 10 648 0.63 MB/sec execute 165 sec latency 6658.360 ms 2024-05-04T00:50:47.330 INFO:tasks.workunit.client.0.smithi006.stdout: 10 649 0.62 MB/sec execute 166 sec latency 4612.258 ms 2024-05-04T00:50:48.330 INFO:tasks.workunit.client.0.smithi006.stdout: 10 650 0.62 MB/sec execute 167 sec latency 3743.650 ms 2024-05-04T00:50:49.330 INFO:tasks.workunit.client.0.smithi006.stdout: 10 650 0.62 MB/sec execute 168 sec latency 4134.780 ms 2024-05-04T00:50:50.330 INFO:tasks.workunit.client.0.smithi006.stdout: 10 650 0.61 MB/sec execute 169 sec latency 5134.876 ms 2024-05-04T00:50:51.330 INFO:tasks.workunit.client.0.smithi006.stdout: 10 650 0.61 MB/sec execute 170 sec latency 6134.939 ms 2024-05-04T00:50:51.947 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:50:51.950 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:50:52.330 INFO:tasks.workunit.client.0.smithi006.stdout: 10 651 0.61 MB/sec execute 171 sec latency 7055.404 ms 2024-05-04T00:50:53.331 INFO:tasks.workunit.client.0.smithi006.stdout: 10 652 0.60 MB/sec execute 172 sec latency 6269.426 ms 2024-05-04T00:50:54.331 INFO:tasks.workunit.client.0.smithi006.stdout: 10 653 0.60 MB/sec execute 173 sec latency 6649.896 ms 2024-05-04T00:50:55.331 INFO:tasks.workunit.client.0.smithi006.stdout: 10 655 0.60 MB/sec execute 174 sec latency 7260.808 ms 2024-05-04T00:50:56.331 INFO:tasks.workunit.client.0.smithi006.stdout: 10 656 0.59 MB/sec execute 175 sec latency 4413.790 ms 2024-05-04T00:50:57.331 INFO:tasks.workunit.client.0.smithi006.stdout: 10 656 0.59 MB/sec execute 176 sec latency 3053.017 ms 2024-05-04T00:50:58.331 INFO:tasks.workunit.client.0.smithi006.stdout: 10 657 0.59 MB/sec execute 177 sec latency 4053.109 ms 2024-05-04T00:50:59.331 INFO:tasks.workunit.client.0.smithi006.stdout: 10 660 0.58 MB/sec execute 178 sec latency 4539.140 ms 2024-05-04T00:51:00.331 INFO:tasks.workunit.client.0.smithi006.stdout: 10 660 0.58 MB/sec execute 179 sec latency 5259.641 ms 2024-05-04T00:51:01.331 INFO:tasks.workunit.client.0.smithi006.stdout: 10 661 0.58 MB/sec execute 180 sec latency 6259.741 ms 2024-05-04T00:51:02.331 INFO:tasks.workunit.client.0.smithi006.stdout: 10 661 0.57 MB/sec execute 181 sec latency 7259.836 ms 2024-05-04T00:51:03.331 INFO:tasks.workunit.client.0.smithi006.stdout: 10 662 0.57 MB/sec execute 182 sec latency 8259.930 ms 2024-05-04T00:51:04.332 INFO:tasks.workunit.client.0.smithi006.stdout: 10 663 0.57 MB/sec execute 183 sec latency 9260.028 ms 2024-05-04T00:51:05.332 INFO:tasks.workunit.client.0.smithi006.stdout: 10 666 0.57 MB/sec execute 184 sec latency 9660.807 ms 2024-05-04T00:51:06.332 INFO:tasks.workunit.client.0.smithi006.stdout: 10 668 0.56 MB/sec execute 185 sec latency 9086.502 ms 2024-05-04T00:51:07.332 INFO:tasks.workunit.client.0.smithi006.stdout: 10 670 0.56 MB/sec execute 186 sec latency 2488.885 ms 2024-05-04T00:51:08.332 INFO:tasks.workunit.client.0.smithi006.stdout: 10 671 0.56 MB/sec execute 187 sec latency 3488.946 ms 2024-05-04T00:51:09.332 INFO:tasks.workunit.client.0.smithi006.stdout: 10 674 0.56 MB/sec execute 188 sec latency 4489.040 ms 2024-05-04T00:51:10.332 INFO:tasks.workunit.client.0.smithi006.stdout: 10 675 0.55 MB/sec execute 189 sec latency 5489.144 ms 2024-05-04T00:51:11.332 INFO:tasks.workunit.client.0.smithi006.stdout: 10 675 0.55 MB/sec execute 190 sec latency 6489.254 ms 2024-05-04T00:51:12.332 INFO:tasks.workunit.client.0.smithi006.stdout: 10 677 0.55 MB/sec execute 191 sec latency 6943.411 ms 2024-05-04T00:51:13.332 INFO:tasks.workunit.client.0.smithi006.stdout: 10 679 0.55 MB/sec execute 192 sec latency 7462.095 ms 2024-05-04T00:51:14.332 INFO:tasks.workunit.client.0.smithi006.stdout: 10 681 0.54 MB/sec execute 193 sec latency 7595.508 ms 2024-05-04T00:51:15.333 INFO:tasks.workunit.client.0.smithi006.stdout: 10 681 0.54 MB/sec execute 194 sec latency 8060.303 ms 2024-05-04T00:51:16.334 INFO:tasks.workunit.client.0.smithi006.stdout: 10 682 0.54 MB/sec execute 195 sec latency 7784.131 ms 2024-05-04T00:51:17.333 INFO:tasks.workunit.client.0.smithi006.stdout: 10 683 0.53 MB/sec execute 196 sec latency 4927.233 ms 2024-05-04T00:51:18.333 INFO:tasks.workunit.client.0.smithi006.stdout: 10 686 0.53 MB/sec execute 197 sec latency 4828.260 ms 2024-05-04T00:51:19.333 INFO:tasks.workunit.client.0.smithi006.stdout: 10 688 0.53 MB/sec execute 198 sec latency 5751.813 ms 2024-05-04T00:51:20.333 INFO:tasks.workunit.client.0.smithi006.stdout: 10 689 0.53 MB/sec execute 199 sec latency 6751.895 ms 2024-05-04T00:51:21.333 INFO:tasks.workunit.client.0.smithi006.stdout: 10 691 0.52 MB/sec execute 200 sec latency 7703.524 ms 2024-05-04T00:51:22.047 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:51:22.050 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:51:22.333 INFO:tasks.workunit.client.0.smithi006.stdout: 10 694 0.52 MB/sec execute 201 sec latency 6424.327 ms 2024-05-04T00:51:23.333 INFO:tasks.workunit.client.0.smithi006.stdout: 10 696 0.52 MB/sec execute 202 sec latency 2011.429 ms 2024-05-04T00:51:24.333 INFO:tasks.workunit.client.0.smithi006.stdout: 10 697 0.52 MB/sec execute 203 sec latency 3011.522 ms 2024-05-04T00:51:25.333 INFO:tasks.workunit.client.0.smithi006.stdout: 10 697 0.51 MB/sec execute 204 sec latency 4011.580 ms 2024-05-04T00:51:26.333 INFO:tasks.workunit.client.0.smithi006.stdout: 10 698 0.51 MB/sec execute 205 sec latency 5011.653 ms 2024-05-04T00:51:27.333 INFO:tasks.workunit.client.0.smithi006.stdout: 10 700 0.51 MB/sec execute 206 sec latency 6011.715 ms 2024-05-04T00:51:28.333 INFO:tasks.workunit.client.0.smithi006.stdout: 10 703 0.51 MB/sec execute 207 sec latency 6234.233 ms 2024-05-04T00:51:29.334 INFO:tasks.workunit.client.0.smithi006.stdout: 10 707 0.51 MB/sec execute 208 sec latency 6766.082 ms 2024-05-04T00:51:30.334 INFO:tasks.workunit.client.0.smithi006.stdout: 10 709 0.50 MB/sec execute 209 sec latency 7718.055 ms 2024-05-04T00:51:31.334 INFO:tasks.workunit.client.0.smithi006.stdout: 10 711 0.50 MB/sec execute 210 sec latency 8211.612 ms 2024-05-04T00:51:32.334 INFO:tasks.workunit.client.0.smithi006.stdout: 10 713 0.50 MB/sec execute 211 sec latency 3222.675 ms 2024-05-04T00:51:33.334 INFO:tasks.workunit.client.0.smithi006.stdout: 10 715 0.50 MB/sec execute 212 sec latency 4222.749 ms 2024-05-04T00:51:34.334 INFO:tasks.workunit.client.0.smithi006.stdout: 10 716 0.49 MB/sec execute 213 sec latency 5222.840 ms 2024-05-04T00:51:35.334 INFO:tasks.workunit.client.0.smithi006.stdout: 10 717 0.49 MB/sec execute 214 sec latency 6222.920 ms 2024-05-04T00:51:36.334 INFO:tasks.workunit.client.0.smithi006.stdout: 10 719 0.49 MB/sec execute 215 sec latency 7223.013 ms 2024-05-04T00:51:37.334 INFO:tasks.workunit.client.0.smithi006.stdout: 10 720 0.49 MB/sec execute 216 sec latency 8223.065 ms 2024-05-04T00:51:38.334 INFO:tasks.workunit.client.0.smithi006.stdout: 10 721 0.49 MB/sec execute 217 sec latency 9223.149 ms 2024-05-04T00:51:39.334 INFO:tasks.workunit.client.0.smithi006.stdout: 10 722 0.48 MB/sec execute 218 sec latency 10223.226 ms 2024-05-04T00:51:40.335 INFO:tasks.workunit.client.0.smithi006.stdout: 10 723 0.48 MB/sec execute 219 sec latency 11223.321 ms 2024-05-04T00:51:41.334 INFO:tasks.workunit.client.0.smithi006.stdout: 10 723 0.48 MB/sec execute 220 sec latency 12223.411 ms 2024-05-04T00:51:42.335 INFO:tasks.workunit.client.0.smithi006.stdout: 10 724 0.48 MB/sec execute 221 sec latency 13223.509 ms 2024-05-04T00:51:43.335 INFO:tasks.workunit.client.0.smithi006.stdout: 10 727 0.48 MB/sec execute 222 sec latency 13358.433 ms 2024-05-04T00:51:44.335 INFO:tasks.workunit.client.0.smithi006.stdout: 10 730 0.47 MB/sec execute 223 sec latency 13364.151 ms 2024-05-04T00:51:45.335 INFO:tasks.workunit.client.0.smithi006.stdout: 10 732 0.47 MB/sec execute 224 sec latency 7489.369 ms 2024-05-04T00:51:46.335 INFO:tasks.workunit.client.0.smithi006.stdout: 10 735 0.47 MB/sec execute 225 sec latency 8489.474 ms 2024-05-04T00:51:47.335 INFO:tasks.workunit.client.0.smithi006.stdout: 10 737 0.47 MB/sec execute 226 sec latency 9489.548 ms 2024-05-04T00:51:48.335 INFO:tasks.workunit.client.0.smithi006.stdout: 10 739 0.47 MB/sec execute 227 sec latency 10247.489 ms 2024-05-04T00:51:49.335 INFO:tasks.workunit.client.0.smithi006.stdout: 10 741 0.47 MB/sec execute 228 sec latency 9606.246 ms 2024-05-04T00:51:50.336 INFO:tasks.workunit.client.0.smithi006.stdout: 10 743 0.46 MB/sec execute 229 sec latency 7538.165 ms 2024-05-04T00:51:51.335 INFO:tasks.workunit.client.0.smithi006.stdout: 10 743 0.46 MB/sec execute 230 sec latency 6060.007 ms 2024-05-04T00:51:52.110 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:51:52.113 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:51:52.335 INFO:tasks.workunit.client.0.smithi006.stdout: 10 744 0.46 MB/sec execute 231 sec latency 7060.072 ms 2024-05-04T00:51:53.336 INFO:tasks.workunit.client.0.smithi006.stdout: 10 745 0.46 MB/sec execute 232 sec latency 7100.106 ms 2024-05-04T00:51:54.336 INFO:tasks.workunit.client.0.smithi006.stdout: 10 746 0.46 MB/sec execute 233 sec latency 6160.497 ms 2024-05-04T00:51:55.336 INFO:tasks.workunit.client.0.smithi006.stdout: 10 746 0.45 MB/sec execute 234 sec latency 7160.562 ms 2024-05-04T00:51:56.336 INFO:tasks.workunit.client.0.smithi006.stdout: 10 747 0.45 MB/sec execute 235 sec latency 7898.172 ms 2024-05-04T00:51:57.336 INFO:tasks.workunit.client.0.smithi006.stdout: 10 750 0.45 MB/sec execute 236 sec latency 8519.994 ms 2024-05-04T00:51:58.336 INFO:tasks.workunit.client.0.smithi006.stdout: 10 753 0.45 MB/sec execute 237 sec latency 8765.779 ms 2024-05-04T00:51:59.336 INFO:tasks.workunit.client.0.smithi006.stdout: 10 757 0.45 MB/sec execute 238 sec latency 8582.574 ms 2024-05-04T00:52:00.336 INFO:tasks.workunit.client.0.smithi006.stdout: 10 760 0.45 MB/sec execute 239 sec latency 7066.754 ms 2024-05-04T00:52:01.336 INFO:tasks.workunit.client.0.smithi006.stdout: 10 762 0.44 MB/sec execute 240 sec latency 2576.347 ms 2024-05-04T00:52:02.336 INFO:tasks.workunit.client.0.smithi006.stdout: 10 762 0.44 MB/sec execute 241 sec latency 3576.424 ms 2024-05-04T00:52:03.336 INFO:tasks.workunit.client.0.smithi006.stdout: 10 764 0.44 MB/sec execute 242 sec latency 4576.521 ms 2024-05-04T00:52:04.336 INFO:tasks.workunit.client.0.smithi006.stdout: 10 765 0.44 MB/sec execute 243 sec latency 5576.616 ms 2024-05-04T00:52:05.336 INFO:tasks.workunit.client.0.smithi006.stdout: 10 765 0.44 MB/sec execute 244 sec latency 6576.691 ms 2024-05-04T00:52:06.336 INFO:tasks.workunit.client.0.smithi006.stdout: 10 765 0.43 MB/sec execute 245 sec latency 7379.653 ms 2024-05-04T00:52:07.336 INFO:tasks.workunit.client.0.smithi006.stdout: 10 768 0.43 MB/sec execute 246 sec latency 8099.398 ms 2024-05-04T00:52:08.337 INFO:tasks.workunit.client.0.smithi006.stdout: 10 773 0.43 MB/sec execute 247 sec latency 8398.854 ms 2024-05-04T00:52:09.337 INFO:tasks.workunit.client.0.smithi006.stdout: 10 774 0.43 MB/sec execute 248 sec latency 8277.626 ms 2024-05-04T00:52:10.337 INFO:tasks.workunit.client.0.smithi006.stdout: 10 777 0.43 MB/sec execute 249 sec latency 8039.205 ms 2024-05-04T00:52:11.337 INFO:tasks.workunit.client.0.smithi006.stdout: 10 777 0.43 MB/sec execute 250 sec latency 8378.529 ms 2024-05-04T00:52:12.337 INFO:tasks.workunit.client.0.smithi006.stdout: 10 781 0.43 MB/sec execute 251 sec latency 4303.867 ms 2024-05-04T00:52:13.337 INFO:tasks.workunit.client.0.smithi006.stdout: 10 782 0.42 MB/sec execute 252 sec latency 5303.965 ms 2024-05-04T00:52:14.337 INFO:tasks.workunit.client.0.smithi006.stdout: 10 784 0.42 MB/sec execute 253 sec latency 6304.044 ms 2024-05-04T00:52:15.337 INFO:tasks.workunit.client.0.smithi006.stdout: 10 785 0.42 MB/sec execute 254 sec latency 7304.129 ms 2024-05-04T00:52:16.338 INFO:tasks.workunit.client.0.smithi006.stdout: 10 787 0.42 MB/sec execute 255 sec latency 8304.423 ms 2024-05-04T00:52:17.338 INFO:tasks.workunit.client.0.smithi006.stdout: 10 788 0.42 MB/sec execute 256 sec latency 8598.832 ms 2024-05-04T00:52:18.338 INFO:tasks.workunit.client.0.smithi006.stdout: 10 790 0.42 MB/sec execute 257 sec latency 8801.859 ms 2024-05-04T00:52:19.338 INFO:tasks.workunit.client.0.smithi006.stdout: 10 794 0.42 MB/sec execute 258 sec latency 5695.560 ms 2024-05-04T00:52:20.338 INFO:tasks.workunit.client.0.smithi006.stdout: 10 797 0.41 MB/sec execute 259 sec latency 6397.622 ms 2024-05-04T00:52:21.338 INFO:tasks.workunit.client.0.smithi006.stdout: 10 797 0.41 MB/sec execute 260 sec latency 4102.842 ms 2024-05-04T00:52:22.233 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:52:22.241 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:52:22.338 INFO:tasks.workunit.client.0.smithi006.stdout: 10 798 0.41 MB/sec execute 261 sec latency 5102.928 ms 2024-05-04T00:52:23.338 INFO:tasks.workunit.client.0.smithi006.stdout: 10 799 0.41 MB/sec execute 262 sec latency 6102.998 ms 2024-05-04T00:52:24.338 INFO:tasks.workunit.client.0.smithi006.stdout: 10 801 0.41 MB/sec execute 263 sec latency 7103.076 ms 2024-05-04T00:52:25.338 INFO:tasks.workunit.client.0.smithi006.stdout: 10 803 0.41 MB/sec execute 264 sec latency 8103.169 ms 2024-05-04T00:52:26.338 INFO:tasks.workunit.client.0.smithi006.stdout: 10 805 0.41 MB/sec execute 265 sec latency 8923.603 ms 2024-05-04T00:52:27.338 INFO:tasks.workunit.client.0.smithi006.stdout: 10 808 0.40 MB/sec execute 266 sec latency 7471.946 ms 2024-05-04T00:52:28.338 INFO:tasks.workunit.client.0.smithi006.stdout: 10 809 0.40 MB/sec execute 267 sec latency 8472.006 ms 2024-05-04T00:52:29.339 INFO:tasks.workunit.client.0.smithi006.stdout: 10 810 0.40 MB/sec execute 268 sec latency 9029.459 ms 2024-05-04T00:52:30.339 INFO:tasks.workunit.client.0.smithi006.stdout: 10 811 0.40 MB/sec execute 269 sec latency 4440.626 ms 2024-05-04T00:52:31.339 INFO:tasks.workunit.client.0.smithi006.stdout: 10 812 0.40 MB/sec execute 270 sec latency 5440.695 ms 2024-05-04T00:52:32.339 INFO:tasks.workunit.client.0.smithi006.stdout: 10 813 0.40 MB/sec execute 271 sec latency 6440.764 ms 2024-05-04T00:52:33.339 INFO:tasks.workunit.client.0.smithi006.stdout: 10 814 0.40 MB/sec execute 272 sec latency 7440.856 ms 2024-05-04T00:52:34.339 INFO:tasks.workunit.client.0.smithi006.stdout: 10 815 0.40 MB/sec execute 273 sec latency 7879.060 ms 2024-05-04T00:52:35.339 INFO:tasks.workunit.client.0.smithi006.stdout: 10 816 0.39 MB/sec execute 274 sec latency 7811.877 ms 2024-05-04T00:52:36.339 INFO:tasks.workunit.client.0.smithi006.stdout: 10 817 0.39 MB/sec execute 275 sec latency 7843.880 ms 2024-05-04T00:52:37.339 INFO:tasks.workunit.client.0.smithi006.stdout: 10 818 0.39 MB/sec execute 276 sec latency 8157.616 ms 2024-05-04T00:52:38.339 INFO:tasks.workunit.client.0.smithi006.stdout: 10 819 0.39 MB/sec execute 277 sec latency 6607.992 ms 2024-05-04T00:52:39.339 INFO:tasks.workunit.client.0.smithi006.stdout: 10 819 0.39 MB/sec execute 278 sec latency 5093.799 ms 2024-05-04T00:52:40.339 INFO:tasks.workunit.client.0.smithi006.stdout: 10 819 0.39 MB/sec execute 279 sec latency 6093.894 ms 2024-05-04T00:52:41.339 INFO:tasks.workunit.client.0.smithi006.stdout: 10 819 0.39 MB/sec execute 280 sec latency 6827.324 ms 2024-05-04T00:52:42.340 INFO:tasks.workunit.client.0.smithi006.stdout: 10 820 0.38 MB/sec execute 281 sec latency 6838.777 ms 2024-05-04T00:52:43.340 INFO:tasks.workunit.client.0.smithi006.stdout: 10 821 0.38 MB/sec execute 282 sec latency 6221.419 ms 2024-05-04T00:52:44.340 INFO:tasks.workunit.client.0.smithi006.stdout: 10 824 0.38 MB/sec execute 283 sec latency 5959.711 ms 2024-05-04T00:52:45.340 INFO:tasks.workunit.client.0.smithi006.stdout: 10 826 0.38 MB/sec execute 284 sec latency 6096.009 ms 2024-05-04T00:52:46.341 INFO:tasks.workunit.client.0.smithi006.stdout: 10 826 0.38 MB/sec execute 285 sec latency 4270.537 ms 2024-05-04T00:52:47.340 INFO:tasks.workunit.client.0.smithi006.stdout: 10 826 0.38 MB/sec execute 286 sec latency 5270.633 ms 2024-05-04T00:52:48.340 INFO:tasks.workunit.client.0.smithi006.stdout: 10 829 0.38 MB/sec execute 287 sec latency 5503.219 ms 2024-05-04T00:52:49.340 INFO:tasks.workunit.client.0.smithi006.stdout: 10 832 0.38 MB/sec execute 288 sec latency 4781.145 ms 2024-05-04T00:52:50.340 INFO:tasks.workunit.client.0.smithi006.stdout: 10 836 0.37 MB/sec execute 289 sec latency 4545.579 ms 2024-05-04T00:52:51.340 INFO:tasks.workunit.client.0.smithi006.stdout: 10 838 0.37 MB/sec execute 290 sec latency 2461.558 ms 2024-05-04T00:52:52.340 INFO:tasks.workunit.client.0.smithi006.stdout: 10 838 0.37 MB/sec execute 291 sec latency 3461.639 ms 2024-05-04T00:52:52.413 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:52:52.415 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:52:53.340 INFO:tasks.workunit.client.0.smithi006.stdout: 10 839 0.37 MB/sec execute 292 sec latency 4461.686 ms 2024-05-04T00:52:54.341 INFO:tasks.workunit.client.0.smithi006.stdout: 10 839 0.37 MB/sec execute 293 sec latency 5461.749 ms 2024-05-04T00:52:55.341 INFO:tasks.workunit.client.0.smithi006.stdout: 10 844 0.37 MB/sec execute 294 sec latency 6080.258 ms 2024-05-04T00:52:56.341 INFO:tasks.workunit.client.0.smithi006.stdout: 10 846 0.37 MB/sec execute 295 sec latency 6308.975 ms 2024-05-04T00:52:57.341 INFO:tasks.workunit.client.0.smithi006.stdout: 10 849 0.37 MB/sec execute 296 sec latency 6229.418 ms 2024-05-04T00:52:58.341 INFO:tasks.workunit.client.0.smithi006.stdout: 10 851 0.37 MB/sec execute 297 sec latency 4055.383 ms 2024-05-04T00:52:59.341 INFO:tasks.workunit.client.0.smithi006.stdout: 10 852 0.36 MB/sec execute 298 sec latency 3928.957 ms 2024-05-04T00:53:00.341 INFO:tasks.workunit.client.0.smithi006.stdout: 10 852 0.36 MB/sec execute 299 sec latency 4555.288 ms 2024-05-04T00:53:01.341 INFO:tasks.workunit.client.0.smithi006.stdout: 10 852 0.36 MB/sec execute 300 sec latency 4946.523 ms 2024-05-04T00:53:02.341 INFO:tasks.workunit.client.0.smithi006.stdout: 10 853 0.36 MB/sec execute 301 sec latency 5911.937 ms 2024-05-04T00:53:03.341 INFO:tasks.workunit.client.0.smithi006.stdout: 10 856 0.36 MB/sec execute 302 sec latency 6112.054 ms 2024-05-04T00:53:04.342 INFO:tasks.workunit.client.0.smithi006.stdout: 10 859 0.36 MB/sec execute 303 sec latency 6515.851 ms 2024-05-04T00:53:05.341 INFO:tasks.workunit.client.0.smithi006.stdout: 10 860 0.36 MB/sec execute 304 sec latency 6244.922 ms 2024-05-04T00:53:06.342 INFO:tasks.workunit.client.0.smithi006.stdout: 10 861 0.36 MB/sec execute 305 sec latency 6460.351 ms 2024-05-04T00:53:07.342 INFO:tasks.workunit.client.0.smithi006.stdout: 10 862 0.36 MB/sec execute 306 sec latency 7460.420 ms 2024-05-04T00:53:08.342 INFO:tasks.workunit.client.0.smithi006.stdout: 10 863 0.35 MB/sec execute 307 sec latency 7931.720 ms 2024-05-04T00:53:09.342 INFO:tasks.workunit.client.0.smithi006.stdout: 10 864 0.35 MB/sec execute 308 sec latency 6189.429 ms 2024-05-04T00:53:10.342 INFO:tasks.workunit.client.0.smithi006.stdout: 10 866 0.35 MB/sec execute 309 sec latency 7189.511 ms 2024-05-04T00:53:11.342 INFO:tasks.workunit.client.0.smithi006.stdout: 10 867 0.35 MB/sec execute 310 sec latency 7490.166 ms 2024-05-04T00:53:12.342 INFO:tasks.workunit.client.0.smithi006.stdout: 10 867 0.35 MB/sec execute 311 sec latency 7829.433 ms 2024-05-04T00:53:13.342 INFO:tasks.workunit.client.0.smithi006.stdout: 10 867 0.35 MB/sec execute 312 sec latency 8829.498 ms 2024-05-04T00:53:14.342 INFO:tasks.workunit.client.0.smithi006.stdout: 10 868 0.35 MB/sec execute 313 sec latency 9601.088 ms 2024-05-04T00:53:15.342 INFO:tasks.workunit.client.0.smithi006.stdout: 10 868 0.35 MB/sec execute 314 sec latency 8173.918 ms 2024-05-04T00:53:16.342 INFO:tasks.workunit.client.0.smithi006.stdout: 10 868 0.35 MB/sec execute 315 sec latency 5973.275 ms 2024-05-04T00:53:17.342 INFO:tasks.workunit.client.0.smithi006.stdout: 10 869 0.34 MB/sec execute 316 sec latency 6973.370 ms 2024-05-04T00:53:18.342 INFO:tasks.workunit.client.0.smithi006.stdout: 10 870 0.34 MB/sec execute 317 sec latency 7840.109 ms 2024-05-04T00:53:19.342 INFO:tasks.workunit.client.0.smithi006.stdout: 10 873 0.34 MB/sec execute 318 sec latency 7895.257 ms 2024-05-04T00:53:20.343 INFO:tasks.workunit.client.0.smithi006.stdout: 10 875 0.34 MB/sec execute 319 sec latency 6212.206 ms 2024-05-04T00:53:21.343 INFO:tasks.workunit.client.0.smithi006.stdout: 10 876 0.34 MB/sec execute 320 sec latency 6439.887 ms 2024-05-04T00:53:22.343 INFO:tasks.workunit.client.0.smithi006.stdout: 10 877 0.34 MB/sec execute 321 sec latency 5188.246 ms 2024-05-04T00:53:22.458 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:53:22.461 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:53:23.346 INFO:tasks.workunit.client.0.smithi006.stdout: 10 879 0.34 MB/sec execute 322 sec latency 5475.495 ms 2024-05-04T00:53:24.343 INFO:tasks.workunit.client.0.smithi006.stdout: 10 880 0.34 MB/sec execute 323 sec latency 5410.834 ms 2024-05-04T00:53:25.343 INFO:tasks.workunit.client.0.smithi006.stdout: 10 881 0.34 MB/sec execute 324 sec latency 6327.063 ms 2024-05-04T00:53:26.344 INFO:tasks.workunit.client.0.smithi006.stdout: 10 882 0.34 MB/sec execute 325 sec latency 5971.473 ms 2024-05-04T00:53:27.343 INFO:tasks.workunit.client.0.smithi006.stdout: 10 883 0.34 MB/sec execute 326 sec latency 6971.544 ms 2024-05-04T00:53:28.343 INFO:tasks.workunit.client.0.smithi006.stdout: 10 884 0.34 MB/sec execute 327 sec latency 7395.511 ms 2024-05-04T00:53:29.343 INFO:tasks.workunit.client.0.smithi006.stdout: 10 886 0.33 MB/sec execute 328 sec latency 6380.836 ms 2024-05-04T00:53:30.343 INFO:tasks.workunit.client.0.smithi006.stdout: 10 888 0.33 MB/sec execute 329 sec latency 5408.603 ms 2024-05-04T00:53:31.344 INFO:tasks.workunit.client.0.smithi006.stdout: 10 888 0.33 MB/sec execute 330 sec latency 5951.490 ms 2024-05-04T00:53:32.347 INFO:tasks.workunit.client.0.smithi006.stdout: 10 890 0.33 MB/sec execute 331 sec latency 6489.491 ms 2024-05-04T00:53:33.344 INFO:tasks.workunit.client.0.smithi006.stdout: 10 893 0.33 MB/sec execute 332 sec latency 5762.527 ms 2024-05-04T00:53:34.344 INFO:tasks.workunit.client.0.smithi006.stdout: 10 896 0.33 MB/sec execute 333 sec latency 5780.450 ms 2024-05-04T00:53:35.344 INFO:tasks.workunit.client.0.smithi006.stdout: 10 899 0.33 MB/sec execute 334 sec latency 2689.251 ms 2024-05-04T00:53:36.344 INFO:tasks.workunit.client.0.smithi006.stdout: 10 900 0.33 MB/sec execute 335 sec latency 3689.309 ms 2024-05-04T00:53:37.344 INFO:tasks.workunit.client.0.smithi006.stdout: 10 902 0.33 MB/sec execute 336 sec latency 4689.387 ms 2024-05-04T00:53:38.344 INFO:tasks.workunit.client.0.smithi006.stdout: 10 902 0.33 MB/sec execute 337 sec latency 5689.447 ms 2024-05-04T00:53:39.344 INFO:tasks.workunit.client.0.smithi006.stdout: 10 903 0.33 MB/sec execute 338 sec latency 6689.525 ms 2024-05-04T00:53:40.344 INFO:tasks.workunit.client.0.smithi006.stdout: 10 903 0.32 MB/sec execute 339 sec latency 7637.782 ms 2024-05-04T00:53:41.344 INFO:tasks.workunit.client.0.smithi006.stdout: 10 903 0.32 MB/sec execute 340 sec latency 7477.467 ms 2024-05-04T00:53:42.344 INFO:tasks.workunit.client.0.smithi006.stdout: 10 904 0.32 MB/sec execute 341 sec latency 8477.564 ms 2024-05-04T00:53:43.344 INFO:tasks.workunit.client.0.smithi006.stdout: 10 904 0.32 MB/sec execute 342 sec latency 9044.664 ms 2024-05-04T00:53:44.345 INFO:tasks.workunit.client.0.smithi006.stdout: 10 906 0.32 MB/sec execute 343 sec latency 9134.274 ms 2024-05-04T00:53:45.345 INFO:tasks.workunit.client.0.smithi006.stdout: 10 909 0.32 MB/sec execute 344 sec latency 8443.261 ms 2024-05-04T00:53:46.345 INFO:tasks.workunit.client.0.smithi006.stdout: 10 913 0.32 MB/sec execute 345 sec latency 3433.230 ms 2024-05-04T00:53:47.345 INFO:tasks.workunit.client.0.smithi006.stdout: 10 916 0.32 MB/sec execute 346 sec latency 4433.295 ms 2024-05-04T00:53:48.345 INFO:tasks.workunit.client.0.smithi006.stdout: 10 918 0.32 MB/sec execute 347 sec latency 5433.368 ms 2024-05-04T00:53:49.345 INFO:tasks.workunit.client.0.smithi006.stdout: 10 920 0.32 MB/sec execute 348 sec latency 6024.706 ms 2024-05-04T00:53:50.345 INFO:tasks.workunit.client.0.smithi006.stdout: 10 922 0.32 MB/sec execute 349 sec latency 5066.522 ms 2024-05-04T00:53:51.345 INFO:tasks.workunit.client.0.smithi006.stdout: 10 923 0.32 MB/sec execute 350 sec latency 6066.576 ms 2024-05-04T00:53:52.345 INFO:tasks.workunit.client.0.smithi006.stdout: 10 923 0.31 MB/sec execute 351 sec latency 7066.659 ms 2024-05-04T00:53:52.517 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:53:52.520 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:53:53.345 INFO:tasks.workunit.client.0.smithi006.stdout: 10 923 0.31 MB/sec execute 352 sec latency 8037.364 ms 2024-05-04T00:53:54.345 INFO:tasks.workunit.client.0.smithi006.stdout: 10 924 0.31 MB/sec execute 353 sec latency 6199.620 ms 2024-05-04T00:53:55.345 INFO:tasks.workunit.client.0.smithi006.stdout: 10 924 0.31 MB/sec execute 354 sec latency 7199.712 ms 2024-05-04T00:53:56.345 INFO:tasks.workunit.client.0.smithi006.stdout: 10 924 0.31 MB/sec execute 355 sec latency 7473.245 ms 2024-05-04T00:53:57.346 INFO:tasks.workunit.client.0.smithi006.stdout: 10 924 0.31 MB/sec execute 356 sec latency 7274.777 ms 2024-05-04T00:53:58.346 INFO:tasks.workunit.client.0.smithi006.stdout: 10 926 0.31 MB/sec execute 357 sec latency 7131.601 ms 2024-05-04T00:53:59.346 INFO:tasks.workunit.client.0.smithi006.stdout: 10 927 0.31 MB/sec execute 358 sec latency 7121.632 ms 2024-05-04T00:54:00.346 INFO:tasks.workunit.client.0.smithi006.stdout: 10 929 0.31 MB/sec execute 359 sec latency 6232.523 ms 2024-05-04T00:54:01.346 INFO:tasks.workunit.client.0.smithi006.stdout: 10 931 0.31 MB/sec execute 360 sec latency 5773.346 ms 2024-05-04T00:54:02.346 INFO:tasks.workunit.client.0.smithi006.stdout: 10 931 0.31 MB/sec execute 361 sec latency 6773.413 ms 2024-05-04T00:54:03.346 INFO:tasks.workunit.client.0.smithi006.stdout: 10 932 0.31 MB/sec execute 362 sec latency 7398.215 ms 2024-05-04T00:54:04.346 INFO:tasks.workunit.client.0.smithi006.stdout: 10 932 0.31 MB/sec execute 363 sec latency 6138.920 ms 2024-05-04T00:54:05.346 INFO:tasks.workunit.client.0.smithi006.stdout: 10 933 0.30 MB/sec execute 364 sec latency 6285.045 ms 2024-05-04T00:54:06.346 INFO:tasks.workunit.client.0.smithi006.stdout: 10 933 0.30 MB/sec execute 365 sec latency 4854.245 ms 2024-05-04T00:54:07.346 INFO:tasks.workunit.client.0.smithi006.stdout: 10 934 0.30 MB/sec execute 366 sec latency 5854.336 ms 2024-05-04T00:54:08.347 INFO:tasks.workunit.client.0.smithi006.stdout: 10 934 0.30 MB/sec execute 367 sec latency 6384.420 ms 2024-05-04T00:54:09.347 INFO:tasks.workunit.client.0.smithi006.stdout: 10 935 0.30 MB/sec execute 368 sec latency 3361.303 ms 2024-05-04T00:54:10.347 INFO:tasks.workunit.client.0.smithi006.stdout: 10 937 0.30 MB/sec execute 369 sec latency 4361.399 ms 2024-05-04T00:54:11.347 INFO:tasks.workunit.client.0.smithi006.stdout: 10 937 0.30 MB/sec execute 370 sec latency 5361.473 ms 2024-05-04T00:54:12.347 INFO:tasks.workunit.client.0.smithi006.stdout: 10 937 0.30 MB/sec execute 371 sec latency 5707.709 ms 2024-05-04T00:54:13.347 INFO:tasks.workunit.client.0.smithi006.stdout: 10 937 0.30 MB/sec execute 372 sec latency 5470.454 ms 2024-05-04T00:54:14.347 INFO:tasks.workunit.client.0.smithi006.stdout: 10 938 0.30 MB/sec execute 373 sec latency 6203.475 ms 2024-05-04T00:54:15.347 INFO:tasks.workunit.client.0.smithi006.stdout: 10 938 0.30 MB/sec execute 374 sec latency 6353.724 ms 2024-05-04T00:54:16.347 INFO:tasks.workunit.client.0.smithi006.stdout: 10 939 0.30 MB/sec execute 375 sec latency 6430.960 ms 2024-05-04T00:54:17.347 INFO:tasks.workunit.client.0.smithi006.stdout: 10 941 0.29 MB/sec execute 376 sec latency 5863.181 ms 2024-05-04T00:54:18.347 INFO:tasks.workunit.client.0.smithi006.stdout: 10 943 0.29 MB/sec execute 377 sec latency 1780.366 ms 2024-05-04T00:54:19.347 INFO:tasks.workunit.client.0.smithi006.stdout: 10 945 0.29 MB/sec execute 378 sec latency 2780.459 ms 2024-05-04T00:54:20.348 INFO:tasks.workunit.client.0.smithi006.stdout: 10 947 0.30 MB/sec execute 379 sec latency 2913.131 ms 2024-05-04T00:54:21.348 INFO:tasks.workunit.client.0.smithi006.stdout: 10 948 0.29 MB/sec execute 380 sec latency 3823.207 ms 2024-05-04T00:54:22.348 INFO:tasks.workunit.client.0.smithi006.stdout: 10 948 0.29 MB/sec execute 381 sec latency 4823.275 ms 2024-05-04T00:54:22.560 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:54:22.563 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:54:23.348 INFO:tasks.workunit.client.0.smithi006.stdout: 10 948 0.29 MB/sec execute 382 sec latency 5058.927 ms 2024-05-04T00:54:24.348 INFO:tasks.workunit.client.0.smithi006.stdout: 10 950 0.29 MB/sec execute 383 sec latency 5310.927 ms 2024-05-04T00:54:25.348 INFO:tasks.workunit.client.0.smithi006.stdout: 10 951 0.29 MB/sec execute 384 sec latency 5785.803 ms 2024-05-04T00:54:26.348 INFO:tasks.workunit.client.0.smithi006.stdout: 10 953 0.29 MB/sec execute 385 sec latency 5733.301 ms 2024-05-04T00:54:27.349 INFO:tasks.workunit.client.0.smithi006.stdout: 10 954 0.29 MB/sec execute 386 sec latency 4548.292 ms 2024-05-04T00:54:28.348 INFO:tasks.workunit.client.0.smithi006.stdout: 10 954 0.29 MB/sec execute 387 sec latency 5548.362 ms 2024-05-04T00:54:29.349 INFO:tasks.workunit.client.0.smithi006.stdout: 10 956 0.29 MB/sec execute 388 sec latency 6270.076 ms 2024-05-04T00:54:30.349 INFO:tasks.workunit.client.0.smithi006.stdout: 10 959 0.29 MB/sec execute 389 sec latency 6002.710 ms 2024-05-04T00:54:31.349 INFO:tasks.workunit.client.0.smithi006.stdout: 10 962 0.29 MB/sec execute 390 sec latency 5279.788 ms 2024-05-04T00:54:32.349 INFO:tasks.workunit.client.0.smithi006.stdout: 10 964 0.29 MB/sec execute 391 sec latency 4303.511 ms 2024-05-04T00:54:33.349 INFO:tasks.workunit.client.0.smithi006.stdout: 10 967 0.29 MB/sec execute 392 sec latency 4404.336 ms 2024-05-04T00:54:34.349 INFO:tasks.workunit.client.0.smithi006.stdout: 10 969 0.29 MB/sec execute 393 sec latency 1667.392 ms 2024-05-04T00:54:35.349 INFO:tasks.workunit.client.0.smithi006.stdout: 10 971 0.29 MB/sec execute 394 sec latency 2173.012 ms 2024-05-04T00:54:36.349 INFO:tasks.workunit.client.0.smithi006.stdout: 10 975 0.29 MB/sec execute 395 sec latency 2618.395 ms 2024-05-04T00:54:37.349 INFO:tasks.workunit.client.0.smithi006.stdout: 10 975 0.29 MB/sec execute 396 sec latency 3618.476 ms 2024-05-04T00:54:38.349 INFO:tasks.workunit.client.0.smithi006.stdout: 10 977 0.29 MB/sec execute 397 sec latency 4618.568 ms 2024-05-04T00:54:39.349 INFO:tasks.workunit.client.0.smithi006.stdout: 10 977 0.28 MB/sec execute 398 sec latency 5618.647 ms 2024-05-04T00:54:40.349 INFO:tasks.workunit.client.0.smithi006.stdout: 10 977 0.28 MB/sec execute 399 sec latency 6618.731 ms 2024-05-04T00:54:41.349 INFO:tasks.workunit.client.0.smithi006.stdout: 10 978 0.28 MB/sec execute 400 sec latency 7618.810 ms 2024-05-04T00:54:42.349 INFO:tasks.workunit.client.0.smithi006.stdout: 10 980 0.28 MB/sec execute 401 sec latency 8618.922 ms 2024-05-04T00:54:43.349 INFO:tasks.workunit.client.0.smithi006.stdout: 10 981 0.28 MB/sec execute 402 sec latency 9619.000 ms 2024-05-04T00:54:44.349 INFO:tasks.workunit.client.0.smithi006.stdout: 10 985 0.28 MB/sec execute 403 sec latency 10068.805 ms 2024-05-04T00:54:45.350 INFO:tasks.workunit.client.0.smithi006.stdout: 10 988 0.28 MB/sec execute 404 sec latency 8732.353 ms 2024-05-04T00:54:46.350 INFO:tasks.workunit.client.0.smithi006.stdout: 10 992 0.28 MB/sec execute 405 sec latency 7254.863 ms 2024-05-04T00:54:47.350 INFO:tasks.workunit.client.0.smithi006.stdout: 10 994 0.28 MB/sec execute 406 sec latency 1950.410 ms 2024-05-04T00:54:48.350 INFO:tasks.workunit.client.0.smithi006.stdout: 10 996 0.28 MB/sec execute 407 sec latency 2950.477 ms 2024-05-04T00:54:49.350 INFO:tasks.workunit.client.0.smithi006.stdout: 10 997 0.28 MB/sec execute 408 sec latency 3950.545 ms 2024-05-04T00:54:50.350 INFO:tasks.workunit.client.0.smithi006.stdout: 10 998 0.28 MB/sec execute 409 sec latency 4950.629 ms 2024-05-04T00:54:51.350 INFO:tasks.workunit.client.0.smithi006.stdout: 10 998 0.28 MB/sec execute 410 sec latency 5950.714 ms 2024-05-04T00:54:52.350 INFO:tasks.workunit.client.0.smithi006.stdout: 10 998 0.28 MB/sec execute 411 sec latency 6950.807 ms 2024-05-04T00:54:52.674 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:54:52.677 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:54:53.350 INFO:tasks.workunit.client.0.smithi006.stdout: 10 998 0.28 MB/sec execute 412 sec latency 7284.091 ms 2024-05-04T00:54:54.350 INFO:tasks.workunit.client.0.smithi006.stdout: 10 998 0.28 MB/sec execute 413 sec latency 7283.209 ms 2024-05-04T00:54:55.350 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1000 0.28 MB/sec execute 414 sec latency 7218.084 ms 2024-05-04T00:54:56.350 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1005 0.28 MB/sec execute 415 sec latency 7910.337 ms 2024-05-04T00:54:57.351 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1008 0.28 MB/sec execute 416 sec latency 8406.182 ms 2024-05-04T00:54:58.351 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1013 0.28 MB/sec execute 417 sec latency 5667.235 ms 2024-05-04T00:54:59.351 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1017 0.28 MB/sec execute 418 sec latency 6541.473 ms 2024-05-04T00:55:00.351 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1023 0.28 MB/sec execute 419 sec latency 4101.419 ms 2024-05-04T00:55:01.351 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1024 0.29 MB/sec execute 420 sec latency 5101.510 ms 2024-05-04T00:55:02.351 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1024 0.28 MB/sec execute 421 sec latency 6101.567 ms 2024-05-04T00:55:02.810 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:25:07.569 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:55:02.814 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:25:07.576 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:55:02.953 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:25:07.662 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:55:02.969 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:25:07.678 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:55:02.970 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:25:07.680 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:55:02.976 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:25:07.686 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:55:03.008 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:25:07.770 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:55:03.097 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:25:07.807 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:55:03.118 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:25:07.827 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:55:03.351 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1025 0.28 MB/sec execute 422 sec latency 6763.910 ms 2024-05-04T00:55:04.351 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1025 0.28 MB/sec execute 423 sec latency 5397.007 ms 2024-05-04T00:55:05.351 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1025 0.28 MB/sec execute 424 sec latency 6397.104 ms 2024-05-04T00:55:06.351 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1026 0.28 MB/sec execute 425 sec latency 7397.182 ms 2024-05-04T00:55:07.351 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1026 0.28 MB/sec execute 426 sec latency 7519.656 ms 2024-05-04T00:55:08.352 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1027 0.28 MB/sec execute 427 sec latency 7737.698 ms 2024-05-04T00:55:09.354 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1028 0.28 MB/sec execute 428 sec latency 8287.880 ms 2024-05-04T00:55:10.352 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1034 0.28 MB/sec execute 429 sec latency 4191.333 ms 2024-05-04T00:55:11.352 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1036 0.28 MB/sec execute 430 sec latency 5191.427 ms 2024-05-04T00:55:12.352 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1038 0.28 MB/sec execute 431 sec latency 6191.526 ms 2024-05-04T00:55:13.352 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1039 0.28 MB/sec execute 432 sec latency 6603.420 ms 2024-05-04T00:55:14.352 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1039 0.28 MB/sec execute 433 sec latency 5017.195 ms 2024-05-04T00:55:15.352 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1039 0.28 MB/sec execute 434 sec latency 5077.663 ms 2024-05-04T00:55:16.352 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1040 0.28 MB/sec execute 435 sec latency 5990.332 ms 2024-05-04T00:55:17.354 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1041 0.28 MB/sec execute 436 sec latency 6180.470 ms 2024-05-04T00:55:18.352 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1043 0.28 MB/sec execute 437 sec latency 5983.870 ms 2024-05-04T00:55:19.353 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1045 0.28 MB/sec execute 438 sec latency 6013.084 ms 2024-05-04T00:55:20.353 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1046 0.28 MB/sec execute 439 sec latency 6742.712 ms 2024-05-04T00:55:21.358 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1047 0.28 MB/sec execute 440 sec latency 5567.826 ms 2024-05-04T00:55:22.353 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1048 0.28 MB/sec execute 441 sec latency 5733.952 ms 2024-05-04T00:55:22.719 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:55:22.722 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:55:23.353 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1050 0.28 MB/sec execute 442 sec latency 4319.152 ms 2024-05-04T00:55:24.353 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1050 0.28 MB/sec execute 443 sec latency 5275.296 ms 2024-05-04T00:55:25.353 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1050 0.27 MB/sec execute 444 sec latency 5182.087 ms 2024-05-04T00:55:26.353 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1050 0.27 MB/sec execute 445 sec latency 5734.929 ms 2024-05-04T00:55:27.353 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1050 0.27 MB/sec execute 446 sec latency 6735.023 ms 2024-05-04T00:55:28.353 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1051 0.27 MB/sec execute 447 sec latency 6903.392 ms 2024-05-04T00:55:29.353 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1053 0.27 MB/sec execute 448 sec latency 5574.166 ms 2024-05-04T00:55:30.353 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1055 0.27 MB/sec execute 449 sec latency 6044.463 ms 2024-05-04T00:55:31.353 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1057 0.27 MB/sec execute 450 sec latency 6427.907 ms 2024-05-04T00:55:32.353 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1057 0.27 MB/sec execute 451 sec latency 5178.688 ms 2024-05-04T00:55:33.354 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1058 0.27 MB/sec execute 452 sec latency 6001.158 ms 2024-05-04T00:55:34.354 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1058 0.27 MB/sec execute 453 sec latency 6832.241 ms 2024-05-04T00:55:35.354 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1058 0.27 MB/sec execute 454 sec latency 6832.734 ms 2024-05-04T00:55:36.354 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1058 0.27 MB/sec execute 455 sec latency 5462.478 ms 2024-05-04T00:55:37.354 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1059 0.27 MB/sec execute 456 sec latency 6393.286 ms 2024-05-04T00:55:38.354 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1060 0.27 MB/sec execute 457 sec latency 7193.474 ms 2024-05-04T00:55:39.354 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1061 0.27 MB/sec execute 458 sec latency 6414.655 ms 2024-05-04T00:55:40.354 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1063 0.27 MB/sec execute 459 sec latency 5895.502 ms 2024-05-04T00:55:41.354 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1064 0.27 MB/sec execute 460 sec latency 6663.715 ms 2024-05-04T00:55:42.354 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1065 0.26 MB/sec execute 461 sec latency 6652.763 ms 2024-05-04T00:55:43.354 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1066 0.26 MB/sec execute 462 sec latency 7367.259 ms 2024-05-04T00:55:44.354 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1069 0.26 MB/sec execute 463 sec latency 6049.625 ms 2024-05-04T00:55:45.354 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1071 0.26 MB/sec execute 464 sec latency 6306.542 ms 2024-05-04T00:55:46.355 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1072 0.26 MB/sec execute 465 sec latency 3309.025 ms 2024-05-04T00:55:47.355 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1072 0.26 MB/sec execute 466 sec latency 4309.111 ms 2024-05-04T00:55:48.355 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1075 0.26 MB/sec execute 467 sec latency 5309.216 ms 2024-05-04T00:55:49.355 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1076 0.26 MB/sec execute 468 sec latency 6309.283 ms 2024-05-04T00:55:50.355 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1078 0.26 MB/sec execute 469 sec latency 7309.349 ms 2024-05-04T00:55:51.355 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1079 0.26 MB/sec execute 470 sec latency 7517.084 ms 2024-05-04T00:55:52.355 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1081 0.26 MB/sec execute 471 sec latency 7743.723 ms 2024-05-04T00:55:52.794 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:55:52.797 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:55:53.355 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1081 0.26 MB/sec execute 472 sec latency 8705.478 ms 2024-05-04T00:55:54.355 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1083 0.26 MB/sec execute 473 sec latency 5321.578 ms 2024-05-04T00:55:55.355 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1086 0.26 MB/sec execute 474 sec latency 6321.681 ms 2024-05-04T00:55:56.355 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1088 0.26 MB/sec execute 475 sec latency 6640.379 ms 2024-05-04T00:55:57.355 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1090 0.26 MB/sec execute 476 sec latency 5968.119 ms 2024-05-04T00:55:58.356 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1091 0.26 MB/sec execute 477 sec latency 6968.215 ms 2024-05-04T00:55:59.356 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1091 0.26 MB/sec execute 478 sec latency 7968.287 ms 2024-05-04T00:56:00.356 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1092 0.26 MB/sec execute 479 sec latency 8282.127 ms 2024-05-04T00:56:01.356 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1094 0.25 MB/sec execute 480 sec latency 7142.177 ms 2024-05-04T00:56:02.356 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1095 0.25 MB/sec execute 481 sec latency 7610.283 ms 2024-05-04T00:56:03.356 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1096 0.25 MB/sec execute 482 sec latency 3485.908 ms 2024-05-04T00:56:04.356 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1097 0.25 MB/sec execute 483 sec latency 4486.003 ms 2024-05-04T00:56:05.356 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1099 0.25 MB/sec execute 484 sec latency 5486.096 ms 2024-05-04T00:56:06.356 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1101 0.25 MB/sec execute 485 sec latency 6153.890 ms 2024-05-04T00:56:07.356 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1103 0.25 MB/sec execute 486 sec latency 5499.188 ms 2024-05-04T00:56:08.356 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1106 0.25 MB/sec execute 487 sec latency 4919.280 ms 2024-05-04T00:56:09.357 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1107 0.25 MB/sec execute 488 sec latency 4646.232 ms 2024-05-04T00:56:10.356 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1108 0.25 MB/sec execute 489 sec latency 5646.286 ms 2024-05-04T00:56:11.356 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1110 0.25 MB/sec execute 490 sec latency 6646.375 ms 2024-05-04T00:56:12.357 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1111 0.25 MB/sec execute 491 sec latency 6960.817 ms 2024-05-04T00:56:13.229 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:26:17.990 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:56:13.345 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:26:18.106 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:56:13.357 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1113 0.25 MB/sec execute 492 sec latency 3193.327 ms 2024-05-04T00:56:13.397 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:26:18.158 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:56:13.521 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:26:18.230 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:56:13.527 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:26:18.237 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:56:13.540 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:26:18.249 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:56:13.546 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:26:18.255 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:56:13.604 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:26:18.313 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:56:13.616 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:26:18.325 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:56:14.357 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1113 0.25 MB/sec execute 493 sec latency 4193.412 ms 2024-05-04T00:56:15.357 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1114 0.25 MB/sec execute 494 sec latency 5193.469 ms 2024-05-04T00:56:16.357 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1115 0.25 MB/sec execute 495 sec latency 5670.289 ms 2024-05-04T00:56:17.357 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1118 0.25 MB/sec execute 496 sec latency 5593.282 ms 2024-05-04T00:56:18.357 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1120 0.25 MB/sec execute 497 sec latency 5850.315 ms 2024-05-04T00:56:19.357 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1121 0.25 MB/sec execute 498 sec latency 5987.231 ms 2024-05-04T00:56:20.357 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1123 0.25 MB/sec execute 499 sec latency 6445.668 ms 2024-05-04T00:56:21.360 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1124 0.25 MB/sec execute 500 sec latency 4677.853 ms 2024-05-04T00:56:22.358 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1125 0.24 MB/sec execute 501 sec latency 5677.947 ms 2024-05-04T00:56:22.914 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:56:22.917 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:56:23.358 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1125 0.24 MB/sec execute 502 sec latency 6678.033 ms 2024-05-04T00:56:24.358 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1127 0.24 MB/sec execute 503 sec latency 6945.394 ms 2024-05-04T00:56:25.358 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1129 0.24 MB/sec execute 504 sec latency 7272.731 ms 2024-05-04T00:56:26.358 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1130 0.24 MB/sec execute 505 sec latency 7405.370 ms 2024-05-04T00:56:27.358 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1132 0.24 MB/sec execute 506 sec latency 1813.897 ms 2024-05-04T00:56:28.358 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1134 0.24 MB/sec execute 507 sec latency 2422.030 ms 2024-05-04T00:56:29.358 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1136 0.24 MB/sec execute 508 sec latency 2703.317 ms 2024-05-04T00:56:30.358 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1137 0.24 MB/sec execute 509 sec latency 3502.080 ms 2024-05-04T00:56:31.358 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1140 0.24 MB/sec execute 510 sec latency 4502.145 ms 2024-05-04T00:56:32.358 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1141 0.24 MB/sec execute 511 sec latency 5502.237 ms 2024-05-04T00:56:33.358 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1142 0.24 MB/sec execute 512 sec latency 6502.310 ms 2024-05-04T00:56:34.358 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1144 0.24 MB/sec execute 513 sec latency 7502.414 ms 2024-05-04T00:56:35.359 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1144 0.24 MB/sec execute 514 sec latency 7776.457 ms 2024-05-04T00:56:36.359 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1145 0.24 MB/sec execute 515 sec latency 5908.754 ms 2024-05-04T00:56:37.359 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1147 0.24 MB/sec execute 516 sec latency 6554.341 ms 2024-05-04T00:56:38.359 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1150 0.24 MB/sec execute 517 sec latency 4549.431 ms 2024-05-04T00:56:39.359 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1152 0.24 MB/sec execute 518 sec latency 5549.529 ms 2024-05-04T00:56:40.359 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1153 0.24 MB/sec execute 519 sec latency 6549.623 ms 2024-05-04T00:56:41.359 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1155 0.24 MB/sec execute 520 sec latency 7337.617 ms 2024-05-04T00:56:42.359 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1158 0.24 MB/sec execute 521 sec latency 7642.188 ms 2024-05-04T00:56:43.359 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1159 0.24 MB/sec execute 522 sec latency 6905.051 ms 2024-05-04T00:56:44.359 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1160 0.24 MB/sec execute 523 sec latency 3264.625 ms 2024-05-04T00:56:45.359 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1162 0.23 MB/sec execute 524 sec latency 4264.713 ms 2024-05-04T00:56:46.359 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1163 0.23 MB/sec execute 525 sec latency 5264.812 ms 2024-05-04T00:56:47.360 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1164 0.23 MB/sec execute 526 sec latency 6264.911 ms 2024-05-04T00:56:48.360 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1165 0.23 MB/sec execute 527 sec latency 7265.010 ms 2024-05-04T00:56:49.360 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1165 0.23 MB/sec execute 528 sec latency 7494.431 ms 2024-05-04T00:56:50.360 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1165 0.23 MB/sec execute 529 sec latency 8138.996 ms 2024-05-04T00:56:51.360 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1166 0.23 MB/sec execute 530 sec latency 8276.453 ms 2024-05-04T00:56:52.360 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1168 0.23 MB/sec execute 531 sec latency 8060.119 ms 2024-05-04T00:56:53.059 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:56:53.063 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:56:53.360 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1168 0.23 MB/sec execute 532 sec latency 7542.413 ms 2024-05-04T00:56:54.360 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1170 0.23 MB/sec execute 533 sec latency 7650.038 ms 2024-05-04T00:56:55.360 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1171 0.23 MB/sec execute 534 sec latency 8650.126 ms 2024-05-04T00:56:56.360 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1172 0.23 MB/sec execute 535 sec latency 8799.234 ms 2024-05-04T00:56:57.360 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1173 0.23 MB/sec execute 536 sec latency 6938.415 ms 2024-05-04T00:56:58.361 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1173 0.23 MB/sec execute 537 sec latency 5874.561 ms 2024-05-04T00:56:59.361 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1174 0.23 MB/sec execute 538 sec latency 6874.658 ms 2024-05-04T00:57:00.361 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1175 0.23 MB/sec execute 539 sec latency 7298.314 ms 2024-05-04T00:57:01.361 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1177 0.23 MB/sec execute 540 sec latency 6289.547 ms 2024-05-04T00:57:02.361 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1179 0.23 MB/sec execute 541 sec latency 6416.432 ms 2024-05-04T00:57:03.361 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1179 0.23 MB/sec execute 542 sec latency 6753.124 ms 2024-05-04T00:57:04.361 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1180 0.23 MB/sec execute 543 sec latency 4576.699 ms 2024-05-04T00:57:05.361 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1180 0.23 MB/sec execute 544 sec latency 5576.758 ms 2024-05-04T00:57:06.361 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1181 0.23 MB/sec execute 545 sec latency 6189.393 ms 2024-05-04T00:57:07.361 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1181 0.23 MB/sec execute 546 sec latency 5870.878 ms 2024-05-04T00:57:08.361 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1182 0.23 MB/sec execute 547 sec latency 6435.518 ms 2024-05-04T00:57:09.361 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1182 0.22 MB/sec execute 548 sec latency 6749.462 ms 2024-05-04T00:57:10.362 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1183 0.22 MB/sec execute 549 sec latency 6387.871 ms 2024-05-04T00:57:11.362 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1183 0.22 MB/sec execute 550 sec latency 6590.788 ms 2024-05-04T00:57:12.362 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1185 0.22 MB/sec execute 551 sec latency 7018.949 ms 2024-05-04T00:57:13.362 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1187 0.22 MB/sec execute 552 sec latency 6550.319 ms 2024-05-04T00:57:14.362 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1188 0.22 MB/sec execute 553 sec latency 7299.712 ms 2024-05-04T00:57:15.362 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1189 0.22 MB/sec execute 554 sec latency 5952.315 ms 2024-05-04T00:57:16.362 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1191 0.22 MB/sec execute 555 sec latency 6205.744 ms 2024-05-04T00:57:17.362 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1193 0.22 MB/sec execute 556 sec latency 4760.732 ms 2024-05-04T00:57:18.362 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1195 0.22 MB/sec execute 557 sec latency 5519.083 ms 2024-05-04T00:57:19.362 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1197 0.22 MB/sec execute 558 sec latency 3955.288 ms 2024-05-04T00:57:20.362 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1198 0.22 MB/sec execute 559 sec latency 4955.355 ms 2024-05-04T00:57:21.362 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1199 0.22 MB/sec execute 560 sec latency 5955.428 ms 2024-05-04T00:57:22.362 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1200 0.22 MB/sec execute 561 sec latency 6535.150 ms 2024-05-04T00:57:23.192 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:57:23.195 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:57:23.362 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1201 0.22 MB/sec execute 562 sec latency 3414.125 ms 2024-05-04T00:57:24.362 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1203 0.22 MB/sec execute 563 sec latency 4414.224 ms 2024-05-04T00:57:25.363 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1203 0.22 MB/sec execute 564 sec latency 5414.318 ms 2024-05-04T00:57:26.363 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1204 0.22 MB/sec execute 565 sec latency 6414.397 ms 2024-05-04T00:57:27.363 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1206 0.22 MB/sec execute 566 sec latency 6818.169 ms 2024-05-04T00:57:28.363 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1209 0.22 MB/sec execute 567 sec latency 6736.327 ms 2024-05-04T00:57:29.363 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1212 0.22 MB/sec execute 568 sec latency 7736.392 ms 2024-05-04T00:57:30.363 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1213 0.22 MB/sec execute 569 sec latency 8250.589 ms 2024-05-04T00:57:31.363 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1215 0.22 MB/sec execute 570 sec latency 4529.702 ms 2024-05-04T00:57:32.363 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1217 0.22 MB/sec execute 571 sec latency 5529.753 ms 2024-05-04T00:57:33.363 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1219 0.22 MB/sec execute 572 sec latency 6529.848 ms 2024-05-04T00:57:34.363 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1221 0.22 MB/sec execute 573 sec latency 7438.257 ms 2024-05-04T00:57:35.363 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1222 0.22 MB/sec execute 574 sec latency 7618.944 ms 2024-05-04T00:57:36.364 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1224 0.22 MB/sec execute 575 sec latency 5464.177 ms 2024-05-04T00:57:37.363 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1225 0.21 MB/sec execute 576 sec latency 6207.094 ms 2024-05-04T00:57:38.364 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1227 0.21 MB/sec execute 577 sec latency 6066.306 ms 2024-05-04T00:57:39.364 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1228 0.21 MB/sec execute 578 sec latency 5092.039 ms 2024-05-04T00:57:40.364 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1229 0.21 MB/sec execute 579 sec latency 6092.125 ms 2024-05-04T00:57:41.364 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1232 0.21 MB/sec execute 580 sec latency 7092.185 ms 2024-05-04T00:57:42.364 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1233 0.21 MB/sec execute 581 sec latency 7992.134 ms 2024-05-04T00:57:43.364 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1235 0.21 MB/sec execute 582 sec latency 7745.384 ms 2024-05-04T00:57:44.364 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1235 0.21 MB/sec execute 583 sec latency 8745.448 ms 2024-05-04T00:57:45.364 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1235 0.21 MB/sec execute 584 sec latency 9541.964 ms 2024-05-04T00:57:46.364 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1237 0.21 MB/sec execute 585 sec latency 9250.825 ms 2024-05-04T00:57:47.364 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1240 0.21 MB/sec execute 586 sec latency 9217.870 ms 2024-05-04T00:57:48.364 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1240 0.21 MB/sec execute 587 sec latency 10217.942 ms 2024-05-04T00:57:49.364 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1242 0.21 MB/sec execute 588 sec latency 11218.024 ms 2024-05-04T00:57:50.364 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1242 0.21 MB/sec execute 589 sec latency 12218.121 ms 2024-05-04T00:57:51.365 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1243 0.21 MB/sec execute 590 sec latency 12796.598 ms 2024-05-04T00:57:52.365 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1245 0.21 MB/sec execute 591 sec latency 10060.148 ms 2024-05-04T00:57:53.298 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:57:53.300 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:57:53.365 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1250 0.21 MB/sec execute 592 sec latency 6115.081 ms 2024-05-04T00:57:54.365 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1258 0.21 MB/sec execute 593 sec latency 7115.152 ms 2024-05-04T00:57:55.365 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1262 0.21 MB/sec execute 594 sec latency 7784.564 ms 2024-05-04T00:57:56.365 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1263 0.21 MB/sec execute 595 sec latency 4335.370 ms 2024-05-04T00:57:57.365 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1264 0.21 MB/sec execute 596 sec latency 5335.460 ms 2024-05-04T00:57:58.365 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1265 0.21 MB/sec execute 597 sec latency 5373.195 ms 2024-05-04T00:57:59.365 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1267 0.21 MB/sec execute 598 sec latency 2702.462 ms 2024-05-04T00:58:00.365 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1267 0.21 MB/sec execute 599 sec latency 3702.539 ms 2024-05-04T00:58:01.365 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 600 sec 2024-05-04T00:58:02.365 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 601 sec 2024-05-04T00:58:03.365 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 602 sec 2024-05-04T00:58:04.366 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 603 sec 2024-05-04T00:58:05.366 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 604 sec 2024-05-04T00:58:06.366 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 605 sec 2024-05-04T00:58:07.366 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 606 sec 2024-05-04T00:58:08.366 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 607 sec 2024-05-04T00:58:09.366 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 608 sec 2024-05-04T00:58:10.366 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 609 sec 2024-05-04T00:58:11.366 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 610 sec 2024-05-04T00:58:12.366 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 611 sec 2024-05-04T00:58:13.366 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 612 sec 2024-05-04T00:58:14.366 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 613 sec 2024-05-04T00:58:15.366 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 614 sec 2024-05-04T00:58:16.366 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 615 sec 2024-05-04T00:58:17.366 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 616 sec 2024-05-04T00:58:18.367 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 617 sec 2024-05-04T00:58:19.366 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 618 sec 2024-05-04T00:58:20.367 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 619 sec 2024-05-04T00:58:21.367 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 620 sec 2024-05-04T00:58:22.367 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 621 sec 2024-05-04T00:58:23.367 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 622 sec 2024-05-04T00:58:23.419 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:58:23.422 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:58:24.367 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 623 sec 2024-05-04T00:58:25.367 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 624 sec 2024-05-04T00:58:26.367 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 625 sec 2024-05-04T00:58:27.367 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 626 sec 2024-05-04T00:58:28.367 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 627 sec 2024-05-04T00:58:29.367 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 628 sec 2024-05-04T00:58:30.367 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 629 sec 2024-05-04T00:58:31.367 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 630 sec 2024-05-04T00:58:32.368 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 631 sec 2024-05-04T00:58:33.368 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 632 sec 2024-05-04T00:58:34.368 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 633 sec 2024-05-04T00:58:35.368 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 634 sec 2024-05-04T00:58:36.368 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 635 sec 2024-05-04T00:58:37.368 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 636 sec 2024-05-04T00:58:38.368 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 637 sec 2024-05-04T00:58:39.368 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 638 sec 2024-05-04T00:58:40.368 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 639 sec 2024-05-04T00:58:41.368 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 640 sec 2024-05-04T00:58:42.368 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 641 sec 2024-05-04T00:58:43.237 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:28:47.999 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:58:43.295 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:28:48.004 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:58:43.306 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:28:48.016 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:58:43.307 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:28:48.016 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:58:43.334 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:28:48.044 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:58:43.343 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:28:48.105 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:58:43.368 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 642 sec 2024-05-04T00:58:43.450 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:28:48.160 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T00:58:43.462 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:28:48.223 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T00:58:43.466 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:28:48.176 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T00:58:44.368 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 643 sec 2024-05-04T00:58:45.369 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 644 sec 2024-05-04T00:58:46.369 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 645 sec 2024-05-04T00:58:47.369 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 646 sec 2024-05-04T00:58:48.369 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 647 sec 2024-05-04T00:58:49.369 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 648 sec 2024-05-04T00:58:50.369 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 649 sec 2024-05-04T00:58:51.369 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 650 sec 2024-05-04T00:58:52.369 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 651 sec 2024-05-04T00:58:53.369 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 652 sec 2024-05-04T00:58:53.616 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:58:53.618 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:58:54.369 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 653 sec 2024-05-04T00:58:55.369 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 654 sec 2024-05-04T00:58:56.369 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 655 sec 2024-05-04T00:58:57.370 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 656 sec 2024-05-04T00:58:58.370 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 657 sec 2024-05-04T00:58:59.370 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 658 sec 2024-05-04T00:59:00.370 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 659 sec 2024-05-04T00:59:01.370 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 660 sec 2024-05-04T00:59:02.370 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 661 sec 2024-05-04T00:59:03.370 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 662 sec 2024-05-04T00:59:04.370 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 663 sec 2024-05-04T00:59:05.370 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 664 sec 2024-05-04T00:59:06.370 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 665 sec 2024-05-04T00:59:07.370 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 666 sec 2024-05-04T00:59:08.370 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 667 sec 2024-05-04T00:59:09.370 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 668 sec 2024-05-04T00:59:10.370 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 669 sec 2024-05-04T00:59:11.371 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 670 sec 2024-05-04T00:59:12.371 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 671 sec 2024-05-04T00:59:13.371 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 672 sec 2024-05-04T00:59:14.371 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 673 sec 2024-05-04T00:59:15.371 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 674 sec 2024-05-04T00:59:16.371 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 675 sec 2024-05-04T00:59:17.371 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 676 sec 2024-05-04T00:59:18.371 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 677 sec 2024-05-04T00:59:19.371 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 678 sec 2024-05-04T00:59:20.371 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 679 sec 2024-05-04T00:59:21.371 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 680 sec 2024-05-04T00:59:22.371 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 681 sec 2024-05-04T00:59:23.372 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 682 sec 2024-05-04T00:59:23.670 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:59:23.673 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:59:24.372 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 683 sec 2024-05-04T00:59:25.372 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 684 sec 2024-05-04T00:59:26.372 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 685 sec 2024-05-04T00:59:27.372 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 686 sec 2024-05-04T00:59:28.372 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 687 sec 2024-05-04T00:59:29.372 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 688 sec 2024-05-04T00:59:30.372 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 689 sec 2024-05-04T00:59:31.372 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 690 sec 2024-05-04T00:59:32.372 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 691 sec 2024-05-04T00:59:33.372 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 692 sec 2024-05-04T00:59:34.372 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 693 sec 2024-05-04T00:59:35.373 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 694 sec 2024-05-04T00:59:36.373 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 695 sec 2024-05-04T00:59:37.373 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 696 sec 2024-05-04T00:59:38.373 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 697 sec 2024-05-04T00:59:39.373 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 698 sec 2024-05-04T00:59:40.373 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 699 sec 2024-05-04T00:59:41.373 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 700 sec 2024-05-04T00:59:42.373 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 701 sec 2024-05-04T00:59:43.373 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 702 sec 2024-05-04T00:59:44.373 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 703 sec 2024-05-04T00:59:45.373 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 704 sec 2024-05-04T00:59:46.374 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 705 sec 2024-05-04T00:59:47.374 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 706 sec 2024-05-04T00:59:48.374 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 707 sec 2024-05-04T00:59:49.374 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 708 sec 2024-05-04T00:59:50.374 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 709 sec 2024-05-04T00:59:51.374 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 710 sec 2024-05-04T00:59:52.374 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 711 sec 2024-05-04T00:59:53.374 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 712 sec 2024-05-04T00:59:53.725 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:59:53.728 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T00:59:54.374 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 713 sec 2024-05-04T00:59:55.374 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 714 sec 2024-05-04T00:59:56.374 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 715 sec 2024-05-04T00:59:57.374 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 716 sec 2024-05-04T00:59:58.375 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 717 sec 2024-05-04T00:59:59.374 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 718 sec 2024-05-04T01:00:00.375 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 719 sec 2024-05-04T01:00:01.375 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 720 sec 2024-05-04T01:00:02.375 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 721 sec 2024-05-04T01:00:03.375 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 722 sec 2024-05-04T01:00:04.375 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 723 sec 2024-05-04T01:00:05.375 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 724 sec 2024-05-04T01:00:06.375 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 725 sec 2024-05-04T01:00:07.375 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 726 sec 2024-05-04T01:00:08.375 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 727 sec 2024-05-04T01:00:09.375 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 728 sec 2024-05-04T01:00:10.375 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 729 sec 2024-05-04T01:00:11.375 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 730 sec 2024-05-04T01:00:12.375 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 731 sec 2024-05-04T01:00:13.375 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 732 sec 2024-05-04T01:00:14.376 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 733 sec 2024-05-04T01:00:15.376 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 734 sec 2024-05-04T01:00:16.376 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 735 sec 2024-05-04T01:00:17.376 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 736 sec 2024-05-04T01:00:18.376 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 737 sec 2024-05-04T01:00:19.376 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 738 sec 2024-05-04T01:00:20.376 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 739 sec 2024-05-04T01:00:21.376 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 740 sec 2024-05-04T01:00:22.376 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 741 sec 2024-05-04T01:00:23.376 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 742 sec 2024-05-04T01:00:23.773 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:00:23.776 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:00:24.376 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 743 sec 2024-05-04T01:00:25.377 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 744 sec 2024-05-04T01:00:26.377 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 745 sec 2024-05-04T01:00:27.377 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 746 sec 2024-05-04T01:00:28.377 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 747 sec 2024-05-04T01:00:29.377 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 748 sec 2024-05-04T01:00:30.377 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 749 sec 2024-05-04T01:00:31.377 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 750 sec 2024-05-04T01:00:32.377 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 751 sec 2024-05-04T01:00:33.377 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 752 sec 2024-05-04T01:00:34.377 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 753 sec 2024-05-04T01:00:35.377 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 754 sec 2024-05-04T01:00:36.377 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 755 sec 2024-05-04T01:00:37.378 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 756 sec 2024-05-04T01:00:38.378 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 757 sec 2024-05-04T01:00:39.378 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 758 sec 2024-05-04T01:00:40.378 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 759 sec 2024-05-04T01:00:41.378 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 760 sec 2024-05-04T01:00:42.378 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 761 sec 2024-05-04T01:00:43.378 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 762 sec 2024-05-04T01:00:44.378 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 763 sec 2024-05-04T01:00:45.378 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 764 sec 2024-05-04T01:00:46.378 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 765 sec 2024-05-04T01:00:47.381 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 766 sec 2024-05-04T01:00:48.378 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 767 sec 2024-05-04T01:00:49.378 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 768 sec 2024-05-04T01:00:50.378 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 769 sec 2024-05-04T01:00:51.379 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 770 sec 2024-05-04T01:00:52.379 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 771 sec 2024-05-04T01:00:53.379 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 772 sec 2024-05-04T01:00:53.844 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:00:53.847 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:00:54.379 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 773 sec 2024-05-04T01:00:55.379 INFO:tasks.workunit.client.0.smithi006.stdout: 9 cleanup 774 sec 2024-05-04T01:00:56.379 INFO:tasks.workunit.client.0.smithi006.stdout: 9 cleanup 775 sec 2024-05-04T01:00:57.379 INFO:tasks.workunit.client.0.smithi006.stdout: 9 cleanup 776 sec 2024-05-04T01:00:58.379 INFO:tasks.workunit.client.0.smithi006.stdout: 9 cleanup 777 sec 2024-05-04T01:00:59.379 INFO:tasks.workunit.client.0.smithi006.stdout: 9 cleanup 778 sec 2024-05-04T01:01:00.379 INFO:tasks.workunit.client.0.smithi006.stdout: 9 cleanup 779 sec 2024-05-04T01:01:01.379 INFO:tasks.workunit.client.0.smithi006.stdout: 9 cleanup 780 sec 2024-05-04T01:01:02.380 INFO:tasks.workunit.client.0.smithi006.stdout: 9 cleanup 781 sec 2024-05-04T01:01:03.380 INFO:tasks.workunit.client.0.smithi006.stdout: 9 cleanup 782 sec 2024-05-04T01:01:04.380 INFO:tasks.workunit.client.0.smithi006.stdout: 9 cleanup 783 sec 2024-05-04T01:01:05.380 INFO:tasks.workunit.client.0.smithi006.stdout: 9 cleanup 784 sec 2024-05-04T01:01:06.380 INFO:tasks.workunit.client.0.smithi006.stdout: 9 cleanup 785 sec 2024-05-04T01:01:07.380 INFO:tasks.workunit.client.0.smithi006.stdout: 9 cleanup 786 sec 2024-05-04T01:01:08.380 INFO:tasks.workunit.client.0.smithi006.stdout: 9 cleanup 787 sec 2024-05-04T01:01:09.380 INFO:tasks.workunit.client.0.smithi006.stdout: 9 cleanup 788 sec 2024-05-04T01:01:10.380 INFO:tasks.workunit.client.0.smithi006.stdout: 9 cleanup 789 sec 2024-05-04T01:01:11.380 INFO:tasks.workunit.client.0.smithi006.stdout: 9 cleanup 790 sec 2024-05-04T01:01:12.380 INFO:tasks.workunit.client.0.smithi006.stdout: 9 cleanup 791 sec 2024-05-04T01:01:13.380 INFO:tasks.workunit.client.0.smithi006.stdout: 8 cleanup 792 sec 2024-05-04T01:01:14.380 INFO:tasks.workunit.client.0.smithi006.stdout: 8 cleanup 793 sec 2024-05-04T01:01:15.381 INFO:tasks.workunit.client.0.smithi006.stdout: 8 cleanup 794 sec 2024-05-04T01:01:16.381 INFO:tasks.workunit.client.0.smithi006.stdout: 8 cleanup 795 sec 2024-05-04T01:01:17.381 INFO:tasks.workunit.client.0.smithi006.stdout: 8 cleanup 796 sec 2024-05-04T01:01:18.381 INFO:tasks.workunit.client.0.smithi006.stdout: 7 cleanup 797 sec 2024-05-04T01:01:19.381 INFO:tasks.workunit.client.0.smithi006.stdout: 7 cleanup 798 sec 2024-05-04T01:01:20.381 INFO:tasks.workunit.client.0.smithi006.stdout: 6 cleanup 799 sec 2024-05-04T01:01:21.381 INFO:tasks.workunit.client.0.smithi006.stdout: 6 cleanup 800 sec 2024-05-04T01:01:22.381 INFO:tasks.workunit.client.0.smithi006.stdout: 4 cleanup 801 sec 2024-05-04T01:01:23.079 INFO:tasks.workunit.client.0.smithi006.stdout: 0 cleanup 802 sec 2024-05-04T01:01:23.080 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-05-04T01:01:23.080 INFO:tasks.workunit.client.0.smithi006.stdout: Operation Count AvgLat MaxLat 2024-05-04T01:01:23.080 INFO:tasks.workunit.client.0.smithi006.stdout: ---------------------------------------- 2024-05-04T01:01:23.080 INFO:tasks.workunit.client.0.smithi006.stdout: NTCreateX 1399 1501.004 6263.501 2024-05-04T01:01:23.080 INFO:tasks.workunit.client.0.smithi006.stdout: Close 1300 7.985 172.617 2024-05-04T01:01:23.080 INFO:tasks.workunit.client.0.smithi006.stdout: Rename 100 2522.306 4451.361 2024-05-04T01:01:23.080 INFO:tasks.workunit.client.0.smithi006.stdout: Unlink 151 937.097 3109.101 2024-05-04T01:01:23.080 INFO:tasks.workunit.client.0.smithi006.stdout: Qpathinfo 864 606.910 4282.160 2024-05-04T01:01:23.080 INFO:tasks.workunit.client.0.smithi006.stdout: Qfileinfo 583 31.348 304.807 2024-05-04T01:01:23.080 INFO:tasks.workunit.client.0.smithi006.stdout: Qfsinfo 294 86.121 262.485 2024-05-04T01:01:23.080 INFO:tasks.workunit.client.0.smithi006.stdout: Sfileinfo 312 171.967 622.505 2024-05-04T01:01:23.080 INFO:tasks.workunit.client.0.smithi006.stdout: Find 388 6774.599 13364.141 2024-05-04T01:01:23.081 INFO:tasks.workunit.client.0.smithi006.stdout: WriteX 2799 46.659 963.924 2024-05-04T01:01:23.081 INFO:tasks.workunit.client.0.smithi006.stdout: ReadX 1382 0.236 38.246 2024-05-04T01:01:23.081 INFO:tasks.workunit.client.0.smithi006.stdout: Flush 240 743.890 2342.372 2024-05-04T01:01:23.081 INFO:tasks.workunit.client.0.smithi006.stdout: 2024-05-04T01:01:23.081 INFO:tasks.workunit.client.0.smithi006.stdout:Throughput 0.211758 MB/sec 10 clients 10 procs max_latency=13364.151 ms 2024-05-04T01:01:23.082 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-04T01:01:23.082 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-04T01:01:23.949 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:01:23.952 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:01:54.071 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:01:54.075 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:02:24.185 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:02:24.189 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:02:28.214 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-05-04T01:02:28.214 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-04T01:02:28.533 DEBUG:teuthology.parallel:result is None 2024-05-04T01:02:28.533 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-04T01:02:29.134 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-04T01:02:29.135 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-04T01:02:29.150 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-04T01:02:29.150 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T01:02:29.150 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T01:02:29.156 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T01:02:29.156 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T01:02:29.203 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-04T01:02:29.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.401+0000 7f515741b640 1 Processor -- start 2024-05-04T01:02:29.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.401+0000 7f515741b640 1 -- start start 2024-05-04T01:02:29.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.405+0000 7f515741b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51500c8ae0 0x7f51500c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:29.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.405+0000 7f515741b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51500cde30 0x7f51500ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:29.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.405+0000 7f515741b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51500c39e0 con 0x7f515015f9b0 2024-05-04T01:02:29.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.405+0000 7f515741b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f51500c3cc0 con 0x7f51500cde30 2024-05-04T01:02:29.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.405+0000 7f515741b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f51500c3fa0 con 0x7f51500c8ae0 2024-05-04T01:02:29.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.405+0000 7f51549b6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51500cde30 0x7f51500ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:29.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.405+0000 7f51549b6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51500cde30 0x7f51500ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40102/0 (socket says 172.21.15.6:40102) 2024-05-04T01:02:29.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.405+0000 7f51549b6640 1 -- 172.21.15.6:0/3198125115 learned_addr learned my addr 172.21.15.6:0/3198125115 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:29.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.405+0000 7f51551b7640 1 --2- 172.21.15.6:0/3198125115 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51500c8ae0 0x7f51500c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:29.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.409+0000 7f51549b6640 1 -- 172.21.15.6:0/3198125115 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51500c8ae0 msgr2=0x7f51500c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:29.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.409+0000 7f51549b6640 1 --2- 172.21.15.6:0/3198125115 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51500c8ae0 0x7f51500c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:29.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.409+0000 7f51549b6640 1 -- 172.21.15.6:0/3198125115 >> v1:172.21.15.6:6789/0 conn(0x7f515015f9b0 legacy=0x7f515015fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:29.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.409+0000 7f51549b6640 1 -- 172.21.15.6:0/3198125115 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51500c4280 con 0x7f51500cde30 2024-05-04T01:02:29.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.413+0000 7f51549b6640 1 --2- 172.21.15.6:0/3198125115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51500cde30 0x7f51500ce240 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5140009870 tx=0x7f514001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99fd440f1d46ffa server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.421+0000 7f5147fff640 1 -- 172.21.15.6:0/3198125115 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51400b5070 con 0x7f51500cde30 2024-05-04T01:02:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.421+0000 7f5147fff640 1 -- 172.21.15.6:0/3198125115 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51400a8a50 con 0x7f51500cde30 2024-05-04T01:02:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.421+0000 7f5147fff640 1 -- 172.21.15.6:0/3198125115 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51400a8e20 con 0x7f51500cde30 2024-05-04T01:02:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.421+0000 7f515741b640 1 -- 172.21.15.6:0/3198125115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51500cde30 msgr2=0x7f51500ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.421+0000 7f515741b640 1 --2- 172.21.15.6:0/3198125115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51500cde30 0x7f51500ce240 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5140009870 tx=0x7f514001ed50 comp rx=0 tx=0).stop 2024-05-04T01:02:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.421+0000 7f515741b640 1 -- 172.21.15.6:0/3198125115 shutdown_connections 2024-05-04T01:02:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.421+0000 7f515741b640 1 --2- 172.21.15.6:0/3198125115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51500cde30 0x7f51500ce240 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.421+0000 7f515741b640 1 --2- 172.21.15.6:0/3198125115 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51500c8ae0 0x7f51500c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.421+0000 7f515741b640 1 -- 172.21.15.6:0/3198125115 >> 172.21.15.6:0/3198125115 conn(0x7f5150070d60 msgr2=0x7f51500711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.425+0000 7f515741b640 1 -- 172.21.15.6:0/3198125115 shutdown_connections 2024-05-04T01:02:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.425+0000 7f515741b640 1 -- 172.21.15.6:0/3198125115 wait complete. 2024-05-04T01:02:29.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.425+0000 7f515741b640 1 Processor -- start 2024-05-04T01:02:29.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.425+0000 7f515741b640 1 -- start start 2024-05-04T01:02:29.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.425+0000 7f515741b640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51500c8ae0 0x7f515015d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:29.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.425+0000 7f515741b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51500cde30 0x7f5150147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:29.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.425+0000 7f515741b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515015f9b0 0x7f51500ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:29.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.425+0000 7f515741b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f51500c49c0 con 0x7f515015f9b0 2024-05-04T01:02:29.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.425+0000 7f515741b640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f51500c4840 con 0x7f51500c8ae0 2024-05-04T01:02:29.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.425+0000 7f515741b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f51501566a0 con 0x7f51500cde30 2024-05-04T01:02:29.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.425+0000 7f51559b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515015f9b0 0x7f51500ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:29.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.429+0000 7f51559b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515015f9b0 0x7f51500ccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40118/0 (socket says 172.21.15.6:40118) 2024-05-04T01:02:29.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.429+0000 7f51559b8640 1 -- 172.21.15.6:0/919964919 learned_addr learned my addr 172.21.15.6:0/919964919 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:29.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.429+0000 7f51549b6640 1 --2- 172.21.15.6:0/919964919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51500cde30 0x7f5150147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:29.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.429+0000 7f51551b7640 1 --2- 172.21.15.6:0/919964919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51500c8ae0 0x7f515015d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:29.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.433+0000 7f51559b8640 1 -- 172.21.15.6:0/919964919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51500cde30 msgr2=0x7f5150147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:29.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.433+0000 7f51559b8640 1 --2- 172.21.15.6:0/919964919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51500cde30 0x7f5150147700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:29.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.433+0000 7f51559b8640 1 -- 172.21.15.6:0/919964919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51500c8ae0 msgr2=0x7f515015d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:29.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.433+0000 7f51559b8640 1 --2- 172.21.15.6:0/919964919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51500c8ae0 0x7f515015d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:29.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.433+0000 7f51559b8640 1 -- 172.21.15.6:0/919964919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515015dde0 con 0x7f515015f9b0 2024-05-04T01:02:29.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.433+0000 7f51559b8640 1 --2- 172.21.15.6:0/919964919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515015f9b0 0x7f51500ccb10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f514800c340 tx=0x7f514800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:29.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.437+0000 7f5145ffb640 1 -- 172.21.15.6:0/919964919 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5148017070 con 0x7f515015f9b0 2024-05-04T01:02:29.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.437+0000 7f5145ffb640 1 -- 172.21.15.6:0/919964919 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51480052d0 con 0x7f515015f9b0 2024-05-04T01:02:29.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.437+0000 7f5145ffb640 1 -- 172.21.15.6:0/919964919 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51480054c0 con 0x7f515015f9b0 2024-05-04T01:02:29.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.437+0000 7f515741b640 1 -- 172.21.15.6:0/919964919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f515015ef50 con 0x7f515015f9b0 2024-05-04T01:02:29.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.441+0000 7f515741b640 1 -- 172.21.15.6:0/919964919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51500cd740 con 0x7f515015f9b0 2024-05-04T01:02:29.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.441+0000 7f515741b640 1 -- 172.21.15.6:0/919964919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5150069a50 con 0x7f515015f9b0 2024-05-04T01:02:29.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.777+0000 7f5145ffb640 1 -- 172.21.15.6:0/919964919 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f514801a070 con 0x7f515015f9b0 2024-05-04T01:02:29.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.781+0000 7f5145ffb640 1 --2- 172.21.15.6:0/919964919 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f513406f400 0x7f5134071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:29.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.781+0000 7f51551b7640 1 --2- 172.21.15.6:0/919964919 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f513406f400 0x7f5134071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:29.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.781+0000 7f51551b7640 1 --2- 172.21.15.6:0/919964919 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f513406f400 0x7f5134071910 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f514c011340 tx=0x7f514c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:29.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.821+0000 7f5145ffb640 1 -- 172.21.15.6:0/919964919 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f51480574c0 con 0x7f515015f9b0 2024-05-04T01:02:29.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:29.825+0000 7f5145ffb640 1 -- 172.21.15.6:0/919964919 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5148021020 con 0x7f515015f9b0 2024-05-04T01:02:30.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.017+0000 7f515741b640 1 -- 172.21.15.6:0/919964919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f51500ca430 con 0x7f515015f9b0 2024-05-04T01:02:30.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.041+0000 7f5145ffb640 1 -- 172.21.15.6:0/919964919 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f514805b230 con 0x7f515015f9b0 2024-05-04T01:02:30.046 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-04T01:02:30.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.045+0000 7f515741b640 1 -- 172.21.15.6:0/919964919 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f513406f400 msgr2=0x7f5134071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:30.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.045+0000 7f515741b640 1 --2- 172.21.15.6:0/919964919 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f513406f400 0x7f5134071910 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f514c011340 tx=0x7f514c00b040 comp rx=0 tx=0).stop 2024-05-04T01:02:30.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.045+0000 7f515741b640 1 -- 172.21.15.6:0/919964919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515015f9b0 msgr2=0x7f51500ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:30.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.045+0000 7f515741b640 1 --2- 172.21.15.6:0/919964919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515015f9b0 0x7f51500ccb10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f514800c340 tx=0x7f514800c800 comp rx=0 tx=0).stop 2024-05-04T01:02:30.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.045+0000 7f515741b640 1 -- 172.21.15.6:0/919964919 shutdown_connections 2024-05-04T01:02:30.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.045+0000 7f515741b640 1 --2- 172.21.15.6:0/919964919 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f513406f400 0x7f5134071910 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:30.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.045+0000 7f515741b640 1 --2- 172.21.15.6:0/919964919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515015f9b0 0x7f51500ccb10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:30.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.045+0000 7f515741b640 1 --2- 172.21.15.6:0/919964919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51500cde30 0x7f5150147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:30.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.045+0000 7f515741b640 1 --2- 172.21.15.6:0/919964919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51500c8ae0 0x7f515015d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:30.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.045+0000 7f515741b640 1 -- 172.21.15.6:0/919964919 >> 172.21.15.6:0/919964919 conn(0x7f5150070d60 msgr2=0x7f5150149550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:30.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.045+0000 7f515741b640 1 -- 172.21.15.6:0/919964919 shutdown_connections 2024-05-04T01:02:30.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.045+0000 7f515741b640 1 -- 172.21.15.6:0/919964919 wait complete. 2024-05-04T01:02:30.073 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-04T01:02:30.073 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T01:02:30.078 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-04T01:02:30.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.285+0000 7fa09fa2f640 1 Processor -- start 2024-05-04T01:02:30.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.285+0000 7fa09fa2f640 1 -- start start 2024-05-04T01:02:30.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.285+0000 7fa09fa2f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0980b3c60 0x7fa09815a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:30.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.285+0000 7fa09fa2f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa0980c88b0 0x7fa0980cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:30.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.285+0000 7fa09fa2f640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0981546d0 con 0x7fa0980c8cc0 2024-05-04T01:02:30.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.285+0000 7fa09fa2f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa0980c3030 con 0x7fa0980b3c60 2024-05-04T01:02:30.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.285+0000 7fa09fa2f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa0980c3310 con 0x7fa0980c88b0 2024-05-04T01:02:30.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.289+0000 7fa09d7cb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0980b3c60 0x7fa09815a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:30.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.289+0000 7fa09cfca640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa0980c88b0 0x7fa0980cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:30.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.289+0000 7fa09d7cb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0980b3c60 0x7fa09815a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40130/0 (socket says 172.21.15.6:40130) 2024-05-04T01:02:30.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.289+0000 7fa09d7cb640 1 -- 172.21.15.6:0/2196452910 learned_addr learned my addr 172.21.15.6:0/2196452910 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:30.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.289+0000 7fa09d7cb640 1 -- 172.21.15.6:0/2196452910 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa0980c88b0 msgr2=0x7fa0980cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:30.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.289+0000 7fa09d7cb640 1 --2- 172.21.15.6:0/2196452910 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa0980c88b0 0x7fa0980cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:30.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.289+0000 7fa09d7cb640 1 -- 172.21.15.6:0/2196452910 >> v1:172.21.15.163:6789/0 conn(0x7fa0980c8cc0 legacy=0x7fa09815d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:30.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.289+0000 7fa09d7cb640 1 -- 172.21.15.6:0/2196452910 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0980c35f0 con 0x7fa0980b3c60 2024-05-04T01:02:30.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.293+0000 7fa09d7cb640 1 --2- 172.21.15.6:0/2196452910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0980b3c60 0x7fa09815a920 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa088009870 tx=0x7fa08801eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ea0d4c2e796b94 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:30.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.301+0000 7fa08ffff640 1 -- 172.21.15.6:0/2196452910 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0880b5070 con 0x7fa0980b3c60 2024-05-04T01:02:30.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.301+0000 7fa08ffff640 1 -- 172.21.15.6:0/2196452910 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0880a87f0 con 0x7fa0980b3c60 2024-05-04T01:02:30.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.301+0000 7fa08ffff640 1 -- 172.21.15.6:0/2196452910 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0880a8bc0 con 0x7fa0980b3c60 2024-05-04T01:02:30.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.301+0000 7fa09fa2f640 1 -- 172.21.15.6:0/2196452910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0980b3c60 msgr2=0x7fa09815a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:30.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.301+0000 7fa09fa2f640 1 --2- 172.21.15.6:0/2196452910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0980b3c60 0x7fa09815a920 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa088009870 tx=0x7fa08801eb70 comp rx=0 tx=0).stop 2024-05-04T01:02:30.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.301+0000 7fa09fa2f640 1 -- 172.21.15.6:0/2196452910 shutdown_connections 2024-05-04T01:02:30.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.301+0000 7fa09fa2f640 1 --2- 172.21.15.6:0/2196452910 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa0980c88b0 0x7fa0980cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:30.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.301+0000 7fa09fa2f640 1 --2- 172.21.15.6:0/2196452910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0980b3c60 0x7fa09815a920 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:30.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.301+0000 7fa09fa2f640 1 -- 172.21.15.6:0/2196452910 >> 172.21.15.6:0/2196452910 conn(0x7fa098070d60 msgr2=0x7fa0980711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:30.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.301+0000 7fa09fa2f640 1 -- 172.21.15.6:0/2196452910 shutdown_connections 2024-05-04T01:02:30.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.301+0000 7fa09fa2f640 1 -- 172.21.15.6:0/2196452910 wait complete. 2024-05-04T01:02:30.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.305+0000 7fa09fa2f640 1 Processor -- start 2024-05-04T01:02:30.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.305+0000 7fa09fa2f640 1 -- start start 2024-05-04T01:02:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.305+0000 7fa09fa2f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0980b3c60 0x7fa09814f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.305+0000 7fa09fa2f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa0980c88b0 0x7fa0980c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.305+0000 7fa09fa2f640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa0980c8cc0 0x7fa09814e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.305+0000 7fa09fa2f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa0980c38d0 con 0x7fa0980b3c60 2024-05-04T01:02:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.305+0000 7fa09fa2f640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa09815a400 con 0x7fa0980c8cc0 2024-05-04T01:02:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.305+0000 7fa09fa2f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa09815ae60 con 0x7fa0980c88b0 2024-05-04T01:02:30.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.305+0000 7fa09d7cb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0980b3c60 0x7fa09814f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:30.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.305+0000 7fa09d7cb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0980b3c60 0x7fa09814f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40140/0 (socket says 172.21.15.6:40140) 2024-05-04T01:02:30.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.305+0000 7fa09d7cb640 1 -- 172.21.15.6:0/457706905 learned_addr learned my addr 172.21.15.6:0/457706905 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:30.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.309+0000 7fa09cfca640 1 --2- 172.21.15.6:0/457706905 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa0980c88b0 0x7fa0980c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:30.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.309+0000 7fa09dfcc640 1 --2- 172.21.15.6:0/457706905 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa0980c8cc0 0x7fa09814e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:30.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.313+0000 7fa09d7cb640 1 -- 172.21.15.6:0/457706905 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa0980c88b0 msgr2=0x7fa0980c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:30.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.313+0000 7fa09d7cb640 1 --2- 172.21.15.6:0/457706905 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa0980c88b0 0x7fa0980c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:30.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.313+0000 7fa09d7cb640 1 -- 172.21.15.6:0/457706905 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa0980c8cc0 msgr2=0x7fa09814e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:30.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.313+0000 7fa09d7cb640 1 --2- 172.21.15.6:0/457706905 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa0980c8cc0 0x7fa09814e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:30.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.313+0000 7fa09d7cb640 1 -- 172.21.15.6:0/457706905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0980c99c0 con 0x7fa0980b3c60 2024-05-04T01:02:30.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.313+0000 7fa09d7cb640 1 --2- 172.21.15.6:0/457706905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0980b3c60 0x7fa09814f920 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa08801d220 tx=0x7fa08801b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:30.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.317+0000 7fa08dffb640 1 -- 172.21.15.6:0/457706905 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0880be070 con 0x7fa0980b3c60 2024-05-04T01:02:30.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.317+0000 7fa08dffb640 1 -- 172.21.15.6:0/457706905 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0880b0640 con 0x7fa0980b3c60 2024-05-04T01:02:30.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.317+0000 7fa09fa2f640 1 -- 172.21.15.6:0/457706905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0980cd1f0 con 0x7fa0980b3c60 2024-05-04T01:02:30.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.317+0000 7fa08dffb640 1 -- 172.21.15.6:0/457706905 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0880b5040 con 0x7fa0980b3c60 2024-05-04T01:02:30.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.317+0000 7fa09fa2f640 1 -- 172.21.15.6:0/457706905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0980c53b0 con 0x7fa0980b3c60 2024-05-04T01:02:30.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.321+0000 7fa09fa2f640 1 -- 172.21.15.6:0/457706905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa098069a50 con 0x7fa0980b3c60 2024-05-04T01:02:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.345+0000 7fa08dffb640 1 -- 172.21.15.6:0/457706905 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa0880c1070 con 0x7fa0980b3c60 2024-05-04T01:02:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.345+0000 7fa08dffb640 1 --2- 172.21.15.6:0/457706905 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fa07c06f450 0x7fa07c071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.349+0000 7fa09cfca640 1 --2- 172.21.15.6:0/457706905 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fa07c06f450 0x7fa07c071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:30.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.349+0000 7fa09cfca640 1 --2- 172.21.15.6:0/457706905 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fa07c06f450 0x7fa07c071960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa09806a780 tx=0x7fa094009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:30.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.665+0000 7fa08dffb640 1 -- 172.21.15.6:0/457706905 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7fa0880a86b0 con 0x7fa0980b3c60 2024-05-04T01:02:30.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.665+0000 7fa08dffb640 1 -- 172.21.15.6:0/457706905 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa0880c8020 con 0x7fa0980b3c60 2024-05-04T01:02:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.857+0000 7fa09fa2f640 1 -- 172.21.15.6:0/457706905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa098157930 con 0x7fa0980b3c60 2024-05-04T01:02:30.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.865+0000 7fa08dffb640 1 -- 172.21.15.6:0/457706905 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7fa0981546d0 con 0x7fa0980b3c60 2024-05-04T01:02:30.867 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-04T01:02:30.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.869+0000 7fa09fa2f640 1 -- 172.21.15.6:0/457706905 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fa07c06f450 msgr2=0x7fa07c071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.869+0000 7fa09fa2f640 1 --2- 172.21.15.6:0/457706905 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fa07c06f450 0x7fa07c071960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa09806a780 tx=0x7fa094009190 comp rx=0 tx=0).stop 2024-05-04T01:02:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.869+0000 7fa09fa2f640 1 -- 172.21.15.6:0/457706905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0980b3c60 msgr2=0x7fa09814f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.869+0000 7fa09fa2f640 1 --2- 172.21.15.6:0/457706905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0980b3c60 0x7fa09814f920 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa08801d220 tx=0x7fa08801b910 comp rx=0 tx=0).stop 2024-05-04T01:02:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.869+0000 7fa09fa2f640 1 -- 172.21.15.6:0/457706905 shutdown_connections 2024-05-04T01:02:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.869+0000 7fa09fa2f640 1 --2- 172.21.15.6:0/457706905 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa0980c8cc0 0x7fa09814e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.869+0000 7fa09fa2f640 1 --2- 172.21.15.6:0/457706905 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fa07c06f450 0x7fa07c071960 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.869+0000 7fa09fa2f640 1 --2- 172.21.15.6:0/457706905 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa0980c88b0 0x7fa0980c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.869+0000 7fa09fa2f640 1 --2- 172.21.15.6:0/457706905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0980b3c60 0x7fa09814f920 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.869+0000 7fa09fa2f640 1 -- 172.21.15.6:0/457706905 >> 172.21.15.6:0/457706905 conn(0x7fa098070d60 msgr2=0x7fa09815baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.869+0000 7fa09fa2f640 1 -- 172.21.15.6:0/457706905 shutdown_connections 2024-05-04T01:02:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:30.869+0000 7fa09fa2f640 1 -- 172.21.15.6:0/457706905 wait complete. 2024-05-04T01:02:30.893 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2024-05-04T01:02:30.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T01:02:30.893 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-04T01:02:30.919 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:02:30.961 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[34637]: fuse finished with error 0 and tester_r 0 2024-05-04T01:02:32.093 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:==00:00:30:35.639 34637== 2024-05-04T01:02:32.093 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:==00:00:30:35.639 34637== Exit program on first error (--exit-on-first-error=yes) 2024-05-04T01:02:32.271 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:daemon-helper: command failed with exit status 42 2024-05-04T01:02:37.021 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-05-04T01:02:37.021 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-05-04T01:02:37.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T01:02:37.021 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-04T01:02:37.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T01:02:37.039 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-04T01:02:37.087 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-04T01:02:37.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T01:02:37.087 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T01:02:37.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T01:02:37.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2024-05-04T01:02:37.316 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-04T01:02:37.325 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-04T01:02:37.326 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T01:02:37.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.481+0000 7f548334a640 1 Processor -- start 2024-05-04T01:02:37.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.481+0000 7f548334a640 1 -- start start 2024-05-04T01:02:37.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.481+0000 7f548334a640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f547c0c7b20 0x7f547c0c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:37.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.481+0000 7f548334a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f547c074690 con 0x7f547c154010 2024-05-04T01:02:37.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.481+0000 7f548334a640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f547c0c9b30 con 0x7f547c15a2f0 2024-05-04T01:02:37.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.481+0000 7f548334a640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f547c074930 con 0x7f547c0c7b20 2024-05-04T01:02:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.485+0000 7f54810e6640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f547c154010 0x7f547c073f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48732/0 (socket says 172.21.15.6:48732) 2024-05-04T01:02:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.485+0000 7f54810e6640 1 -- 172.21.15.6:0/1828928791 learned_addr learned my addr 172.21.15.6:0/1828928791 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T01:02:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.485+0000 7f54808e5640 1 --2- 172.21.15.6:0/1828928791 >> v2:172.21.15.163:3300/0 conn(0x7f547c0c7b20 0x7f547c0c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:37.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.489+0000 7f5473fff640 1 -- 172.21.15.6:0/1828928791 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2706013123 0 0) 0x7f547c074690 con 0x7f547c154010 2024-05-04T01:02:37.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.489+0000 7f5473fff640 1 -- 172.21.15.6:0/1828928791 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5468003530 con 0x7f547c154010 2024-05-04T01:02:37.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.493+0000 7f54808e5640 1 -- 172.21.15.6:0/1828928791 >> v1:172.21.15.163:6789/0 conn(0x7f547c15a2f0 legacy=0x7f547c15a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:37.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.493+0000 7f54808e5640 1 -- 172.21.15.6:0/1828928791 >> v1:172.21.15.6:6789/0 conn(0x7f547c154010 legacy=0x7f547c073f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:37.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.493+0000 7f54808e5640 1 -- 172.21.15.6:0/1828928791 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547c0c8f20 con 0x7f547c0c7b20 2024-05-04T01:02:37.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.505+0000 7f54808e5640 1 --2- 172.21.15.6:0/1828928791 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f547c0c7b20 0x7f547c0c7f30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f546c0097c0 tx=0x7f546c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd4e038de462248a server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:37.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.517+0000 7f5473fff640 1 -- 172.21.15.6:0/1828928791 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c0b0070 con 0x7f547c0c7b20 2024-05-04T01:02:37.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.517+0000 7f5473fff640 1 -- 172.21.15.6:0/1828928791 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f546c0ab600 con 0x7f547c0c7b20 2024-05-04T01:02:37.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.517+0000 7f5473fff640 1 -- 172.21.15.6:0/1828928791 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c0ab9d0 con 0x7f547c0c7b20 2024-05-04T01:02:37.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.517+0000 7f548334a640 1 -- 172.21.15.6:0/1828928791 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f547c0c7b20 msgr2=0x7f547c0c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:37.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.517+0000 7f548334a640 1 --2- 172.21.15.6:0/1828928791 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f547c0c7b20 0x7f547c0c7f30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f546c0097c0 tx=0x7f546c01c410 comp rx=0 tx=0).stop 2024-05-04T01:02:37.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.517+0000 7f548334a640 1 -- 172.21.15.6:0/1828928791 shutdown_connections 2024-05-04T01:02:37.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.517+0000 7f548334a640 1 --2- 172.21.15.6:0/1828928791 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f547c0c7b20 0x7f547c0c7f30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:37.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.517+0000 7f548334a640 1 -- 172.21.15.6:0/1828928791 >> 172.21.15.6:0/1828928791 conn(0x7f547c0ce410 msgr2=0x7f547c0ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:37.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.517+0000 7f548334a640 1 -- 172.21.15.6:0/1828928791 shutdown_connections 2024-05-04T01:02:37.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.517+0000 7f548334a640 1 -- 172.21.15.6:0/1828928791 wait complete. 2024-05-04T01:02:37.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.521+0000 7f548334a640 1 Processor -- start 2024-05-04T01:02:37.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.521+0000 7f548334a640 1 -- start start 2024-05-04T01:02:37.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.521+0000 7f548334a640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f547c0c7b20 0x7f547c148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:37.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.521+0000 7f548334a640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f547c154010 0x7f547c159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:37.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.521+0000 7f548334a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f547c15a2f0 0x7f547c138b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:37.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.521+0000 7f548334a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f547c06c780 con 0x7f547c15a2f0 2024-05-04T01:02:37.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.521+0000 7f548334a640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f547c154420 con 0x7f547c0c7b20 2024-05-04T01:02:37.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.521+0000 7f548334a640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f547c168560 con 0x7f547c154010 2024-05-04T01:02:37.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.521+0000 7f54818e7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f547c15a2f0 0x7f547c138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:37.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.521+0000 7f54818e7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f547c15a2f0 0x7f547c138b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57522/0 (socket says 172.21.15.6:57522) 2024-05-04T01:02:37.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.521+0000 7f54818e7640 1 -- 172.21.15.6:0/1754178636 learned_addr learned my addr 172.21.15.6:0/1754178636 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:37.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.525+0000 7f54810e6640 1 --2- 172.21.15.6:0/1754178636 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f547c0c7b20 0x7f547c148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:37.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.525+0000 7f54808e5640 1 --2- 172.21.15.6:0/1754178636 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f547c154010 0x7f547c159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:37.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.529+0000 7f54818e7640 1 -- 172.21.15.6:0/1754178636 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f547c154010 msgr2=0x7f547c159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:37.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.529+0000 7f54818e7640 1 --2- 172.21.15.6:0/1754178636 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f547c154010 0x7f547c159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:37.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.529+0000 7f54818e7640 1 -- 172.21.15.6:0/1754178636 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f547c0c7b20 msgr2=0x7f547c148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:37.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.529+0000 7f54818e7640 1 --2- 172.21.15.6:0/1754178636 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f547c0c7b20 0x7f547c148710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:37.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.529+0000 7f54818e7640 1 -- 172.21.15.6:0/1754178636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547c0c73f0 con 0x7f547c15a2f0 2024-05-04T01:02:37.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.533+0000 7f54818e7640 1 --2- 172.21.15.6:0/1754178636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f547c15a2f0 0x7f547c138b60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f547400c6e0 tx=0x7f547400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.537+0000 7f5471ffb640 1 -- 172.21.15.6:0/1754178636 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474003b80 con 0x7f547c15a2f0 2024-05-04T01:02:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.537+0000 7f5471ffb640 1 -- 172.21.15.6:0/1754178636 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5474003d20 con 0x7f547c15a2f0 2024-05-04T01:02:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.537+0000 7f548334a640 1 -- 172.21.15.6:0/1754178636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f547c0c7690 con 0x7f547c15a2f0 2024-05-04T01:02:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.537+0000 7f5471ffb640 1 -- 172.21.15.6:0/1754178636 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54740052f0 con 0x7f547c15a2f0 2024-05-04T01:02:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.537+0000 7f548334a640 1 -- 172.21.15.6:0/1754178636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f547c1632b0 con 0x7f547c15a2f0 2024-05-04T01:02:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.537+0000 7f548334a640 1 -- 172.21.15.6:0/1754178636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f547c069a50 con 0x7f547c15a2f0 2024-05-04T01:02:37.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.861+0000 7f5471ffb640 1 -- 172.21.15.6:0/1754178636 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5474005490 con 0x7f547c15a2f0 2024-05-04T01:02:37.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.861+0000 7f5471ffb640 1 --2- 172.21.15.6:0/1754178636 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f546006f450 0x7f5460071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:37.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.861+0000 7f54810e6640 1 --2- 172.21.15.6:0/1754178636 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f546006f450 0x7f5460071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:37.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.865+0000 7f54810e6640 1 --2- 172.21.15.6:0/1754178636 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f546006f450 0x7f5460071960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5478005890 tx=0x7f5478007ce0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:37.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.885+0000 7f5471ffb640 1 -- 172.21.15.6:0/1754178636 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f5474005780 con 0x7f547c15a2f0 2024-05-04T01:02:37.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:37.885+0000 7f5471ffb640 1 -- 172.21.15.6:0/1754178636 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f547405c340 con 0x7f547c15a2f0 2024-05-04T01:02:38.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.053+0000 7f548334a640 1 -- 172.21.15.6:0/1754178636 --> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f547c0c7970 con 0x7f546006f450 2024-05-04T01:02:38.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.073+0000 7f5471ffb640 1 -- 172.21.15.6:0/1754178636 <== mgr.4103 v2:172.21.15.163:6800/2152694980 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252736 (secure 0 0 0) 0x7f547c0c7970 con 0x7f546006f450 2024-05-04T01:02:38.080 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T01:02:38.082 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-04T01:02:38.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.077+0000 7f548334a640 1 -- 172.21.15.6:0/1754178636 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f546006f450 msgr2=0x7f5460071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:38.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.077+0000 7f548334a640 1 --2- 172.21.15.6:0/1754178636 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f546006f450 0x7f5460071960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5478005890 tx=0x7f5478007ce0 comp rx=0 tx=0).stop 2024-05-04T01:02:38.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.077+0000 7f548334a640 1 -- 172.21.15.6:0/1754178636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f547c15a2f0 msgr2=0x7f547c138b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:38.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.077+0000 7f548334a640 1 --2- 172.21.15.6:0/1754178636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f547c15a2f0 0x7f547c138b60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f547400c6e0 tx=0x7f547400cba0 comp rx=0 tx=0).stop 2024-05-04T01:02:38.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.081+0000 7f548334a640 1 -- 172.21.15.6:0/1754178636 shutdown_connections 2024-05-04T01:02:38.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.081+0000 7f548334a640 1 --2- 172.21.15.6:0/1754178636 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f546006f450 0x7f5460071960 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:38.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.081+0000 7f548334a640 1 --2- 172.21.15.6:0/1754178636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f547c15a2f0 0x7f547c138b60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:38.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.081+0000 7f548334a640 1 --2- 172.21.15.6:0/1754178636 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f547c154010 0x7f547c159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:38.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.081+0000 7f548334a640 1 --2- 172.21.15.6:0/1754178636 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f547c0c7b20 0x7f547c148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:38.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.081+0000 7f548334a640 1 -- 172.21.15.6:0/1754178636 >> 172.21.15.6:0/1754178636 conn(0x7f547c0ce410 msgr2=0x7f547c152db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:38.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.081+0000 7f548334a640 1 -- 172.21.15.6:0/1754178636 shutdown_connections 2024-05-04T01:02:38.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.081+0000 7f548334a640 1 -- 172.21.15.6:0/1754178636 wait complete. 2024-05-04T01:02:38.106 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":986,"stamp":"2024-05-04T01:02:36.385060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22768727,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":531,"num_read_kb":545,"num_write":8988,"num_write_kb":276826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8056,"ondisk_log_size":8056,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":333776,"kb_used_data":46928,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754640944,"statfs":{"total":773094113280,"available":772752326656,"internally_reserved":0,"allocated":48054272,"data_stored":46427946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":108160,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":59,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005705"},"pg_stats":[{"pgid":"3.3f","version":"28'39","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.841472+0000","last_change":"2024-05-04T00:31:21.410516+0000","last_active":"2024-05-04T01:02:31.841472+0000","last_peered":"2024-05-04T01:02:31.841472+0000","last_clean":"2024-05-04T01:02:31.841472+0000","last_became_active":"2024-05-04T00:31:21.409386+0000","last_became_peered":"2024-05-04T00:31:21.409386+0000","last_unstale":"2024-05-04T01:02:31.841472+0000","last_undegraded":"2024-05-04T01:02:31.841472+0000","last_fullsized":"2024-05-04T01:02:31.841472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:09:40.562107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":2475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'39","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.471532+0000","last_change":"2024-05-04T00:31:21.397440+0000","last_active":"2024-05-04T01:02:31.471532+0000","last_peered":"2024-05-04T01:02:31.471532+0000","last_clean":"2024-05-04T01:02:31.471532+0000","last_became_active":"2024-05-04T00:31:21.396255+0000","last_became_peered":"2024-05-04T00:31:21.396255+0000","last_unstale":"2024-05-04T01:02:31.471532+0000","last_undegraded":"2024-05-04T01:02:31.471532+0000","last_fullsized":"2024-05-04T01:02:31.471532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:07.460897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":1259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'53","reported_seq":89,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.469843+0000","last_change":"2024-05-04T00:31:21.442932+0000","last_active":"2024-05-04T01:02:31.469843+0000","last_peered":"2024-05-04T01:02:31.469843+0000","last_clean":"2024-05-04T01:02:31.469843+0000","last_became_active":"2024-05-04T00:31:21.442507+0000","last_became_peered":"2024-05-04T00:31:21.442507+0000","last_unstale":"2024-05-04T01:02:31.469843+0000","last_undegraded":"2024-05-04T01:02:31.469843+0000","last_fullsized":"2024-05-04T01:02:31.469843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:52:48.345813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":2592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"28'34","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.685927+0000","last_change":"2024-05-04T00:31:21.442087+0000","last_active":"2024-05-04T01:02:31.685927+0000","last_peered":"2024-05-04T01:02:31.685927+0000","last_clean":"2024-05-04T01:02:31.685927+0000","last_became_active":"2024-05-04T00:31:21.440935+0000","last_became_peered":"2024-05-04T00:31:21.440935+0000","last_unstale":"2024-05-04T01:02:31.685927+0000","last_undegraded":"2024-05-04T01:02:31.685927+0000","last_fullsized":"2024-05-04T01:02:31.685927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:02:02.166274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":1417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'35","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.835987+0000","last_change":"2024-05-04T00:31:21.408892+0000","last_active":"2024-05-04T01:02:31.835987+0000","last_peered":"2024-05-04T01:02:31.835987+0000","last_clean":"2024-05-04T01:02:31.835987+0000","last_became_active":"2024-05-04T00:31:21.402554+0000","last_became_peered":"2024-05-04T00:31:21.402554+0000","last_unstale":"2024-05-04T01:02:31.835987+0000","last_undegraded":"2024-05-04T01:02:31.835987+0000","last_fullsized":"2024-05-04T01:02:31.835987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:07.135906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":2934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'51","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.677056+0000","last_change":"2024-05-04T00:31:21.442773+0000","last_active":"2024-05-04T01:02:31.677056+0000","last_peered":"2024-05-04T01:02:31.677056+0000","last_clean":"2024-05-04T01:02:31.677056+0000","last_became_active":"2024-05-04T00:31:21.441082+0000","last_became_peered":"2024-05-04T00:31:21.441082+0000","last_unstale":"2024-05-04T01:02:31.677056+0000","last_undegraded":"2024-05-04T01:02:31.677056+0000","last_fullsized":"2024-05-04T01:02:31.677056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:54.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":4527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"28'38","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.824772+0000","last_change":"2024-05-04T00:31:21.441617+0000","last_active":"2024-05-04T01:02:31.824772+0000","last_peered":"2024-05-04T01:02:31.824772+0000","last_clean":"2024-05-04T01:02:31.824772+0000","last_became_active":"2024-05-04T00:31:21.440766+0000","last_became_peered":"2024-05-04T00:31:21.440766+0000","last_unstale":"2024-05-04T01:02:31.824772+0000","last_undegraded":"2024-05-04T01:02:31.824772+0000","last_fullsized":"2024-05-04T01:02:31.824772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:28:07.779536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":2716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"28'27","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.469564+0000","last_change":"2024-05-04T00:31:21.408515+0000","last_active":"2024-05-04T01:02:31.469564+0000","last_peered":"2024-05-04T01:02:31.469564+0000","last_clean":"2024-05-04T01:02:31.469564+0000","last_became_active":"2024-05-04T00:31:21.407785+0000","last_became_peered":"2024-05-04T00:31:21.407785+0000","last_unstale":"2024-05-04T01:02:31.469564+0000","last_undegraded":"2024-05-04T01:02:31.469564+0000","last_fullsized":"2024-05-04T01:02:31.469564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:42.617159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"28'58","reported_seq":91,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.367510+0000","last_change":"2024-05-04T00:31:21.400836+0000","last_active":"2024-05-04T01:02:31.367510+0000","last_peered":"2024-05-04T01:02:31.367510+0000","last_clean":"2024-05-04T01:02:31.367510+0000","last_became_active":"2024-05-04T00:31:21.400001+0000","last_became_peered":"2024-05-04T00:31:21.400001+0000","last_unstale":"2024-05-04T01:02:31.367510+0000","last_undegraded":"2024-05-04T01:02:31.367510+0000","last_fullsized":"2024-05-04T01:02:31.367510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:56.687510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":3953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"28'49","reported_seq":82,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.843190+0000","last_change":"2024-05-04T00:31:21.391806+0000","last_active":"2024-05-04T01:02:31.843190+0000","last_peered":"2024-05-04T01:02:31.843190+0000","last_clean":"2024-05-04T01:02:31.843190+0000","last_became_active":"2024-05-04T00:31:21.389347+0000","last_became_peered":"2024-05-04T00:31:21.389347+0000","last_unstale":"2024-05-04T01:02:31.843190+0000","last_undegraded":"2024-05-04T01:02:31.843190+0000","last_fullsized":"2024-05-04T01:02:31.843190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:40:12.379274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":5065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'36","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.843911+0000","last_change":"2024-05-04T00:31:21.396045+0000","last_active":"2024-05-04T01:02:31.843911+0000","last_peered":"2024-05-04T01:02:31.843911+0000","last_clean":"2024-05-04T01:02:31.843911+0000","last_became_active":"2024-05-04T00:31:21.385949+0000","last_became_peered":"2024-05-04T00:31:21.385949+0000","last_unstale":"2024-05-04T01:02:31.843911+0000","last_undegraded":"2024-05-04T01:02:31.843911+0000","last_fullsized":"2024-05-04T01:02:31.843911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:33.187636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"28'26","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.840904+0000","last_change":"2024-05-04T00:31:21.407987+0000","last_active":"2024-05-04T01:02:31.840904+0000","last_peered":"2024-05-04T01:02:31.840904+0000","last_clean":"2024-05-04T01:02:31.840904+0000","last_became_active":"2024-05-04T00:31:21.404557+0000","last_became_peered":"2024-05-04T00:31:21.404557+0000","last_unstale":"2024-05-04T01:02:31.840904+0000","last_undegraded":"2024-05-04T01:02:31.840904+0000","last_fullsized":"2024-05-04T01:02:31.840904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:00:51.313452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'80","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.427750+0000","last_change":"2024-05-04T00:31:21.389251+0000","last_active":"2024-05-04T01:02:31.427750+0000","last_peered":"2024-05-04T01:02:31.427750+0000","last_clean":"2024-05-04T01:02:31.427750+0000","last_became_active":"2024-05-04T00:31:21.387958+0000","last_became_peered":"2024-05-04T00:31:21.387958+0000","last_unstale":"2024-05-04T01:02:31.427750+0000","last_undegraded":"2024-05-04T01:02:31.427750+0000","last_fullsized":"2024-05-04T01:02:31.427750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:31.926158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":3559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"28'48","reported_seq":82,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.420705+0000","last_change":"2024-05-04T00:31:21.402284+0000","last_active":"2024-05-04T01:02:31.420705+0000","last_peered":"2024-05-04T01:02:31.420705+0000","last_clean":"2024-05-04T01:02:31.420705+0000","last_became_active":"2024-05-04T00:31:21.401495+0000","last_became_peered":"2024-05-04T00:31:21.401495+0000","last_unstale":"2024-05-04T01:02:31.420705+0000","last_undegraded":"2024-05-04T01:02:31.420705+0000","last_fullsized":"2024-05-04T01:02:31.420705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:09.622538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":5060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"28'52","reported_seq":86,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.443478+0000","last_change":"2024-05-04T00:31:21.410958+0000","last_active":"2024-05-04T01:02:31.443478+0000","last_peered":"2024-05-04T01:02:31.443478+0000","last_clean":"2024-05-04T01:02:31.443478+0000","last_became_active":"2024-05-04T00:31:21.410489+0000","last_became_peered":"2024-05-04T00:31:21.410489+0000","last_unstale":"2024-05-04T01:02:31.443478+0000","last_undegraded":"2024-05-04T01:02:31.443478+0000","last_fullsized":"2024-05-04T01:02:31.443478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:05:47.448392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'49","reported_seq":83,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.698662+0000","last_change":"2024-05-04T00:31:21.187055+0000","last_active":"2024-05-04T01:02:31.698662+0000","last_peered":"2024-05-04T01:02:31.698662+0000","last_clean":"2024-05-04T01:02:31.698662+0000","last_became_active":"2024-05-04T00:31:21.186141+0000","last_became_peered":"2024-05-04T00:31:21.186141+0000","last_unstale":"2024-05-04T01:02:31.698662+0000","last_undegraded":"2024-05-04T01:02:31.698662+0000","last_fullsized":"2024-05-04T01:02:31.698662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:53:13.451818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":5921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"28'39","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.685239+0000","last_change":"2024-05-04T00:31:21.406402+0000","last_active":"2024-05-04T01:02:31.685239+0000","last_peered":"2024-05-04T01:02:31.685239+0000","last_clean":"2024-05-04T01:02:31.685239+0000","last_became_active":"2024-05-04T00:31:21.389108+0000","last_became_peered":"2024-05-04T00:31:21.389108+0000","last_unstale":"2024-05-04T01:02:31.685239+0000","last_undegraded":"2024-05-04T01:02:31.685239+0000","last_fullsized":"2024-05-04T01:02:31.685239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:11:03.598993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'50","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.449234+0000","last_change":"2024-05-04T00:31:21.418601+0000","last_active":"2024-05-04T01:02:31.449234+0000","last_peered":"2024-05-04T01:02:31.449234+0000","last_clean":"2024-05-04T01:02:31.449234+0000","last_became_active":"2024-05-04T00:31:21.417914+0000","last_became_peered":"2024-05-04T00:31:21.417914+0000","last_unstale":"2024-05-04T01:02:31.449234+0000","last_undegraded":"2024-05-04T01:02:31.449234+0000","last_fullsized":"2024-05-04T01:02:31.449234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:23:35.270037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":3403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"28'50","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.692446+0000","last_change":"2024-05-04T00:31:21.441868+0000","last_active":"2024-05-04T01:02:31.692446+0000","last_peered":"2024-05-04T01:02:31.692446+0000","last_clean":"2024-05-04T01:02:31.692446+0000","last_became_active":"2024-05-04T00:31:21.440945+0000","last_became_peered":"2024-05-04T00:31:21.440945+0000","last_unstale":"2024-05-04T01:02:31.692446+0000","last_undegraded":"2024-05-04T01:02:31.692446+0000","last_fullsized":"2024-05-04T01:02:31.692446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:47:43.629512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":6197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"28'63","reported_seq":97,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.839764+0000","last_change":"2024-05-04T00:31:21.395356+0000","last_active":"2024-05-04T01:02:31.839764+0000","last_peered":"2024-05-04T01:02:31.839764+0000","last_clean":"2024-05-04T01:02:31.839764+0000","last_became_active":"2024-05-04T00:31:21.394461+0000","last_became_peered":"2024-05-04T00:31:21.394461+0000","last_unstale":"2024-05-04T01:02:31.839764+0000","last_undegraded":"2024-05-04T01:02:31.839764+0000","last_fullsized":"2024-05-04T01:02:31.839764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:42:31.303120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"28'59","reported_seq":93,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.540103+0000","last_change":"2024-05-04T00:31:21.446878+0000","last_active":"2024-05-04T01:02:31.540103+0000","last_peered":"2024-05-04T01:02:31.540103+0000","last_clean":"2024-05-04T01:02:31.540103+0000","last_became_active":"2024-05-04T00:31:21.446250+0000","last_became_peered":"2024-05-04T00:31:21.446250+0000","last_unstale":"2024-05-04T01:02:31.540103+0000","last_undegraded":"2024-05-04T01:02:31.540103+0000","last_fullsized":"2024-05-04T01:02:31.540103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:42.617159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":5743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"28'39","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.368262+0000","last_change":"2024-05-04T00:31:21.414182+0000","last_active":"2024-05-04T01:02:31.368262+0000","last_peered":"2024-05-04T01:02:31.368262+0000","last_clean":"2024-05-04T01:02:31.368262+0000","last_became_active":"2024-05-04T00:31:21.413073+0000","last_became_peered":"2024-05-04T00:31:21.413073+0000","last_unstale":"2024-05-04T01:02:31.368262+0000","last_undegraded":"2024-05-04T01:02:31.368262+0000","last_fullsized":"2024-05-04T01:02:31.368262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:23.471892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"28'57","reported_seq":91,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.457014+0000","last_change":"2024-05-04T00:31:21.403827+0000","last_active":"2024-05-04T01:02:31.457014+0000","last_peered":"2024-05-04T01:02:31.457014+0000","last_clean":"2024-05-04T01:02:31.457014+0000","last_became_active":"2024-05-04T00:31:21.402985+0000","last_became_peered":"2024-05-04T00:31:21.402985+0000","last_unstale":"2024-05-04T01:02:31.457014+0000","last_undegraded":"2024-05-04T01:02:31.457014+0000","last_fullsized":"2024-05-04T01:02:31.457014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:43:15.203235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":5055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'40","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.684142+0000","last_change":"2024-05-04T00:31:21.393270+0000","last_active":"2024-05-04T01:02:31.684142+0000","last_peered":"2024-05-04T01:02:31.684142+0000","last_clean":"2024-05-04T01:02:31.684142+0000","last_became_active":"2024-05-04T00:31:21.392368+0000","last_became_peered":"2024-05-04T00:31:21.392368+0000","last_unstale":"2024-05-04T01:02:31.684142+0000","last_undegraded":"2024-05-04T01:02:31.684142+0000","last_fullsized":"2024-05-04T01:02:31.684142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:49:22.354637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":4444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"28'33","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.431054+0000","last_change":"2024-05-04T00:31:21.416800+0000","last_active":"2024-05-04T01:02:31.431054+0000","last_peered":"2024-05-04T01:02:31.431054+0000","last_clean":"2024-05-04T01:02:31.431054+0000","last_became_active":"2024-05-04T00:31:21.415540+0000","last_became_peered":"2024-05-04T00:31:21.415540+0000","last_unstale":"2024-05-04T01:02:31.431054+0000","last_undegraded":"2024-05-04T01:02:31.431054+0000","last_fullsized":"2024-05-04T01:02:31.431054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:00:51.313452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"28'72","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.700962+0000","last_change":"2024-05-04T00:31:21.188504+0000","last_active":"2024-05-04T01:02:31.700962+0000","last_peered":"2024-05-04T01:02:31.700962+0000","last_clean":"2024-05-04T01:02:31.700962+0000","last_became_active":"2024-05-04T00:31:21.187877+0000","last_became_peered":"2024-05-04T00:31:21.187877+0000","last_unstale":"2024-05-04T01:02:31.700962+0000","last_undegraded":"2024-05-04T01:02:31.700962+0000","last_fullsized":"2024-05-04T01:02:31.700962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:48:39.671984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":3181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"28'39","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.408156+0000","last_change":"2024-05-04T00:31:21.393500+0000","last_active":"2024-05-04T01:02:31.408156+0000","last_peered":"2024-05-04T01:02:31.408156+0000","last_clean":"2024-05-04T01:02:31.408156+0000","last_became_active":"2024-05-04T00:31:21.392579+0000","last_became_peered":"2024-05-04T00:31:21.392579+0000","last_unstale":"2024-05-04T01:02:31.408156+0000","last_undegraded":"2024-05-04T01:02:31.408156+0000","last_fullsized":"2024-05-04T01:02:31.408156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:16.804136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":2828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"28'30","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.428999+0000","last_change":"2024-05-04T00:31:21.395778+0000","last_active":"2024-05-04T01:02:31.428999+0000","last_peered":"2024-05-04T01:02:31.428999+0000","last_clean":"2024-05-04T01:02:31.428999+0000","last_became_active":"2024-05-04T00:31:21.394966+0000","last_became_peered":"2024-05-04T00:31:21.394966+0000","last_unstale":"2024-05-04T01:02:31.428999+0000","last_undegraded":"2024-05-04T01:02:31.428999+0000","last_fullsized":"2024-05-04T01:02:31.428999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:53:28.166224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"28'34","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.456236+0000","last_change":"2024-05-04T00:31:21.405250+0000","last_active":"2024-05-04T01:02:31.456236+0000","last_peered":"2024-05-04T01:02:31.456236+0000","last_clean":"2024-05-04T01:02:31.456236+0000","last_became_active":"2024-05-04T00:31:21.403779+0000","last_became_peered":"2024-05-04T00:31:21.403779+0000","last_unstale":"2024-05-04T01:02:31.456236+0000","last_undegraded":"2024-05-04T01:02:31.456236+0000","last_fullsized":"2024-05-04T01:02:31.456236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:33.187636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":2736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"28'56","reported_seq":92,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.691846+0000","last_change":"2024-05-04T00:31:21.399896+0000","last_active":"2024-05-04T01:02:31.691846+0000","last_peered":"2024-05-04T01:02:31.691846+0000","last_clean":"2024-05-04T01:02:31.691846+0000","last_became_active":"2024-05-04T00:31:21.398994+0000","last_became_peered":"2024-05-04T00:31:21.398994+0000","last_unstale":"2024-05-04T01:02:31.691846+0000","last_undegraded":"2024-05-04T01:02:31.691846+0000","last_fullsized":"2024-05-04T01:02:31.691846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:32:42.591423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":5289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"28'49","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.449650+0000","last_change":"2024-05-04T00:31:21.416130+0000","last_active":"2024-05-04T01:02:31.449650+0000","last_peered":"2024-05-04T01:02:31.449650+0000","last_clean":"2024-05-04T01:02:31.449650+0000","last_became_active":"2024-05-04T00:31:21.415395+0000","last_became_peered":"2024-05-04T00:31:21.415395+0000","last_unstale":"2024-05-04T01:02:31.449650+0000","last_undegraded":"2024-05-04T01:02:31.449650+0000","last_fullsized":"2024-05-04T01:02:31.449650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:33:22.819977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":6794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'61","reported_seq":96,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.690638+0000","last_change":"2024-05-04T00:31:21.342105+0000","last_active":"2024-05-04T01:02:31.690638+0000","last_peered":"2024-05-04T01:02:31.690638+0000","last_clean":"2024-05-04T01:02:31.690638+0000","last_became_active":"2024-05-04T00:31:21.341333+0000","last_became_peered":"2024-05-04T00:31:21.341333+0000","last_unstale":"2024-05-04T01:02:31.690638+0000","last_undegraded":"2024-05-04T01:02:31.690638+0000","last_fullsized":"2024-05-04T01:02:31.690638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:23.471892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":5609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"28'25","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.370813+0000","last_change":"2024-05-04T00:31:21.405647+0000","last_active":"2024-05-04T01:02:31.370813+0000","last_peered":"2024-05-04T01:02:31.370813+0000","last_clean":"2024-05-04T01:02:31.370813+0000","last_became_active":"2024-05-04T00:31:21.403998+0000","last_became_peered":"2024-05-04T00:31:21.403998+0000","last_unstale":"2024-05-04T01:02:31.370813+0000","last_undegraded":"2024-05-04T01:02:31.370813+0000","last_fullsized":"2024-05-04T01:02:31.370813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:54.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"28'495","reported_seq":532,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:23.318163+0000","last_change":"2024-05-04T00:31:19.185018+0000","last_active":"2024-05-04T01:02:23.318163+0000","last_peered":"2024-05-04T01:02:23.318163+0000","last_clean":"2024-05-04T01:02:23.318163+0000","last_became_active":"2024-05-04T00:31:19.181107+0000","last_became_peered":"2024-05-04T00:31:19.181107+0000","last_unstale":"2024-05-04T01:02:23.318163+0000","last_undegraded":"2024-05-04T01:02:23.318163+0000","last_fullsized":"2024-05-04T01:02:23.318163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:14.453153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"28'45","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.542677+0000","last_change":"2024-05-04T00:31:21.446209+0000","last_active":"2024-05-04T01:02:31.542677+0000","last_peered":"2024-05-04T01:02:31.542677+0000","last_clean":"2024-05-04T01:02:31.542677+0000","last_became_active":"2024-05-04T00:31:21.445793+0000","last_became_peered":"2024-05-04T00:31:21.445793+0000","last_unstale":"2024-05-04T01:02:31.542677+0000","last_undegraded":"2024-05-04T01:02:31.542677+0000","last_fullsized":"2024-05-04T01:02:31.542677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:54:48.084884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"28'359","reported_seq":396,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:23.320461+0000","last_change":"2024-05-04T00:31:19.185102+0000","last_active":"2024-05-04T01:02:23.320461+0000","last_peered":"2024-05-04T01:02:23.320461+0000","last_clean":"2024-05-04T01:02:23.320461+0000","last_became_active":"2024-05-04T00:31:19.183394+0000","last_became_peered":"2024-05-04T00:31:19.183394+0000","last_unstale":"2024-05-04T01:02:23.320461+0000","last_undegraded":"2024-05-04T01:02:23.320461+0000","last_fullsized":"2024-05-04T01:02:23.320461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:36:38.420366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":4278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T00:58:02.556311+0000","last_change":"2024-05-04T00:31:19.158945+0000","last_active":"2024-05-04T00:58:02.556311+0000","last_peered":"2024-05-04T00:58:02.556311+0000","last_clean":"2024-05-04T00:58:02.556311+0000","last_became_active":"2024-05-04T00:31:19.158152+0000","last_became_peered":"2024-05-04T00:31:19.158152+0000","last_unstale":"2024-05-04T00:58:02.556311+0000","last_undegraded":"2024-05-04T00:58:02.556311+0000","last_fullsized":"2024-05-04T00:58:02.556311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:52.040804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'48","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.458775+0000","last_change":"2024-05-04T00:31:21.397183+0000","last_active":"2024-05-04T01:02:31.458775+0000","last_peered":"2024-05-04T01:02:31.458775+0000","last_clean":"2024-05-04T01:02:31.458775+0000","last_became_active":"2024-05-04T00:31:21.393014+0000","last_became_peered":"2024-05-04T00:31:21.393014+0000","last_unstale":"2024-05-04T01:02:31.458775+0000","last_undegraded":"2024-05-04T01:02:31.458775+0000","last_fullsized":"2024-05-04T01:02:31.458775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:40:12.379274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":2972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"28'7","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:52.153404+0000","last_change":"2024-05-04T00:31:19.186007+0000","last_active":"2024-05-04T01:01:52.153404+0000","last_peered":"2024-05-04T01:01:52.153404+0000","last_clean":"2024-05-04T01:01:52.153404+0000","last_became_active":"2024-05-04T00:31:19.184526+0000","last_became_peered":"2024-05-04T00:31:19.184526+0000","last_unstale":"2024-05-04T01:01:52.153404+0000","last_undegraded":"2024-05-04T01:01:52.153404+0000","last_fullsized":"2024-05-04T01:01:52.153404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:01:33.042606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"28'43","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.553685+0000","last_change":"2024-05-04T00:31:21.447258+0000","last_active":"2024-05-04T01:02:31.553685+0000","last_peered":"2024-05-04T01:02:31.553685+0000","last_clean":"2024-05-04T01:02:31.553685+0000","last_became_active":"2024-05-04T00:31:21.446842+0000","last_became_peered":"2024-05-04T00:31:21.446842+0000","last_unstale":"2024-05-04T01:02:31.553685+0000","last_undegraded":"2024-05-04T01:02:31.553685+0000","last_fullsized":"2024-05-04T01:02:31.553685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:10:57.675700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"28'10","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:58.543037+0000","last_change":"2024-05-04T00:31:19.190422+0000","last_active":"2024-05-04T01:01:58.543037+0000","last_peered":"2024-05-04T01:01:58.543037+0000","last_clean":"2024-05-04T01:01:58.543037+0000","last_became_active":"2024-05-04T00:31:19.189517+0000","last_became_peered":"2024-05-04T00:31:19.189517+0000","last_unstale":"2024-05-04T01:01:58.543037+0000","last_undegraded":"2024-05-04T01:01:58.543037+0000","last_fullsized":"2024-05-04T01:01:58.543037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:16:41.367677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"28'52","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.702363+0000","last_change":"2024-05-04T00:31:21.184586+0000","last_active":"2024-05-04T01:02:31.702363+0000","last_peered":"2024-05-04T01:02:31.702363+0000","last_clean":"2024-05-04T01:02:31.702363+0000","last_became_active":"2024-05-04T00:31:21.183698+0000","last_became_peered":"2024-05-04T00:31:21.183698+0000","last_unstale":"2024-05-04T01:02:31.702363+0000","last_undegraded":"2024-05-04T01:02:31.702363+0000","last_fullsized":"2024-05-04T01:02:31.702363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:47:25.699731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":3598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"28'5","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:02.892394+0000","last_change":"2024-05-04T00:31:19.186623+0000","last_active":"2024-05-04T01:02:02.892394+0000","last_peered":"2024-05-04T01:02:02.892394+0000","last_clean":"2024-05-04T01:02:02.892394+0000","last_became_active":"2024-05-04T00:31:19.185633+0000","last_became_peered":"2024-05-04T00:31:19.185633+0000","last_unstale":"2024-05-04T01:02:02.892394+0000","last_undegraded":"2024-05-04T01:02:02.892394+0000","last_fullsized":"2024-05-04T01:02:02.892394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:10:55.324717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"28'45","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.442971+0000","last_change":"2024-05-04T00:31:21.410329+0000","last_active":"2024-05-04T01:02:31.442971+0000","last_peered":"2024-05-04T01:02:31.442971+0000","last_clean":"2024-05-04T01:02:31.442971+0000","last_became_active":"2024-05-04T00:31:21.409655+0000","last_became_peered":"2024-05-04T00:31:21.409655+0000","last_unstale":"2024-05-04T01:02:31.442971+0000","last_undegraded":"2024-05-04T01:02:31.442971+0000","last_fullsized":"2024-05-04T01:02:31.442971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:09:40.562107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":5409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"28'348","reported_seq":385,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:30.340190+0000","last_change":"2024-05-04T00:31:19.178130+0000","last_active":"2024-05-04T01:02:30.340190+0000","last_peered":"2024-05-04T01:02:30.340190+0000","last_clean":"2024-05-04T01:02:30.340190+0000","last_became_active":"2024-05-04T00:31:19.177283+0000","last_became_peered":"2024-05-04T00:31:19.177283+0000","last_unstale":"2024-05-04T01:02:30.340190+0000","last_undegraded":"2024-05-04T01:02:30.340190+0000","last_fullsized":"2024-05-04T01:02:30.340190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:42:41.790988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"28'47","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.699191+0000","last_change":"2024-05-04T00:31:21.187102+0000","last_active":"2024-05-04T01:02:31.699191+0000","last_peered":"2024-05-04T01:02:31.699191+0000","last_clean":"2024-05-04T01:02:31.699191+0000","last_became_active":"2024-05-04T00:31:21.186167+0000","last_became_peered":"2024-05-04T00:31:21.186167+0000","last_unstale":"2024-05-04T01:02:31.699191+0000","last_undegraded":"2024-05-04T01:02:31.699191+0000","last_fullsized":"2024-05-04T01:02:31.699191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:05:04.013367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"28'811","reported_seq":849,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:19.958271+0000","last_change":"2024-05-04T00:31:19.251247+0000","last_active":"2024-05-04T01:02:19.958271+0000","last_peered":"2024-05-04T01:02:19.958271+0000","last_clean":"2024-05-04T01:02:19.958271+0000","last_became_active":"2024-05-04T00:31:19.250003+0000","last_became_peered":"2024-05-04T00:31:19.250003+0000","last_unstale":"2024-05-04T01:02:19.958271+0000","last_undegraded":"2024-05-04T01:02:19.958271+0000","last_fullsized":"2024-05-04T01:02:19.958271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:40:06.774090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":4561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"28'32","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.835367+0000","last_change":"2024-05-04T00:31:21.401432+0000","last_active":"2024-05-04T01:02:31.835367+0000","last_peered":"2024-05-04T01:02:31.835367+0000","last_clean":"2024-05-04T01:02:31.835367+0000","last_became_active":"2024-05-04T00:31:21.397220+0000","last_became_peered":"2024-05-04T00:31:21.397220+0000","last_unstale":"2024-05-04T01:02:31.835367+0000","last_undegraded":"2024-05-04T01:02:31.835367+0000","last_fullsized":"2024-05-04T01:02:31.835367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:07.460897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:40.484170+0000","last_change":"2024-05-04T00:31:19.183674+0000","last_active":"2024-05-04T01:01:40.484170+0000","last_peered":"2024-05-04T01:01:40.484170+0000","last_clean":"2024-05-04T01:01:40.484170+0000","last_became_active":"2024-05-04T00:31:19.183331+0000","last_became_peered":"2024-05-04T00:31:19.183331+0000","last_unstale":"2024-05-04T01:01:40.484170+0000","last_undegraded":"2024-05-04T01:01:40.484170+0000","last_fullsized":"2024-05-04T01:01:40.484170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:13:52.447627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"28'47","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.421027+0000","last_change":"2024-05-04T00:31:21.342578+0000","last_active":"2024-05-04T01:02:31.421027+0000","last_peered":"2024-05-04T01:02:31.421027+0000","last_clean":"2024-05-04T01:02:31.421027+0000","last_became_active":"2024-05-04T00:31:21.342064+0000","last_became_peered":"2024-05-04T00:31:21.342064+0000","last_unstale":"2024-05-04T01:02:31.421027+0000","last_undegraded":"2024-05-04T01:02:31.421027+0000","last_fullsized":"2024-05-04T01:02:31.421027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:35.377002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"28'10","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:16.788884+0000","last_change":"2024-05-04T00:31:19.184166+0000","last_active":"2024-05-04T01:02:16.788884+0000","last_peered":"2024-05-04T01:02:16.788884+0000","last_clean":"2024-05-04T01:02:16.788884+0000","last_became_active":"2024-05-04T00:31:19.181304+0000","last_became_peered":"2024-05-04T00:31:19.181304+0000","last_unstale":"2024-05-04T01:02:16.788884+0000","last_undegraded":"2024-05-04T01:02:16.788884+0000","last_fullsized":"2024-05-04T01:02:16.788884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:49:04.376111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'62","reported_seq":96,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.695730+0000","last_change":"2024-05-04T00:31:21.390252+0000","last_active":"2024-05-04T01:02:31.695730+0000","last_peered":"2024-05-04T01:02:31.695730+0000","last_clean":"2024-05-04T01:02:31.695730+0000","last_became_active":"2024-05-04T00:31:21.389360+0000","last_became_peered":"2024-05-04T00:31:21.389360+0000","last_unstale":"2024-05-04T01:02:31.695730+0000","last_undegraded":"2024-05-04T01:02:31.695730+0000","last_fullsized":"2024-05-04T01:02:31.695730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:45:23.177550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":7948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:57.630518+0000","last_change":"2024-05-04T00:31:19.176756+0000","last_active":"2024-05-04T01:01:57.630518+0000","last_peered":"2024-05-04T01:01:57.630518+0000","last_clean":"2024-05-04T01:01:57.630518+0000","last_became_active":"2024-05-04T00:31:19.175779+0000","last_became_peered":"2024-05-04T00:31:19.175779+0000","last_unstale":"2024-05-04T01:01:57.630518+0000","last_undegraded":"2024-05-04T01:01:57.630518+0000","last_fullsized":"2024-05-04T01:01:57.630518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:14.453153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'46","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.361428+0000","last_change":"2024-05-04T00:31:21.397306+0000","last_active":"2024-05-04T01:02:31.361428+0000","last_peered":"2024-05-04T01:02:31.361428+0000","last_clean":"2024-05-04T01:02:31.361428+0000","last_became_active":"2024-05-04T00:31:21.394863+0000","last_became_peered":"2024-05-04T00:31:21.394863+0000","last_unstale":"2024-05-04T01:02:31.361428+0000","last_undegraded":"2024-05-04T01:02:31.361428+0000","last_fullsized":"2024-05-04T01:02:31.361428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:46:38.463068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":4347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"28'17","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:42.389948+0000","last_change":"2024-05-04T00:31:19.177402+0000","last_active":"2024-05-04T01:01:42.389948+0000","last_peered":"2024-05-04T01:01:42.389948+0000","last_clean":"2024-05-04T01:01:42.389948+0000","last_became_active":"2024-05-04T00:31:19.176805+0000","last_became_peered":"2024-05-04T00:31:19.176805+0000","last_unstale":"2024-05-04T01:01:42.389948+0000","last_undegraded":"2024-05-04T01:01:42.389948+0000","last_fullsized":"2024-05-04T01:01:42.389948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:31.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'47","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.694612+0000","last_change":"2024-05-04T00:31:21.188457+0000","last_active":"2024-05-04T01:02:31.694612+0000","last_peered":"2024-05-04T01:02:31.694612+0000","last_clean":"2024-05-04T01:02:31.694612+0000","last_became_active":"2024-05-04T00:31:21.187554+0000","last_became_peered":"2024-05-04T00:31:21.187554+0000","last_unstale":"2024-05-04T01:02:31.694612+0000","last_undegraded":"2024-05-04T01:02:31.694612+0000","last_fullsized":"2024-05-04T01:02:31.694612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:31:55.671261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":6499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:23.368856+0000","last_change":"2024-05-04T00:31:19.176641+0000","last_active":"2024-05-04T01:02:23.368856+0000","last_peered":"2024-05-04T01:02:23.368856+0000","last_clean":"2024-05-04T01:02:23.368856+0000","last_became_active":"2024-05-04T00:31:19.175715+0000","last_became_peered":"2024-05-04T00:31:19.175715+0000","last_unstale":"2024-05-04T01:02:23.368856+0000","last_undegraded":"2024-05-04T01:02:23.368856+0000","last_fullsized":"2024-05-04T01:02:23.368856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:05:45.097410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"28'30","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.700719+0000","last_change":"2024-05-04T00:31:21.407554+0000","last_active":"2024-05-04T01:02:31.700719+0000","last_peered":"2024-05-04T01:02:31.700719+0000","last_clean":"2024-05-04T01:02:31.700719+0000","last_became_active":"2024-05-04T00:31:21.403004+0000","last_became_peered":"2024-05-04T00:31:21.403004+0000","last_unstale":"2024-05-04T01:02:31.700719+0000","last_undegraded":"2024-05-04T01:02:31.700719+0000","last_fullsized":"2024-05-04T01:02:31.700719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:33.938895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:23.316664+0000","last_change":"2024-05-04T00:31:19.187116+0000","last_active":"2024-05-04T01:02:23.316664+0000","last_peered":"2024-05-04T01:02:23.316664+0000","last_clean":"2024-05-04T01:02:23.316664+0000","last_became_active":"2024-05-04T00:31:19.186540+0000","last_became_peered":"2024-05-04T00:31:19.186540+0000","last_unstale":"2024-05-04T01:02:23.316664+0000","last_undegraded":"2024-05-04T01:02:23.316664+0000","last_fullsized":"2024-05-04T01:02:23.316664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:08.420067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"28'41","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.841254+0000","last_change":"2024-05-04T00:31:21.407986+0000","last_active":"2024-05-04T01:02:31.841254+0000","last_peered":"2024-05-04T01:02:31.841254+0000","last_clean":"2024-05-04T01:02:31.841254+0000","last_became_active":"2024-05-04T00:31:21.404350+0000","last_became_peered":"2024-05-04T00:31:21.404350+0000","last_unstale":"2024-05-04T01:02:31.841254+0000","last_undegraded":"2024-05-04T01:02:31.841254+0000","last_fullsized":"2024-05-04T01:02:31.841254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:12:34.898595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'2","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:00:35.381044+0000","last_change":"2024-05-04T00:31:19.190045+0000","last_active":"2024-05-04T01:00:35.381044+0000","last_peered":"2024-05-04T01:00:35.381044+0000","last_clean":"2024-05-04T01:00:35.381044+0000","last_became_active":"2024-05-04T00:31:19.189166+0000","last_became_peered":"2024-05-04T00:31:19.189166+0000","last_unstale":"2024-05-04T01:00:35.381044+0000","last_undegraded":"2024-05-04T01:00:35.381044+0000","last_fullsized":"2024-05-04T01:00:35.381044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:31.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"28'36","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.835864+0000","last_change":"2024-05-04T00:31:21.402171+0000","last_active":"2024-05-04T01:02:31.835864+0000","last_peered":"2024-05-04T01:02:31.835864+0000","last_clean":"2024-05-04T01:02:31.835864+0000","last_became_active":"2024-05-04T00:31:21.401467+0000","last_became_peered":"2024-05-04T00:31:21.401467+0000","last_unstale":"2024-05-04T01:02:31.835864+0000","last_undegraded":"2024-05-04T01:02:31.835864+0000","last_fullsized":"2024-05-04T01:02:31.835864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:34:25.722557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:03.938611+0000","last_change":"2024-05-04T00:31:19.155210+0000","last_active":"2024-05-04T01:02:03.938611+0000","last_peered":"2024-05-04T01:02:03.938611+0000","last_clean":"2024-05-04T01:02:03.938611+0000","last_became_active":"2024-05-04T00:31:19.154504+0000","last_became_peered":"2024-05-04T00:31:19.154504+0000","last_unstale":"2024-05-04T01:02:03.938611+0000","last_undegraded":"2024-05-04T01:02:03.938611+0000","last_fullsized":"2024-05-04T01:02:03.938611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:47:23.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'47","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.696865+0000","last_change":"2024-05-04T00:31:21.406273+0000","last_active":"2024-05-04T01:02:31.696865+0000","last_peered":"2024-05-04T01:02:31.696865+0000","last_clean":"2024-05-04T01:02:31.696865+0000","last_became_active":"2024-05-04T00:31:21.405283+0000","last_became_peered":"2024-05-04T00:31:21.405283+0000","last_unstale":"2024-05-04T01:02:31.696865+0000","last_undegraded":"2024-05-04T01:02:31.696865+0000","last_fullsized":"2024-05-04T01:02:31.696865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:20:31.795673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":136,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T00:58:47.566980+0000","last_change":"2024-05-04T00:30:40.841283+0000","last_active":"2024-05-04T00:58:47.566980+0000","last_peered":"2024-05-04T00:58:47.566980+0000","last_clean":"2024-05-04T00:58:47.566980+0000","last_became_active":"2024-05-04T00:30:40.838353+0000","last_became_peered":"2024-05-04T00:30:40.838353+0000","last_unstale":"2024-05-04T00:58:47.566980+0000","last_undegraded":"2024-05-04T00:58:47.566980+0000","last_fullsized":"2024-05-04T00:58:47.566980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:30:37.159356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:30:37.159356+0000","last_clean_scrub_stamp":"2024-05-04T00:30:37.159356+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:30:10.374994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"28'7","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:28.311754+0000","last_change":"2024-05-04T00:31:19.248691+0000","last_active":"2024-05-04T01:02:28.311754+0000","last_peered":"2024-05-04T01:02:28.311754+0000","last_clean":"2024-05-04T01:02:28.311754+0000","last_became_active":"2024-05-04T00:31:19.247815+0000","last_became_peered":"2024-05-04T00:31:19.247815+0000","last_unstale":"2024-05-04T01:02:28.311754+0000","last_undegraded":"2024-05-04T01:02:28.311754+0000","last_fullsized":"2024-05-04T01:02:28.311754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:46:05.720208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"28'34","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.518382+0000","last_change":"2024-05-04T00:31:21.446500+0000","last_active":"2024-05-04T01:02:31.518382+0000","last_peered":"2024-05-04T01:02:31.518382+0000","last_clean":"2024-05-04T01:02:31.518382+0000","last_became_active":"2024-05-04T00:31:21.446100+0000","last_became_peered":"2024-05-04T00:31:21.446100+0000","last_unstale":"2024-05-04T01:02:31.518382+0000","last_undegraded":"2024-05-04T01:02:31.518382+0000","last_fullsized":"2024-05-04T01:02:31.518382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:06.542614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"28'10","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:15.858216+0000","last_change":"2024-05-04T00:31:19.184044+0000","last_active":"2024-05-04T01:02:15.858216+0000","last_peered":"2024-05-04T01:02:15.858216+0000","last_clean":"2024-05-04T01:02:15.858216+0000","last_became_active":"2024-05-04T00:31:19.181956+0000","last_became_peered":"2024-05-04T00:31:19.181956+0000","last_unstale":"2024-05-04T01:02:15.858216+0000","last_undegraded":"2024-05-04T01:02:15.858216+0000","last_fullsized":"2024-05-04T01:02:15.858216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:09:33.607433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"28'23","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.424299+0000","last_change":"2024-05-04T00:31:21.343953+0000","last_active":"2024-05-04T01:02:31.424299+0000","last_peered":"2024-05-04T01:02:31.424299+0000","last_clean":"2024-05-04T01:02:31.424299+0000","last_became_active":"2024-05-04T00:31:21.343499+0000","last_became_peered":"2024-05-04T00:31:21.343499+0000","last_unstale":"2024-05-04T01:02:31.424299+0000","last_undegraded":"2024-05-04T01:02:31.424299+0000","last_fullsized":"2024-05-04T01:02:31.424299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:33.938895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"28'477","reported_seq":982,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.802778+0000","last_change":"2024-05-04T00:31:19.184947+0000","last_active":"2024-05-04T01:02:31.802778+0000","last_peered":"2024-05-04T01:02:31.802778+0000","last_clean":"2024-05-04T01:02:31.802778+0000","last_became_active":"2024-05-04T00:31:19.184606+0000","last_became_peered":"2024-05-04T00:31:19.184606+0000","last_unstale":"2024-05-04T01:02:31.802778+0000","last_undegraded":"2024-05-04T01:02:31.802778+0000","last_fullsized":"2024-05-04T01:02:31.802778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:07:49.638230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109877,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":465,"num_read_kb":490,"num_write":474,"num_write_kb":495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"28'42","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.432000+0000","last_change":"2024-05-04T00:31:21.402799+0000","last_active":"2024-05-04T01:02:31.432000+0000","last_peered":"2024-05-04T01:02:31.432000+0000","last_clean":"2024-05-04T01:02:31.432000+0000","last_became_active":"2024-05-04T00:31:21.401591+0000","last_became_peered":"2024-05-04T00:31:21.401591+0000","last_unstale":"2024-05-04T01:02:31.432000+0000","last_undegraded":"2024-05-04T01:02:31.432000+0000","last_fullsized":"2024-05-04T01:02:31.432000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:28:07.779536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"28'6","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:28.312950+0000","last_change":"2024-05-04T00:31:19.182214+0000","last_active":"2024-05-04T01:02:28.312950+0000","last_peered":"2024-05-04T01:02:28.312950+0000","last_clean":"2024-05-04T01:02:28.312950+0000","last_became_active":"2024-05-04T00:31:19.180317+0000","last_became_peered":"2024-05-04T00:31:19.180317+0000","last_unstale":"2024-05-04T01:02:28.312950+0000","last_undegraded":"2024-05-04T01:02:28.312950+0000","last_fullsized":"2024-05-04T01:02:28.312950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:44.678316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"28'41","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.432070+0000","last_change":"2024-05-04T00:32:21.647507+0000","last_active":"2024-05-04T01:02:31.432070+0000","last_peered":"2024-05-04T01:02:31.432070+0000","last_clean":"2024-05-04T01:02:31.432070+0000","last_became_active":"2024-05-04T00:32:21.646617+0000","last_became_peered":"2024-05-04T00:32:21.646617+0000","last_unstale":"2024-05-04T01:02:31.432070+0000","last_undegraded":"2024-05-04T01:02:31.432070+0000","last_fullsized":"2024-05-04T01:02:31.432070+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:09:35.958415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"28'2","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:28.316123+0000","last_change":"2024-05-04T00:31:19.183991+0000","last_active":"2024-05-04T01:02:28.316123+0000","last_peered":"2024-05-04T01:02:28.316123+0000","last_clean":"2024-05-04T01:02:28.316123+0000","last_became_active":"2024-05-04T00:31:19.179785+0000","last_became_peered":"2024-05-04T00:31:19.179785+0000","last_unstale":"2024-05-04T01:02:28.316123+0000","last_undegraded":"2024-05-04T01:02:28.316123+0000","last_fullsized":"2024-05-04T01:02:28.316123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:29.575176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"28'35","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.677677+0000","last_change":"2024-05-04T00:31:21.342687+0000","last_active":"2024-05-04T01:02:31.677677+0000","last_peered":"2024-05-04T01:02:31.677677+0000","last_clean":"2024-05-04T01:02:31.677677+0000","last_became_active":"2024-05-04T00:31:21.341702+0000","last_became_peered":"2024-05-04T00:31:21.341702+0000","last_unstale":"2024-05-04T01:02:31.677677+0000","last_undegraded":"2024-05-04T01:02:31.677677+0000","last_fullsized":"2024-05-04T01:02:31.677677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:56.687510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":3658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:16.832909+0000","last_change":"2024-05-04T00:31:19.176663+0000","last_active":"2024-05-04T01:02:16.832909+0000","last_peered":"2024-05-04T01:02:16.832909+0000","last_clean":"2024-05-04T01:02:16.832909+0000","last_became_active":"2024-05-04T00:31:19.175616+0000","last_became_peered":"2024-05-04T00:31:19.175616+0000","last_unstale":"2024-05-04T01:02:16.832909+0000","last_undegraded":"2024-05-04T01:02:16.832909+0000","last_fullsized":"2024-05-04T01:02:16.832909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:24:47.124717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'38","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.406850+0000","last_change":"2024-05-04T00:31:21.403129+0000","last_active":"2024-05-04T01:02:31.406850+0000","last_peered":"2024-05-04T01:02:31.406850+0000","last_clean":"2024-05-04T01:02:31.406850+0000","last_became_active":"2024-05-04T00:31:21.402248+0000","last_became_peered":"2024-05-04T00:31:21.402248+0000","last_unstale":"2024-05-04T01:02:31.406850+0000","last_undegraded":"2024-05-04T01:02:31.406850+0000","last_fullsized":"2024-05-04T01:02:31.406850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:10.771050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":1649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"28'1198","reported_seq":1237,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:30.508455+0000","last_change":"2024-05-04T00:31:19.155903+0000","last_active":"2024-05-04T01:02:30.508455+0000","last_peered":"2024-05-04T01:02:30.508455+0000","last_clean":"2024-05-04T01:02:30.508455+0000","last_became_active":"2024-05-04T00:31:19.154909+0000","last_became_peered":"2024-05-04T00:31:19.154909+0000","last_unstale":"2024-05-04T01:02:30.508455+0000","last_undegraded":"2024-05-04T01:02:30.508455+0000","last_fullsized":"2024-05-04T01:02:30.508455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1198,"log_dups_size":0,"ondisk_log_size":1198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:53:25.815241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2862,"num_write_kb":974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'37","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.549167+0000","last_change":"2024-05-04T00:31:21.445396+0000","last_active":"2024-05-04T01:02:31.549167+0000","last_peered":"2024-05-04T01:02:31.549167+0000","last_clean":"2024-05-04T01:02:31.549167+0000","last_became_active":"2024-05-04T00:31:21.444934+0000","last_became_peered":"2024-05-04T00:31:21.444934+0000","last_unstale":"2024-05-04T01:02:31.549167+0000","last_undegraded":"2024-05-04T01:02:31.549167+0000","last_fullsized":"2024-05-04T01:02:31.549167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:23:02.407000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'10","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:30.330017+0000","last_change":"2024-05-04T00:31:19.182946+0000","last_active":"2024-05-04T01:02:30.330017+0000","last_peered":"2024-05-04T01:02:30.330017+0000","last_clean":"2024-05-04T01:02:30.330017+0000","last_became_active":"2024-05-04T00:31:19.182050+0000","last_became_peered":"2024-05-04T00:31:19.182050+0000","last_unstale":"2024-05-04T01:02:30.330017+0000","last_undegraded":"2024-05-04T01:02:30.330017+0000","last_fullsized":"2024-05-04T01:02:30.330017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:55:12.448558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'45","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.537417+0000","last_change":"2024-05-04T00:31:21.443100+0000","last_active":"2024-05-04T01:02:31.537417+0000","last_peered":"2024-05-04T01:02:31.537417+0000","last_clean":"2024-05-04T01:02:31.537417+0000","last_became_active":"2024-05-04T00:31:21.442602+0000","last_became_peered":"2024-05-04T00:31:21.442602+0000","last_unstale":"2024-05-04T01:02:31.537417+0000","last_undegraded":"2024-05-04T01:02:31.537417+0000","last_fullsized":"2024-05-04T01:02:31.537417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:16:45.807230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":5859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'4","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:15.855817+0000","last_change":"2024-05-04T00:31:19.248358+0000","last_active":"2024-05-04T01:02:15.855817+0000","last_peered":"2024-05-04T01:02:15.855817+0000","last_clean":"2024-05-04T01:02:15.855817+0000","last_became_active":"2024-05-04T00:31:19.247822+0000","last_became_peered":"2024-05-04T00:31:19.247822+0000","last_unstale":"2024-05-04T01:02:15.855817+0000","last_undegraded":"2024-05-04T01:02:15.855817+0000","last_fullsized":"2024-05-04T01:02:15.855817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:04.191631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"28'37","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:40.508031+0000","last_change":"2024-05-04T00:31:21.441959+0000","last_active":"2024-05-04T01:01:40.508031+0000","last_peered":"2024-05-04T01:01:40.508031+0000","last_clean":"2024-05-04T01:01:40.508031+0000","last_became_active":"2024-05-04T00:31:21.441015+0000","last_became_peered":"2024-05-04T00:31:21.441015+0000","last_unstale":"2024-05-04T01:01:40.508031+0000","last_undegraded":"2024-05-04T01:01:40.508031+0000","last_fullsized":"2024-05-04T01:01:40.508031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:54:30.187813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'10","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:23.316808+0000","last_change":"2024-05-04T00:31:19.159146+0000","last_active":"2024-05-04T01:02:23.316808+0000","last_peered":"2024-05-04T01:02:23.316808+0000","last_clean":"2024-05-04T01:02:23.316808+0000","last_became_active":"2024-05-04T00:31:19.158366+0000","last_became_peered":"2024-05-04T00:31:19.158366+0000","last_unstale":"2024-05-04T01:02:23.316808+0000","last_undegraded":"2024-05-04T01:02:23.316808+0000","last_fullsized":"2024-05-04T01:02:23.316808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:07.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'51","reported_seq":86,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.533109+0000","last_change":"2024-05-04T00:31:21.441521+0000","last_active":"2024-05-04T01:02:31.533109+0000","last_peered":"2024-05-04T01:02:31.533109+0000","last_clean":"2024-05-04T01:02:31.533109+0000","last_became_active":"2024-05-04T00:31:21.441074+0000","last_became_peered":"2024-05-04T00:31:21.441074+0000","last_unstale":"2024-05-04T01:02:31.533109+0000","last_undegraded":"2024-05-04T01:02:31.533109+0000","last_fullsized":"2024-05-04T01:02:31.533109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:31.926158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"28'3","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:02.977229+0000","last_change":"2024-05-04T00:31:19.174493+0000","last_active":"2024-05-04T01:02:02.977229+0000","last_peered":"2024-05-04T01:02:02.977229+0000","last_clean":"2024-05-04T01:02:02.977229+0000","last_became_active":"2024-05-04T00:31:19.174113+0000","last_became_peered":"2024-05-04T00:31:19.174113+0000","last_unstale":"2024-05-04T01:02:02.977229+0000","last_undegraded":"2024-05-04T01:02:02.977229+0000","last_fullsized":"2024-05-04T01:02:02.977229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:54.336528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"28'49","reported_seq":83,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.436970+0000","last_change":"2024-05-04T00:31:21.406782+0000","last_active":"2024-05-04T01:02:31.436970+0000","last_peered":"2024-05-04T01:02:31.436970+0000","last_clean":"2024-05-04T01:02:31.436970+0000","last_became_active":"2024-05-04T00:31:21.406008+0000","last_became_peered":"2024-05-04T00:31:21.406008+0000","last_unstale":"2024-05-04T01:02:31.436970+0000","last_undegraded":"2024-05-04T01:02:31.436970+0000","last_fullsized":"2024-05-04T01:02:31.436970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:24:01.565048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":5340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"28'574","reported_seq":612,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:03.886093+0000","last_change":"2024-05-04T00:31:19.248682+0000","last_active":"2024-05-04T01:02:03.886093+0000","last_peered":"2024-05-04T01:02:03.886093+0000","last_clean":"2024-05-04T01:02:03.886093+0000","last_became_active":"2024-05-04T00:31:19.247736+0000","last_became_peered":"2024-05-04T00:31:19.247736+0000","last_unstale":"2024-05-04T01:02:03.886093+0000","last_undegraded":"2024-05-04T01:02:03.886093+0000","last_fullsized":"2024-05-04T01:02:03.886093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:42:59.459764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":570,"num_write_kb":4382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"28'46","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.694414+0000","last_change":"2024-05-04T00:31:21.401858+0000","last_active":"2024-05-04T01:02:31.694414+0000","last_peered":"2024-05-04T01:02:31.694414+0000","last_clean":"2024-05-04T01:02:31.694414+0000","last_became_active":"2024-05-04T00:31:21.400935+0000","last_became_peered":"2024-05-04T00:31:21.400935+0000","last_unstale":"2024-05-04T01:02:31.694414+0000","last_undegraded":"2024-05-04T01:02:31.694414+0000","last_fullsized":"2024-05-04T01:02:31.694414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:50:11.762845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"28'52","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.696600+0000","last_change":"2024-05-04T00:31:21.392918+0000","last_active":"2024-05-04T01:02:31.696600+0000","last_peered":"2024-05-04T01:02:31.696600+0000","last_clean":"2024-05-04T01:02:31.696600+0000","last_became_active":"2024-05-04T00:31:21.392020+0000","last_became_peered":"2024-05-04T00:31:21.392020+0000","last_unstale":"2024-05-04T01:02:31.696600+0000","last_undegraded":"2024-05-04T01:02:31.696600+0000","last_fullsized":"2024-05-04T01:02:31.696600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:19:30.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":3157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:32.731087+0000","last_change":"2024-05-04T00:31:19.187930+0000","last_active":"2024-05-04T01:01:32.731087+0000","last_peered":"2024-05-04T01:01:32.731087+0000","last_clean":"2024-05-04T01:01:32.731087+0000","last_became_active":"2024-05-04T00:31:19.185156+0000","last_became_peered":"2024-05-04T00:31:19.185156+0000","last_unstale":"2024-05-04T01:01:32.731087+0000","last_undegraded":"2024-05-04T01:01:32.731087+0000","last_fullsized":"2024-05-04T01:01:32.731087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:40.266177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'39","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.367470+0000","last_change":"2024-05-04T00:31:21.397596+0000","last_active":"2024-05-04T01:02:31.367470+0000","last_peered":"2024-05-04T01:02:31.367470+0000","last_clean":"2024-05-04T01:02:31.367470+0000","last_became_active":"2024-05-04T00:31:21.396023+0000","last_became_peered":"2024-05-04T00:31:21.396023+0000","last_unstale":"2024-05-04T01:02:31.367470+0000","last_undegraded":"2024-05-04T01:02:31.367470+0000","last_fullsized":"2024-05-04T01:02:31.367470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:02:02.166274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"28'11","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:15.854981+0000","last_change":"2024-05-04T00:31:19.189413+0000","last_active":"2024-05-04T01:02:15.854981+0000","last_peered":"2024-05-04T01:02:15.854981+0000","last_clean":"2024-05-04T01:02:15.854981+0000","last_became_active":"2024-05-04T00:31:19.188359+0000","last_became_peered":"2024-05-04T00:31:19.188359+0000","last_unstale":"2024-05-04T01:02:15.854981+0000","last_undegraded":"2024-05-04T01:02:15.854981+0000","last_fullsized":"2024-05-04T01:02:15.854981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:16:43.456248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"28'51","reported_seq":87,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.471110+0000","last_change":"2024-05-04T00:31:21.417364+0000","last_active":"2024-05-04T01:02:31.471110+0000","last_peered":"2024-05-04T01:02:31.471110+0000","last_clean":"2024-05-04T01:02:31.471110+0000","last_became_active":"2024-05-04T00:31:21.416267+0000","last_became_peered":"2024-05-04T00:31:21.416267+0000","last_unstale":"2024-05-04T01:02:31.471110+0000","last_undegraded":"2024-05-04T01:02:31.471110+0000","last_fullsized":"2024-05-04T01:02:31.471110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:42:31.303120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":6244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"28'119","reported_seq":159,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.967954+0000","last_change":"2024-05-04T00:31:19.187081+0000","last_active":"2024-05-04T01:02:31.967954+0000","last_peered":"2024-05-04T01:02:31.967954+0000","last_clean":"2024-05-04T01:02:31.967954+0000","last_became_active":"2024-05-04T00:31:19.186483+0000","last_became_peered":"2024-05-04T00:31:19.186483+0000","last_unstale":"2024-05-04T01:02:31.967954+0000","last_undegraded":"2024-05-04T01:02:31.967954+0000","last_fullsized":"2024-05-04T01:02:31.967954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:07.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092188,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":1130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"28'29","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.430195+0000","last_change":"2024-05-04T00:31:21.414034+0000","last_active":"2024-05-04T01:02:31.430195+0000","last_peered":"2024-05-04T01:02:31.430195+0000","last_clean":"2024-05-04T01:02:31.430195+0000","last_became_active":"2024-05-04T00:31:21.413330+0000","last_became_peered":"2024-05-04T00:31:21.413330+0000","last_unstale":"2024-05-04T01:02:31.430195+0000","last_undegraded":"2024-05-04T01:02:31.430195+0000","last_fullsized":"2024-05-04T01:02:31.430195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:07.135906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":2406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"28'620","reported_seq":659,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:38.088985+0000","last_change":"2024-05-04T00:31:19.175936+0000","last_active":"2024-05-04T01:01:38.088985+0000","last_peered":"2024-05-04T01:01:38.088985+0000","last_clean":"2024-05-04T01:01:38.088985+0000","last_became_active":"2024-05-04T00:31:19.175356+0000","last_became_peered":"2024-05-04T00:31:19.175356+0000","last_unstale":"2024-05-04T01:01:38.088985+0000","last_undegraded":"2024-05-04T01:01:38.088985+0000","last_fullsized":"2024-05-04T01:01:38.088985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:33.026019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":4428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2165,"num_write_kb":250211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2827,"ondisk_log_size":2827,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22178359,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":465,"num_read_kb":490,"num_write":6722,"num_write_kb":24987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44507136,"data_stored":44356718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5157,"ondisk_log_size":5157,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509829,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":4396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":4501504,"data_stored":4307686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509829,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52176,"kb_used_data":8520,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94319664,"statfs":{"total":96636764160,"available":96583335936,"internally_reserved":0,"allocated":8724480,"data_stored":8502444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509830,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43828,"kb_used_data":8492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328012,"statfs":{"total":96636764160,"available":96591884288,"internally_reserved":0,"allocated":8695808,"data_stored":8500910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509830,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":897024,"data_stored":702124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509829,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43900,"kb_used_data":4404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327940,"statfs":{"total":96636764160,"available":96591810560,"internally_reserved":0,"allocated":4509696,"data_stored":4307216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542533,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1523712,"data_stored":1313341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542533,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41496,"kb_used_data":6160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330344,"statfs":{"total":96636764160,"available":96594272256,"internally_reserved":0,"allocated":6307840,"data_stored":6098491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542533,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52088,"kb_used_data":12592,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319752,"statfs":{"total":96636764160,"available":96583426048,"internally_reserved":0,"allocated":12894208,"data_stored":12695734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4195620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12599296,"data_stored":12584138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8429568,"data_stored":8390848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5419008,"data_stored":5397665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4196090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1228800,"data_stored":1202883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T01:02:38.111 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T01:02:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.301+0000 7f697a910640 1 Processor -- start 2024-05-04T01:02:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.301+0000 7f697a910640 1 -- start start 2024-05-04T01:02:38.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.301+0000 7f697a910640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f69740cdeb0 0x7f69740ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:38.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.301+0000 7f697a910640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6974160070 con 0x7f697415cd10 2024-05-04T01:02:38.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.301+0000 7f697a910640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f697415d120 con 0x7f6974073ec0 2024-05-04T01:02:38.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.301+0000 7f697a910640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f69740742d0 con 0x7f69740cdeb0 2024-05-04T01:02:38.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.305+0000 7f6973fff640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f6974073ec0 0x7f69740c8b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:34250/0 (socket says 172.21.15.6:34250) 2024-05-04T01:02:38.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.305+0000 7f6973fff640 1 -- 172.21.15.6:0/3125707641 learned_addr learned my addr 172.21.15.6:0/3125707641 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T01:02:38.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.305+0000 7f6978ead640 1 --2- 172.21.15.6:0/3125707641 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f69740cdeb0 0x7f69740ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:38.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.313+0000 7f6972ffd640 1 -- 172.21.15.6:0/3125707641 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517179278 0 0) 0x7f697415d120 con 0x7f6974073ec0 2024-05-04T01:02:38.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.313+0000 7f6972ffd640 1 -- 172.21.15.6:0/3125707641 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f695c003530 con 0x7f6974073ec0 2024-05-04T01:02:38.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.317+0000 7f6978ead640 1 -- 172.21.15.6:0/3125707641 >> v1:172.21.15.163:6789/0 conn(0x7f6974073ec0 legacy=0x7f69740c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:38.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.317+0000 7f6978ead640 1 -- 172.21.15.6:0/3125707641 >> v1:172.21.15.6:6789/0 conn(0x7f697415cd10 legacy=0x7f697415f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:38.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.317+0000 7f6978ead640 1 -- 172.21.15.6:0/3125707641 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6974160310 con 0x7f69740cdeb0 2024-05-04T01:02:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.321+0000 7f6978ead640 1 --2- 172.21.15.6:0/3125707641 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f69740cdeb0 0x7f69740ce2c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f69740ce960 tx=0x7f696c01f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=265999fa6fb25c8c server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:38.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.337+0000 7f6972ffd640 1 -- 172.21.15.6:0/3125707641 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c0b4070 con 0x7f69740cdeb0 2024-05-04T01:02:38.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.337+0000 7f6972ffd640 1 -- 172.21.15.6:0/3125707641 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f696c0af600 con 0x7f69740cdeb0 2024-05-04T01:02:38.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.337+0000 7f6972ffd640 1 -- 172.21.15.6:0/3125707641 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c0af9d0 con 0x7f69740cdeb0 2024-05-04T01:02:38.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.341+0000 7f697a910640 1 -- 172.21.15.6:0/3125707641 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f69740cdeb0 msgr2=0x7f69740ce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:38.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.341+0000 7f697a910640 1 --2- 172.21.15.6:0/3125707641 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f69740cdeb0 0x7f69740ce2c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f69740ce960 tx=0x7f696c01f170 comp rx=0 tx=0).stop 2024-05-04T01:02:38.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.341+0000 7f697a910640 1 -- 172.21.15.6:0/3125707641 shutdown_connections 2024-05-04T01:02:38.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.341+0000 7f697a910640 1 --2- 172.21.15.6:0/3125707641 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f69740cdeb0 0x7f69740ce2c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:38.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.341+0000 7f697a910640 1 -- 172.21.15.6:0/3125707641 >> 172.21.15.6:0/3125707641 conn(0x7f6974070d60 msgr2=0x7f69740711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:38.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.341+0000 7f697a910640 1 -- 172.21.15.6:0/3125707641 shutdown_connections 2024-05-04T01:02:38.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.341+0000 7f697a910640 1 -- 172.21.15.6:0/3125707641 wait complete. 2024-05-04T01:02:38.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.341+0000 7f697a910640 1 Processor -- start 2024-05-04T01:02:38.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.341+0000 7f697a910640 1 -- start start 2024-05-04T01:02:38.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.341+0000 7f697a910640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6974073ec0 0x7f69741f3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:38.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.345+0000 7f697a910640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f69740cdeb0 0x7f697414c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:38.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.345+0000 7f697a910640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f697415cd10 0x7f6974149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:38.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.345+0000 7f697a910640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f697415c510 con 0x7f697415cd10 2024-05-04T01:02:38.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.345+0000 7f697a910640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f697415c880 con 0x7f6974073ec0 2024-05-04T01:02:38.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.345+0000 7f697a910640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f697415c1c0 con 0x7f69740cdeb0 2024-05-04T01:02:38.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.345+0000 7f69737fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f69740cdeb0 0x7f697414c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:38.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.345+0000 7f6973fff640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6974073ec0 0x7f69741f3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:38.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.345+0000 7f69737fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f69740cdeb0 0x7f697414c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:51396/0 (socket says 172.21.15.6:51396) 2024-05-04T01:02:38.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.345+0000 7f69737fe640 1 -- 172.21.15.6:0/1881292315 learned_addr learned my addr 172.21.15.6:0/1881292315 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:38.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.349+0000 7f6978ead640 1 --2- 172.21.15.6:0/1881292315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f697415cd10 0x7f6974149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:38.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.357+0000 7f6973fff640 1 -- 172.21.15.6:0/1881292315 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f69740cdeb0 msgr2=0x7f697414c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:38.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.357+0000 7f6973fff640 1 --2- 172.21.15.6:0/1881292315 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f69740cdeb0 0x7f697414c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:38.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.357+0000 7f6973fff640 1 -- 172.21.15.6:0/1881292315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f697415cd10 msgr2=0x7f6974149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:38.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.357+0000 7f6973fff640 1 --2- 172.21.15.6:0/1881292315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f697415cd10 0x7f6974149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:38.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.357+0000 7f6973fff640 1 -- 172.21.15.6:0/1881292315 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69740cbe40 con 0x7f6974073ec0 2024-05-04T01:02:38.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.365+0000 7f6973fff640 1 --2- 172.21.15.6:0/1881292315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6974073ec0 0x7f69741f3730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f696400c3c0 tx=0x7f696400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.373+0000 7f6970ff9640 1 -- 172.21.15.6:0/1881292315 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6964017070 con 0x7f6974073ec0 2024-05-04T01:02:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.373+0000 7f6970ff9640 1 -- 172.21.15.6:0/1881292315 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6964005cf0 con 0x7f6974073ec0 2024-05-04T01:02:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.373+0000 7f697a910640 1 -- 172.21.15.6:0/1881292315 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6974152880 con 0x7f6974073ec0 2024-05-04T01:02:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.373+0000 7f6970ff9640 1 -- 172.21.15.6:0/1881292315 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69640072d0 con 0x7f6974073ec0 2024-05-04T01:02:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.373+0000 7f697a910640 1 -- 172.21.15.6:0/1881292315 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f697414d0e0 con 0x7f6974073ec0 2024-05-04T01:02:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.377+0000 7f697a910640 1 -- 172.21.15.6:0/1881292315 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6974069a50 con 0x7f6974073ec0 2024-05-04T01:02:38.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.741+0000 7f6970ff9640 1 -- 172.21.15.6:0/1881292315 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f696401a070 con 0x7f6974073ec0 2024-05-04T01:02:38.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.741+0000 7f6970ff9640 1 --2- 172.21.15.6:0/1881292315 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f696006f450 0x7f6960071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:38.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.741+0000 7f69737fe640 1 --2- 172.21.15.6:0/1881292315 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f696006f450 0x7f6960071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:38.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.741+0000 7f69737fe640 1 --2- 172.21.15.6:0/1881292315 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f696006f450 0x7f6960071960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f697414cce0 tx=0x7f69680090e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.761+0000 7f6970ff9640 1 -- 172.21.15.6:0/1881292315 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f6964057320 con 0x7f6974073ec0 2024-05-04T01:02:38.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.789+0000 7f6970ff9640 1 -- 172.21.15.6:0/1881292315 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6964022080 con 0x7f6974073ec0 2024-05-04T01:02:38.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.969+0000 7f697a910640 1 -- 172.21.15.6:0/1881292315 --> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f69741e82c0 con 0x7f696006f450 2024-05-04T01:02:38.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.989+0000 7f6970ff9640 1 -- 172.21.15.6:0/1881292315 <== mgr.4103 v2:172.21.15.163:6800/2152694980 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252720 (secure 0 0 0) 0x7f69741e82c0 con 0x7f696006f450 2024-05-04T01:02:38.994 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T01:02:38.996 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-04T01:02:38.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.993+0000 7f697a910640 1 -- 172.21.15.6:0/1881292315 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f696006f450 msgr2=0x7f6960071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:38.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.993+0000 7f697a910640 1 --2- 172.21.15.6:0/1881292315 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f696006f450 0x7f6960071960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f697414cce0 tx=0x7f69680090e0 comp rx=0 tx=0).stop 2024-05-04T01:02:38.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.993+0000 7f697a910640 1 -- 172.21.15.6:0/1881292315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6974073ec0 msgr2=0x7f69741f3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:38.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.993+0000 7f697a910640 1 --2- 172.21.15.6:0/1881292315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6974073ec0 0x7f69741f3730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f696400c3c0 tx=0x7f696400c880 comp rx=0 tx=0).stop 2024-05-04T01:02:38.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.993+0000 7f697a910640 1 -- 172.21.15.6:0/1881292315 shutdown_connections 2024-05-04T01:02:38.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.993+0000 7f697a910640 1 --2- 172.21.15.6:0/1881292315 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f696006f450 0x7f6960071960 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:38.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.993+0000 7f697a910640 1 --2- 172.21.15.6:0/1881292315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f697415cd10 0x7f6974149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:38.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.993+0000 7f697a910640 1 --2- 172.21.15.6:0/1881292315 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f69740cdeb0 0x7f697414c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:38.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.993+0000 7f697a910640 1 --2- 172.21.15.6:0/1881292315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6974073ec0 0x7f69741f3730 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:38.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.993+0000 7f697a910640 1 -- 172.21.15.6:0/1881292315 >> 172.21.15.6:0/1881292315 conn(0x7f6974070d60 msgr2=0x7f697415a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:38.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.993+0000 7f697a910640 1 -- 172.21.15.6:0/1881292315 shutdown_connections 2024-05-04T01:02:38.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:38.993+0000 7f697a910640 1 -- 172.21.15.6:0/1881292315 wait complete. 2024-05-04T01:02:39.019 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":987,"stamp":"2024-05-04T01:02:38.385928+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22768727,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":531,"num_read_kb":545,"num_write":8989,"num_write_kb":276827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8057,"ondisk_log_size":8057,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317136,"kb_used_data":46928,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754657584,"statfs":{"total":773094113280,"available":772769366016,"internally_reserved":0,"allocated":48054272,"data_stored":46427946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51017,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":52,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005691"},"pg_stats":[{"pgid":"3.3f","version":"28'39","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.841929+0000","last_change":"2024-05-04T00:31:21.410516+0000","last_active":"2024-05-04T01:02:31.841929+0000","last_peered":"2024-05-04T01:02:31.841929+0000","last_clean":"2024-05-04T01:02:31.841929+0000","last_became_active":"2024-05-04T00:31:21.409386+0000","last_became_peered":"2024-05-04T00:31:21.409386+0000","last_unstale":"2024-05-04T01:02:31.841929+0000","last_undegraded":"2024-05-04T01:02:31.841929+0000","last_fullsized":"2024-05-04T01:02:31.841929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:09:40.562107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":2475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'39","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.471532+0000","last_change":"2024-05-04T00:31:21.397440+0000","last_active":"2024-05-04T01:02:31.471532+0000","last_peered":"2024-05-04T01:02:31.471532+0000","last_clean":"2024-05-04T01:02:31.471532+0000","last_became_active":"2024-05-04T00:31:21.396255+0000","last_became_peered":"2024-05-04T00:31:21.396255+0000","last_unstale":"2024-05-04T01:02:31.471532+0000","last_undegraded":"2024-05-04T01:02:31.471532+0000","last_fullsized":"2024-05-04T01:02:31.471532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:07.460897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":1259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'53","reported_seq":89,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.469843+0000","last_change":"2024-05-04T00:31:21.442932+0000","last_active":"2024-05-04T01:02:31.469843+0000","last_peered":"2024-05-04T01:02:31.469843+0000","last_clean":"2024-05-04T01:02:31.469843+0000","last_became_active":"2024-05-04T00:31:21.442507+0000","last_became_peered":"2024-05-04T00:31:21.442507+0000","last_unstale":"2024-05-04T01:02:31.469843+0000","last_undegraded":"2024-05-04T01:02:31.469843+0000","last_fullsized":"2024-05-04T01:02:31.469843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:52:48.345813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":2592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"28'34","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.685927+0000","last_change":"2024-05-04T00:31:21.442087+0000","last_active":"2024-05-04T01:02:31.685927+0000","last_peered":"2024-05-04T01:02:31.685927+0000","last_clean":"2024-05-04T01:02:31.685927+0000","last_became_active":"2024-05-04T00:31:21.440935+0000","last_became_peered":"2024-05-04T00:31:21.440935+0000","last_unstale":"2024-05-04T01:02:31.685927+0000","last_undegraded":"2024-05-04T01:02:31.685927+0000","last_fullsized":"2024-05-04T01:02:31.685927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:02:02.166274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":1417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'35","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.835987+0000","last_change":"2024-05-04T00:31:21.408892+0000","last_active":"2024-05-04T01:02:31.835987+0000","last_peered":"2024-05-04T01:02:31.835987+0000","last_clean":"2024-05-04T01:02:31.835987+0000","last_became_active":"2024-05-04T00:31:21.402554+0000","last_became_peered":"2024-05-04T00:31:21.402554+0000","last_unstale":"2024-05-04T01:02:31.835987+0000","last_undegraded":"2024-05-04T01:02:31.835987+0000","last_fullsized":"2024-05-04T01:02:31.835987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:07.135906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":2934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'51","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.677056+0000","last_change":"2024-05-04T00:31:21.442773+0000","last_active":"2024-05-04T01:02:31.677056+0000","last_peered":"2024-05-04T01:02:31.677056+0000","last_clean":"2024-05-04T01:02:31.677056+0000","last_became_active":"2024-05-04T00:31:21.441082+0000","last_became_peered":"2024-05-04T00:31:21.441082+0000","last_unstale":"2024-05-04T01:02:31.677056+0000","last_undegraded":"2024-05-04T01:02:31.677056+0000","last_fullsized":"2024-05-04T01:02:31.677056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:54.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":4527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"28'38","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.824772+0000","last_change":"2024-05-04T00:31:21.441617+0000","last_active":"2024-05-04T01:02:31.824772+0000","last_peered":"2024-05-04T01:02:31.824772+0000","last_clean":"2024-05-04T01:02:31.824772+0000","last_became_active":"2024-05-04T00:31:21.440766+0000","last_became_peered":"2024-05-04T00:31:21.440766+0000","last_unstale":"2024-05-04T01:02:31.824772+0000","last_undegraded":"2024-05-04T01:02:31.824772+0000","last_fullsized":"2024-05-04T01:02:31.824772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:28:07.779536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":2716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"28'27","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.469564+0000","last_change":"2024-05-04T00:31:21.408515+0000","last_active":"2024-05-04T01:02:31.469564+0000","last_peered":"2024-05-04T01:02:31.469564+0000","last_clean":"2024-05-04T01:02:31.469564+0000","last_became_active":"2024-05-04T00:31:21.407785+0000","last_became_peered":"2024-05-04T00:31:21.407785+0000","last_unstale":"2024-05-04T01:02:31.469564+0000","last_undegraded":"2024-05-04T01:02:31.469564+0000","last_fullsized":"2024-05-04T01:02:31.469564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:42.617159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"28'58","reported_seq":91,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.367510+0000","last_change":"2024-05-04T00:31:21.400836+0000","last_active":"2024-05-04T01:02:31.367510+0000","last_peered":"2024-05-04T01:02:31.367510+0000","last_clean":"2024-05-04T01:02:31.367510+0000","last_became_active":"2024-05-04T00:31:21.400001+0000","last_became_peered":"2024-05-04T00:31:21.400001+0000","last_unstale":"2024-05-04T01:02:31.367510+0000","last_undegraded":"2024-05-04T01:02:31.367510+0000","last_fullsized":"2024-05-04T01:02:31.367510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:56.687510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":3953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"28'49","reported_seq":82,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.843190+0000","last_change":"2024-05-04T00:31:21.391806+0000","last_active":"2024-05-04T01:02:31.843190+0000","last_peered":"2024-05-04T01:02:31.843190+0000","last_clean":"2024-05-04T01:02:31.843190+0000","last_became_active":"2024-05-04T00:31:21.389347+0000","last_became_peered":"2024-05-04T00:31:21.389347+0000","last_unstale":"2024-05-04T01:02:31.843190+0000","last_undegraded":"2024-05-04T01:02:31.843190+0000","last_fullsized":"2024-05-04T01:02:31.843190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:40:12.379274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":5065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'36","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.843911+0000","last_change":"2024-05-04T00:31:21.396045+0000","last_active":"2024-05-04T01:02:31.843911+0000","last_peered":"2024-05-04T01:02:31.843911+0000","last_clean":"2024-05-04T01:02:31.843911+0000","last_became_active":"2024-05-04T00:31:21.385949+0000","last_became_peered":"2024-05-04T00:31:21.385949+0000","last_unstale":"2024-05-04T01:02:31.843911+0000","last_undegraded":"2024-05-04T01:02:31.843911+0000","last_fullsized":"2024-05-04T01:02:31.843911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:33.187636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"28'26","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.840904+0000","last_change":"2024-05-04T00:31:21.407987+0000","last_active":"2024-05-04T01:02:31.840904+0000","last_peered":"2024-05-04T01:02:31.840904+0000","last_clean":"2024-05-04T01:02:31.840904+0000","last_became_active":"2024-05-04T00:31:21.404557+0000","last_became_peered":"2024-05-04T00:31:21.404557+0000","last_unstale":"2024-05-04T01:02:31.840904+0000","last_undegraded":"2024-05-04T01:02:31.840904+0000","last_fullsized":"2024-05-04T01:02:31.840904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:00:51.313452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'80","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.427750+0000","last_change":"2024-05-04T00:31:21.389251+0000","last_active":"2024-05-04T01:02:31.427750+0000","last_peered":"2024-05-04T01:02:31.427750+0000","last_clean":"2024-05-04T01:02:31.427750+0000","last_became_active":"2024-05-04T00:31:21.387958+0000","last_became_peered":"2024-05-04T00:31:21.387958+0000","last_unstale":"2024-05-04T01:02:31.427750+0000","last_undegraded":"2024-05-04T01:02:31.427750+0000","last_fullsized":"2024-05-04T01:02:31.427750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:31.926158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":3559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"28'48","reported_seq":82,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.420705+0000","last_change":"2024-05-04T00:31:21.402284+0000","last_active":"2024-05-04T01:02:31.420705+0000","last_peered":"2024-05-04T01:02:31.420705+0000","last_clean":"2024-05-04T01:02:31.420705+0000","last_became_active":"2024-05-04T00:31:21.401495+0000","last_became_peered":"2024-05-04T00:31:21.401495+0000","last_unstale":"2024-05-04T01:02:31.420705+0000","last_undegraded":"2024-05-04T01:02:31.420705+0000","last_fullsized":"2024-05-04T01:02:31.420705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:09.622538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":5060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"28'52","reported_seq":86,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.443478+0000","last_change":"2024-05-04T00:31:21.410958+0000","last_active":"2024-05-04T01:02:31.443478+0000","last_peered":"2024-05-04T01:02:31.443478+0000","last_clean":"2024-05-04T01:02:31.443478+0000","last_became_active":"2024-05-04T00:31:21.410489+0000","last_became_peered":"2024-05-04T00:31:21.410489+0000","last_unstale":"2024-05-04T01:02:31.443478+0000","last_undegraded":"2024-05-04T01:02:31.443478+0000","last_fullsized":"2024-05-04T01:02:31.443478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:05:47.448392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'49","reported_seq":83,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.698662+0000","last_change":"2024-05-04T00:31:21.187055+0000","last_active":"2024-05-04T01:02:31.698662+0000","last_peered":"2024-05-04T01:02:31.698662+0000","last_clean":"2024-05-04T01:02:31.698662+0000","last_became_active":"2024-05-04T00:31:21.186141+0000","last_became_peered":"2024-05-04T00:31:21.186141+0000","last_unstale":"2024-05-04T01:02:31.698662+0000","last_undegraded":"2024-05-04T01:02:31.698662+0000","last_fullsized":"2024-05-04T01:02:31.698662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:53:13.451818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":5921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"28'39","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.685239+0000","last_change":"2024-05-04T00:31:21.406402+0000","last_active":"2024-05-04T01:02:31.685239+0000","last_peered":"2024-05-04T01:02:31.685239+0000","last_clean":"2024-05-04T01:02:31.685239+0000","last_became_active":"2024-05-04T00:31:21.389108+0000","last_became_peered":"2024-05-04T00:31:21.389108+0000","last_unstale":"2024-05-04T01:02:31.685239+0000","last_undegraded":"2024-05-04T01:02:31.685239+0000","last_fullsized":"2024-05-04T01:02:31.685239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:11:03.598993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'50","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.449234+0000","last_change":"2024-05-04T00:31:21.418601+0000","last_active":"2024-05-04T01:02:31.449234+0000","last_peered":"2024-05-04T01:02:31.449234+0000","last_clean":"2024-05-04T01:02:31.449234+0000","last_became_active":"2024-05-04T00:31:21.417914+0000","last_became_peered":"2024-05-04T00:31:21.417914+0000","last_unstale":"2024-05-04T01:02:31.449234+0000","last_undegraded":"2024-05-04T01:02:31.449234+0000","last_fullsized":"2024-05-04T01:02:31.449234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:23:35.270037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":3403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"28'50","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.692446+0000","last_change":"2024-05-04T00:31:21.441868+0000","last_active":"2024-05-04T01:02:31.692446+0000","last_peered":"2024-05-04T01:02:31.692446+0000","last_clean":"2024-05-04T01:02:31.692446+0000","last_became_active":"2024-05-04T00:31:21.440945+0000","last_became_peered":"2024-05-04T00:31:21.440945+0000","last_unstale":"2024-05-04T01:02:31.692446+0000","last_undegraded":"2024-05-04T01:02:31.692446+0000","last_fullsized":"2024-05-04T01:02:31.692446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:47:43.629512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":6197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"28'63","reported_seq":97,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.839764+0000","last_change":"2024-05-04T00:31:21.395356+0000","last_active":"2024-05-04T01:02:31.839764+0000","last_peered":"2024-05-04T01:02:31.839764+0000","last_clean":"2024-05-04T01:02:31.839764+0000","last_became_active":"2024-05-04T00:31:21.394461+0000","last_became_peered":"2024-05-04T00:31:21.394461+0000","last_unstale":"2024-05-04T01:02:31.839764+0000","last_undegraded":"2024-05-04T01:02:31.839764+0000","last_fullsized":"2024-05-04T01:02:31.839764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:42:31.303120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"28'59","reported_seq":93,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.540103+0000","last_change":"2024-05-04T00:31:21.446878+0000","last_active":"2024-05-04T01:02:31.540103+0000","last_peered":"2024-05-04T01:02:31.540103+0000","last_clean":"2024-05-04T01:02:31.540103+0000","last_became_active":"2024-05-04T00:31:21.446250+0000","last_became_peered":"2024-05-04T00:31:21.446250+0000","last_unstale":"2024-05-04T01:02:31.540103+0000","last_undegraded":"2024-05-04T01:02:31.540103+0000","last_fullsized":"2024-05-04T01:02:31.540103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:42.617159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":5743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"28'39","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.368262+0000","last_change":"2024-05-04T00:31:21.414182+0000","last_active":"2024-05-04T01:02:31.368262+0000","last_peered":"2024-05-04T01:02:31.368262+0000","last_clean":"2024-05-04T01:02:31.368262+0000","last_became_active":"2024-05-04T00:31:21.413073+0000","last_became_peered":"2024-05-04T00:31:21.413073+0000","last_unstale":"2024-05-04T01:02:31.368262+0000","last_undegraded":"2024-05-04T01:02:31.368262+0000","last_fullsized":"2024-05-04T01:02:31.368262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:23.471892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"28'57","reported_seq":91,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.457014+0000","last_change":"2024-05-04T00:31:21.403827+0000","last_active":"2024-05-04T01:02:31.457014+0000","last_peered":"2024-05-04T01:02:31.457014+0000","last_clean":"2024-05-04T01:02:31.457014+0000","last_became_active":"2024-05-04T00:31:21.402985+0000","last_became_peered":"2024-05-04T00:31:21.402985+0000","last_unstale":"2024-05-04T01:02:31.457014+0000","last_undegraded":"2024-05-04T01:02:31.457014+0000","last_fullsized":"2024-05-04T01:02:31.457014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:43:15.203235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":5055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'40","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.684142+0000","last_change":"2024-05-04T00:31:21.393270+0000","last_active":"2024-05-04T01:02:31.684142+0000","last_peered":"2024-05-04T01:02:31.684142+0000","last_clean":"2024-05-04T01:02:31.684142+0000","last_became_active":"2024-05-04T00:31:21.392368+0000","last_became_peered":"2024-05-04T00:31:21.392368+0000","last_unstale":"2024-05-04T01:02:31.684142+0000","last_undegraded":"2024-05-04T01:02:31.684142+0000","last_fullsized":"2024-05-04T01:02:31.684142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:49:22.354637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":4444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"28'33","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.431054+0000","last_change":"2024-05-04T00:31:21.416800+0000","last_active":"2024-05-04T01:02:31.431054+0000","last_peered":"2024-05-04T01:02:31.431054+0000","last_clean":"2024-05-04T01:02:31.431054+0000","last_became_active":"2024-05-04T00:31:21.415540+0000","last_became_peered":"2024-05-04T00:31:21.415540+0000","last_unstale":"2024-05-04T01:02:31.431054+0000","last_undegraded":"2024-05-04T01:02:31.431054+0000","last_fullsized":"2024-05-04T01:02:31.431054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:00:51.313452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"28'72","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.700962+0000","last_change":"2024-05-04T00:31:21.188504+0000","last_active":"2024-05-04T01:02:31.700962+0000","last_peered":"2024-05-04T01:02:31.700962+0000","last_clean":"2024-05-04T01:02:31.700962+0000","last_became_active":"2024-05-04T00:31:21.187877+0000","last_became_peered":"2024-05-04T00:31:21.187877+0000","last_unstale":"2024-05-04T01:02:31.700962+0000","last_undegraded":"2024-05-04T01:02:31.700962+0000","last_fullsized":"2024-05-04T01:02:31.700962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:48:39.671984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":3181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"28'39","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.408156+0000","last_change":"2024-05-04T00:31:21.393500+0000","last_active":"2024-05-04T01:02:31.408156+0000","last_peered":"2024-05-04T01:02:31.408156+0000","last_clean":"2024-05-04T01:02:31.408156+0000","last_became_active":"2024-05-04T00:31:21.392579+0000","last_became_peered":"2024-05-04T00:31:21.392579+0000","last_unstale":"2024-05-04T01:02:31.408156+0000","last_undegraded":"2024-05-04T01:02:31.408156+0000","last_fullsized":"2024-05-04T01:02:31.408156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:16.804136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":2828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"28'30","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.428999+0000","last_change":"2024-05-04T00:31:21.395778+0000","last_active":"2024-05-04T01:02:31.428999+0000","last_peered":"2024-05-04T01:02:31.428999+0000","last_clean":"2024-05-04T01:02:31.428999+0000","last_became_active":"2024-05-04T00:31:21.394966+0000","last_became_peered":"2024-05-04T00:31:21.394966+0000","last_unstale":"2024-05-04T01:02:31.428999+0000","last_undegraded":"2024-05-04T01:02:31.428999+0000","last_fullsized":"2024-05-04T01:02:31.428999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:53:28.166224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"28'34","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.456236+0000","last_change":"2024-05-04T00:31:21.405250+0000","last_active":"2024-05-04T01:02:31.456236+0000","last_peered":"2024-05-04T01:02:31.456236+0000","last_clean":"2024-05-04T01:02:31.456236+0000","last_became_active":"2024-05-04T00:31:21.403779+0000","last_became_peered":"2024-05-04T00:31:21.403779+0000","last_unstale":"2024-05-04T01:02:31.456236+0000","last_undegraded":"2024-05-04T01:02:31.456236+0000","last_fullsized":"2024-05-04T01:02:31.456236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:33.187636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":2736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"28'56","reported_seq":92,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.691846+0000","last_change":"2024-05-04T00:31:21.399896+0000","last_active":"2024-05-04T01:02:31.691846+0000","last_peered":"2024-05-04T01:02:31.691846+0000","last_clean":"2024-05-04T01:02:31.691846+0000","last_became_active":"2024-05-04T00:31:21.398994+0000","last_became_peered":"2024-05-04T00:31:21.398994+0000","last_unstale":"2024-05-04T01:02:31.691846+0000","last_undegraded":"2024-05-04T01:02:31.691846+0000","last_fullsized":"2024-05-04T01:02:31.691846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:32:42.591423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":5289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"28'49","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.449650+0000","last_change":"2024-05-04T00:31:21.416130+0000","last_active":"2024-05-04T01:02:31.449650+0000","last_peered":"2024-05-04T01:02:31.449650+0000","last_clean":"2024-05-04T01:02:31.449650+0000","last_became_active":"2024-05-04T00:31:21.415395+0000","last_became_peered":"2024-05-04T00:31:21.415395+0000","last_unstale":"2024-05-04T01:02:31.449650+0000","last_undegraded":"2024-05-04T01:02:31.449650+0000","last_fullsized":"2024-05-04T01:02:31.449650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:33:22.819977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":6794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'61","reported_seq":97,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.691358+0000","last_change":"2024-05-04T00:31:21.342105+0000","last_active":"2024-05-04T01:02:31.691358+0000","last_peered":"2024-05-04T01:02:31.691358+0000","last_clean":"2024-05-04T01:02:31.691358+0000","last_became_active":"2024-05-04T00:31:21.341333+0000","last_became_peered":"2024-05-04T00:31:21.341333+0000","last_unstale":"2024-05-04T01:02:31.691358+0000","last_undegraded":"2024-05-04T01:02:31.691358+0000","last_fullsized":"2024-05-04T01:02:31.691358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:23.471892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":5609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"28'25","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.370813+0000","last_change":"2024-05-04T00:31:21.405647+0000","last_active":"2024-05-04T01:02:31.370813+0000","last_peered":"2024-05-04T01:02:31.370813+0000","last_clean":"2024-05-04T01:02:31.370813+0000","last_became_active":"2024-05-04T00:31:21.403998+0000","last_became_peered":"2024-05-04T00:31:21.403998+0000","last_unstale":"2024-05-04T01:02:31.370813+0000","last_undegraded":"2024-05-04T01:02:31.370813+0000","last_fullsized":"2024-05-04T01:02:31.370813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:54.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"28'495","reported_seq":532,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:23.318163+0000","last_change":"2024-05-04T00:31:19.185018+0000","last_active":"2024-05-04T01:02:23.318163+0000","last_peered":"2024-05-04T01:02:23.318163+0000","last_clean":"2024-05-04T01:02:23.318163+0000","last_became_active":"2024-05-04T00:31:19.181107+0000","last_became_peered":"2024-05-04T00:31:19.181107+0000","last_unstale":"2024-05-04T01:02:23.318163+0000","last_undegraded":"2024-05-04T01:02:23.318163+0000","last_fullsized":"2024-05-04T01:02:23.318163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:14.453153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"28'45","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.542677+0000","last_change":"2024-05-04T00:31:21.446209+0000","last_active":"2024-05-04T01:02:31.542677+0000","last_peered":"2024-05-04T01:02:31.542677+0000","last_clean":"2024-05-04T01:02:31.542677+0000","last_became_active":"2024-05-04T00:31:21.445793+0000","last_became_peered":"2024-05-04T00:31:21.445793+0000","last_unstale":"2024-05-04T01:02:31.542677+0000","last_undegraded":"2024-05-04T01:02:31.542677+0000","last_fullsized":"2024-05-04T01:02:31.542677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:54:48.084884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"28'359","reported_seq":396,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:23.320461+0000","last_change":"2024-05-04T00:31:19.185102+0000","last_active":"2024-05-04T01:02:23.320461+0000","last_peered":"2024-05-04T01:02:23.320461+0000","last_clean":"2024-05-04T01:02:23.320461+0000","last_became_active":"2024-05-04T00:31:19.183394+0000","last_became_peered":"2024-05-04T00:31:19.183394+0000","last_unstale":"2024-05-04T01:02:23.320461+0000","last_undegraded":"2024-05-04T01:02:23.320461+0000","last_fullsized":"2024-05-04T01:02:23.320461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:36:38.420366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":4278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T00:58:02.556311+0000","last_change":"2024-05-04T00:31:19.158945+0000","last_active":"2024-05-04T00:58:02.556311+0000","last_peered":"2024-05-04T00:58:02.556311+0000","last_clean":"2024-05-04T00:58:02.556311+0000","last_became_active":"2024-05-04T00:31:19.158152+0000","last_became_peered":"2024-05-04T00:31:19.158152+0000","last_unstale":"2024-05-04T00:58:02.556311+0000","last_undegraded":"2024-05-04T00:58:02.556311+0000","last_fullsized":"2024-05-04T00:58:02.556311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:52.040804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'48","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.458775+0000","last_change":"2024-05-04T00:31:21.397183+0000","last_active":"2024-05-04T01:02:31.458775+0000","last_peered":"2024-05-04T01:02:31.458775+0000","last_clean":"2024-05-04T01:02:31.458775+0000","last_became_active":"2024-05-04T00:31:21.393014+0000","last_became_peered":"2024-05-04T00:31:21.393014+0000","last_unstale":"2024-05-04T01:02:31.458775+0000","last_undegraded":"2024-05-04T01:02:31.458775+0000","last_fullsized":"2024-05-04T01:02:31.458775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:40:12.379274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":2972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"28'7","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:52.153404+0000","last_change":"2024-05-04T00:31:19.186007+0000","last_active":"2024-05-04T01:01:52.153404+0000","last_peered":"2024-05-04T01:01:52.153404+0000","last_clean":"2024-05-04T01:01:52.153404+0000","last_became_active":"2024-05-04T00:31:19.184526+0000","last_became_peered":"2024-05-04T00:31:19.184526+0000","last_unstale":"2024-05-04T01:01:52.153404+0000","last_undegraded":"2024-05-04T01:01:52.153404+0000","last_fullsized":"2024-05-04T01:01:52.153404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:01:33.042606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"28'43","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.553685+0000","last_change":"2024-05-04T00:31:21.447258+0000","last_active":"2024-05-04T01:02:31.553685+0000","last_peered":"2024-05-04T01:02:31.553685+0000","last_clean":"2024-05-04T01:02:31.553685+0000","last_became_active":"2024-05-04T00:31:21.446842+0000","last_became_peered":"2024-05-04T00:31:21.446842+0000","last_unstale":"2024-05-04T01:02:31.553685+0000","last_undegraded":"2024-05-04T01:02:31.553685+0000","last_fullsized":"2024-05-04T01:02:31.553685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:10:57.675700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"28'10","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:58.543037+0000","last_change":"2024-05-04T00:31:19.190422+0000","last_active":"2024-05-04T01:01:58.543037+0000","last_peered":"2024-05-04T01:01:58.543037+0000","last_clean":"2024-05-04T01:01:58.543037+0000","last_became_active":"2024-05-04T00:31:19.189517+0000","last_became_peered":"2024-05-04T00:31:19.189517+0000","last_unstale":"2024-05-04T01:01:58.543037+0000","last_undegraded":"2024-05-04T01:01:58.543037+0000","last_fullsized":"2024-05-04T01:01:58.543037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:16:41.367677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"28'52","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.702363+0000","last_change":"2024-05-04T00:31:21.184586+0000","last_active":"2024-05-04T01:02:31.702363+0000","last_peered":"2024-05-04T01:02:31.702363+0000","last_clean":"2024-05-04T01:02:31.702363+0000","last_became_active":"2024-05-04T00:31:21.183698+0000","last_became_peered":"2024-05-04T00:31:21.183698+0000","last_unstale":"2024-05-04T01:02:31.702363+0000","last_undegraded":"2024-05-04T01:02:31.702363+0000","last_fullsized":"2024-05-04T01:02:31.702363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:47:25.699731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":3598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"28'5","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:02.892394+0000","last_change":"2024-05-04T00:31:19.186623+0000","last_active":"2024-05-04T01:02:02.892394+0000","last_peered":"2024-05-04T01:02:02.892394+0000","last_clean":"2024-05-04T01:02:02.892394+0000","last_became_active":"2024-05-04T00:31:19.185633+0000","last_became_peered":"2024-05-04T00:31:19.185633+0000","last_unstale":"2024-05-04T01:02:02.892394+0000","last_undegraded":"2024-05-04T01:02:02.892394+0000","last_fullsized":"2024-05-04T01:02:02.892394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:10:55.324717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"28'45","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.442971+0000","last_change":"2024-05-04T00:31:21.410329+0000","last_active":"2024-05-04T01:02:31.442971+0000","last_peered":"2024-05-04T01:02:31.442971+0000","last_clean":"2024-05-04T01:02:31.442971+0000","last_became_active":"2024-05-04T00:31:21.409655+0000","last_became_peered":"2024-05-04T00:31:21.409655+0000","last_unstale":"2024-05-04T01:02:31.442971+0000","last_undegraded":"2024-05-04T01:02:31.442971+0000","last_fullsized":"2024-05-04T01:02:31.442971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:09:40.562107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":5409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"28'348","reported_seq":385,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:30.340190+0000","last_change":"2024-05-04T00:31:19.178130+0000","last_active":"2024-05-04T01:02:30.340190+0000","last_peered":"2024-05-04T01:02:30.340190+0000","last_clean":"2024-05-04T01:02:30.340190+0000","last_became_active":"2024-05-04T00:31:19.177283+0000","last_became_peered":"2024-05-04T00:31:19.177283+0000","last_unstale":"2024-05-04T01:02:30.340190+0000","last_undegraded":"2024-05-04T01:02:30.340190+0000","last_fullsized":"2024-05-04T01:02:30.340190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:42:41.790988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"28'47","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.699191+0000","last_change":"2024-05-04T00:31:21.187102+0000","last_active":"2024-05-04T01:02:31.699191+0000","last_peered":"2024-05-04T01:02:31.699191+0000","last_clean":"2024-05-04T01:02:31.699191+0000","last_became_active":"2024-05-04T00:31:21.186167+0000","last_became_peered":"2024-05-04T00:31:21.186167+0000","last_unstale":"2024-05-04T01:02:31.699191+0000","last_undegraded":"2024-05-04T01:02:31.699191+0000","last_fullsized":"2024-05-04T01:02:31.699191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:05:04.013367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"28'812","reported_seq":850,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:28.319115+0000","last_change":"2024-05-04T00:31:19.251247+0000","last_active":"2024-05-04T01:02:28.319115+0000","last_peered":"2024-05-04T01:02:28.319115+0000","last_clean":"2024-05-04T01:02:28.319115+0000","last_became_active":"2024-05-04T00:31:19.250003+0000","last_became_peered":"2024-05-04T00:31:19.250003+0000","last_unstale":"2024-05-04T01:02:28.319115+0000","last_undegraded":"2024-05-04T01:02:28.319115+0000","last_fullsized":"2024-05-04T01:02:28.319115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:40:06.774090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":4562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"28'32","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.835367+0000","last_change":"2024-05-04T00:31:21.401432+0000","last_active":"2024-05-04T01:02:31.835367+0000","last_peered":"2024-05-04T01:02:31.835367+0000","last_clean":"2024-05-04T01:02:31.835367+0000","last_became_active":"2024-05-04T00:31:21.397220+0000","last_became_peered":"2024-05-04T00:31:21.397220+0000","last_unstale":"2024-05-04T01:02:31.835367+0000","last_undegraded":"2024-05-04T01:02:31.835367+0000","last_fullsized":"2024-05-04T01:02:31.835367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:07.460897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:40.484170+0000","last_change":"2024-05-04T00:31:19.183674+0000","last_active":"2024-05-04T01:01:40.484170+0000","last_peered":"2024-05-04T01:01:40.484170+0000","last_clean":"2024-05-04T01:01:40.484170+0000","last_became_active":"2024-05-04T00:31:19.183331+0000","last_became_peered":"2024-05-04T00:31:19.183331+0000","last_unstale":"2024-05-04T01:01:40.484170+0000","last_undegraded":"2024-05-04T01:01:40.484170+0000","last_fullsized":"2024-05-04T01:01:40.484170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:13:52.447627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"28'47","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.421027+0000","last_change":"2024-05-04T00:31:21.342578+0000","last_active":"2024-05-04T01:02:31.421027+0000","last_peered":"2024-05-04T01:02:31.421027+0000","last_clean":"2024-05-04T01:02:31.421027+0000","last_became_active":"2024-05-04T00:31:21.342064+0000","last_became_peered":"2024-05-04T00:31:21.342064+0000","last_unstale":"2024-05-04T01:02:31.421027+0000","last_undegraded":"2024-05-04T01:02:31.421027+0000","last_fullsized":"2024-05-04T01:02:31.421027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:35.377002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"28'10","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:16.788884+0000","last_change":"2024-05-04T00:31:19.184166+0000","last_active":"2024-05-04T01:02:16.788884+0000","last_peered":"2024-05-04T01:02:16.788884+0000","last_clean":"2024-05-04T01:02:16.788884+0000","last_became_active":"2024-05-04T00:31:19.181304+0000","last_became_peered":"2024-05-04T00:31:19.181304+0000","last_unstale":"2024-05-04T01:02:16.788884+0000","last_undegraded":"2024-05-04T01:02:16.788884+0000","last_fullsized":"2024-05-04T01:02:16.788884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:49:04.376111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'62","reported_seq":96,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.695730+0000","last_change":"2024-05-04T00:31:21.390252+0000","last_active":"2024-05-04T01:02:31.695730+0000","last_peered":"2024-05-04T01:02:31.695730+0000","last_clean":"2024-05-04T01:02:31.695730+0000","last_became_active":"2024-05-04T00:31:21.389360+0000","last_became_peered":"2024-05-04T00:31:21.389360+0000","last_unstale":"2024-05-04T01:02:31.695730+0000","last_undegraded":"2024-05-04T01:02:31.695730+0000","last_fullsized":"2024-05-04T01:02:31.695730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:45:23.177550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":7948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:57.630518+0000","last_change":"2024-05-04T00:31:19.176756+0000","last_active":"2024-05-04T01:01:57.630518+0000","last_peered":"2024-05-04T01:01:57.630518+0000","last_clean":"2024-05-04T01:01:57.630518+0000","last_became_active":"2024-05-04T00:31:19.175779+0000","last_became_peered":"2024-05-04T00:31:19.175779+0000","last_unstale":"2024-05-04T01:01:57.630518+0000","last_undegraded":"2024-05-04T01:01:57.630518+0000","last_fullsized":"2024-05-04T01:01:57.630518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:14.453153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'46","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.361428+0000","last_change":"2024-05-04T00:31:21.397306+0000","last_active":"2024-05-04T01:02:31.361428+0000","last_peered":"2024-05-04T01:02:31.361428+0000","last_clean":"2024-05-04T01:02:31.361428+0000","last_became_active":"2024-05-04T00:31:21.394863+0000","last_became_peered":"2024-05-04T00:31:21.394863+0000","last_unstale":"2024-05-04T01:02:31.361428+0000","last_undegraded":"2024-05-04T01:02:31.361428+0000","last_fullsized":"2024-05-04T01:02:31.361428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:46:38.463068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":4347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"28'17","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:42.389948+0000","last_change":"2024-05-04T00:31:19.177402+0000","last_active":"2024-05-04T01:01:42.389948+0000","last_peered":"2024-05-04T01:01:42.389948+0000","last_clean":"2024-05-04T01:01:42.389948+0000","last_became_active":"2024-05-04T00:31:19.176805+0000","last_became_peered":"2024-05-04T00:31:19.176805+0000","last_unstale":"2024-05-04T01:01:42.389948+0000","last_undegraded":"2024-05-04T01:01:42.389948+0000","last_fullsized":"2024-05-04T01:01:42.389948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:31.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'47","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.694612+0000","last_change":"2024-05-04T00:31:21.188457+0000","last_active":"2024-05-04T01:02:31.694612+0000","last_peered":"2024-05-04T01:02:31.694612+0000","last_clean":"2024-05-04T01:02:31.694612+0000","last_became_active":"2024-05-04T00:31:21.187554+0000","last_became_peered":"2024-05-04T00:31:21.187554+0000","last_unstale":"2024-05-04T01:02:31.694612+0000","last_undegraded":"2024-05-04T01:02:31.694612+0000","last_fullsized":"2024-05-04T01:02:31.694612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:31:55.671261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":6499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:23.368856+0000","last_change":"2024-05-04T00:31:19.176641+0000","last_active":"2024-05-04T01:02:23.368856+0000","last_peered":"2024-05-04T01:02:23.368856+0000","last_clean":"2024-05-04T01:02:23.368856+0000","last_became_active":"2024-05-04T00:31:19.175715+0000","last_became_peered":"2024-05-04T00:31:19.175715+0000","last_unstale":"2024-05-04T01:02:23.368856+0000","last_undegraded":"2024-05-04T01:02:23.368856+0000","last_fullsized":"2024-05-04T01:02:23.368856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:05:45.097410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"28'30","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.700719+0000","last_change":"2024-05-04T00:31:21.407554+0000","last_active":"2024-05-04T01:02:31.700719+0000","last_peered":"2024-05-04T01:02:31.700719+0000","last_clean":"2024-05-04T01:02:31.700719+0000","last_became_active":"2024-05-04T00:31:21.403004+0000","last_became_peered":"2024-05-04T00:31:21.403004+0000","last_unstale":"2024-05-04T01:02:31.700719+0000","last_undegraded":"2024-05-04T01:02:31.700719+0000","last_fullsized":"2024-05-04T01:02:31.700719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:33.938895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:23.316664+0000","last_change":"2024-05-04T00:31:19.187116+0000","last_active":"2024-05-04T01:02:23.316664+0000","last_peered":"2024-05-04T01:02:23.316664+0000","last_clean":"2024-05-04T01:02:23.316664+0000","last_became_active":"2024-05-04T00:31:19.186540+0000","last_became_peered":"2024-05-04T00:31:19.186540+0000","last_unstale":"2024-05-04T01:02:23.316664+0000","last_undegraded":"2024-05-04T01:02:23.316664+0000","last_fullsized":"2024-05-04T01:02:23.316664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:08.420067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"28'41","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.841254+0000","last_change":"2024-05-04T00:31:21.407986+0000","last_active":"2024-05-04T01:02:31.841254+0000","last_peered":"2024-05-04T01:02:31.841254+0000","last_clean":"2024-05-04T01:02:31.841254+0000","last_became_active":"2024-05-04T00:31:21.404350+0000","last_became_peered":"2024-05-04T00:31:21.404350+0000","last_unstale":"2024-05-04T01:02:31.841254+0000","last_undegraded":"2024-05-04T01:02:31.841254+0000","last_fullsized":"2024-05-04T01:02:31.841254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:12:34.898595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'2","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:00:35.381044+0000","last_change":"2024-05-04T00:31:19.190045+0000","last_active":"2024-05-04T01:00:35.381044+0000","last_peered":"2024-05-04T01:00:35.381044+0000","last_clean":"2024-05-04T01:00:35.381044+0000","last_became_active":"2024-05-04T00:31:19.189166+0000","last_became_peered":"2024-05-04T00:31:19.189166+0000","last_unstale":"2024-05-04T01:00:35.381044+0000","last_undegraded":"2024-05-04T01:00:35.381044+0000","last_fullsized":"2024-05-04T01:00:35.381044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:31.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"28'36","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.835864+0000","last_change":"2024-05-04T00:31:21.402171+0000","last_active":"2024-05-04T01:02:31.835864+0000","last_peered":"2024-05-04T01:02:31.835864+0000","last_clean":"2024-05-04T01:02:31.835864+0000","last_became_active":"2024-05-04T00:31:21.401467+0000","last_became_peered":"2024-05-04T00:31:21.401467+0000","last_unstale":"2024-05-04T01:02:31.835864+0000","last_undegraded":"2024-05-04T01:02:31.835864+0000","last_fullsized":"2024-05-04T01:02:31.835864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:34:25.722557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:03.938611+0000","last_change":"2024-05-04T00:31:19.155210+0000","last_active":"2024-05-04T01:02:03.938611+0000","last_peered":"2024-05-04T01:02:03.938611+0000","last_clean":"2024-05-04T01:02:03.938611+0000","last_became_active":"2024-05-04T00:31:19.154504+0000","last_became_peered":"2024-05-04T00:31:19.154504+0000","last_unstale":"2024-05-04T01:02:03.938611+0000","last_undegraded":"2024-05-04T01:02:03.938611+0000","last_fullsized":"2024-05-04T01:02:03.938611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:47:23.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'47","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.696865+0000","last_change":"2024-05-04T00:31:21.406273+0000","last_active":"2024-05-04T01:02:31.696865+0000","last_peered":"2024-05-04T01:02:31.696865+0000","last_clean":"2024-05-04T01:02:31.696865+0000","last_became_active":"2024-05-04T00:31:21.405283+0000","last_became_peered":"2024-05-04T00:31:21.405283+0000","last_unstale":"2024-05-04T01:02:31.696865+0000","last_undegraded":"2024-05-04T01:02:31.696865+0000","last_fullsized":"2024-05-04T01:02:31.696865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:20:31.795673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":136,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T00:58:47.566980+0000","last_change":"2024-05-04T00:30:40.841283+0000","last_active":"2024-05-04T00:58:47.566980+0000","last_peered":"2024-05-04T00:58:47.566980+0000","last_clean":"2024-05-04T00:58:47.566980+0000","last_became_active":"2024-05-04T00:30:40.838353+0000","last_became_peered":"2024-05-04T00:30:40.838353+0000","last_unstale":"2024-05-04T00:58:47.566980+0000","last_undegraded":"2024-05-04T00:58:47.566980+0000","last_fullsized":"2024-05-04T00:58:47.566980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:30:37.159356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:30:37.159356+0000","last_clean_scrub_stamp":"2024-05-04T00:30:37.159356+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:30:10.374994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"28'7","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:28.311754+0000","last_change":"2024-05-04T00:31:19.248691+0000","last_active":"2024-05-04T01:02:28.311754+0000","last_peered":"2024-05-04T01:02:28.311754+0000","last_clean":"2024-05-04T01:02:28.311754+0000","last_became_active":"2024-05-04T00:31:19.247815+0000","last_became_peered":"2024-05-04T00:31:19.247815+0000","last_unstale":"2024-05-04T01:02:28.311754+0000","last_undegraded":"2024-05-04T01:02:28.311754+0000","last_fullsized":"2024-05-04T01:02:28.311754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:46:05.720208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"28'34","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.533474+0000","last_change":"2024-05-04T00:31:21.446500+0000","last_active":"2024-05-04T01:02:31.533474+0000","last_peered":"2024-05-04T01:02:31.533474+0000","last_clean":"2024-05-04T01:02:31.533474+0000","last_became_active":"2024-05-04T00:31:21.446100+0000","last_became_peered":"2024-05-04T00:31:21.446100+0000","last_unstale":"2024-05-04T01:02:31.533474+0000","last_undegraded":"2024-05-04T01:02:31.533474+0000","last_fullsized":"2024-05-04T01:02:31.533474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:06.542614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"28'10","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:15.858216+0000","last_change":"2024-05-04T00:31:19.184044+0000","last_active":"2024-05-04T01:02:15.858216+0000","last_peered":"2024-05-04T01:02:15.858216+0000","last_clean":"2024-05-04T01:02:15.858216+0000","last_became_active":"2024-05-04T00:31:19.181956+0000","last_became_peered":"2024-05-04T00:31:19.181956+0000","last_unstale":"2024-05-04T01:02:15.858216+0000","last_undegraded":"2024-05-04T01:02:15.858216+0000","last_fullsized":"2024-05-04T01:02:15.858216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:09:33.607433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"28'23","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.425515+0000","last_change":"2024-05-04T00:31:21.343953+0000","last_active":"2024-05-04T01:02:31.425515+0000","last_peered":"2024-05-04T01:02:31.425515+0000","last_clean":"2024-05-04T01:02:31.425515+0000","last_became_active":"2024-05-04T00:31:21.343499+0000","last_became_peered":"2024-05-04T00:31:21.343499+0000","last_unstale":"2024-05-04T01:02:31.425515+0000","last_undegraded":"2024-05-04T01:02:31.425515+0000","last_fullsized":"2024-05-04T01:02:31.425515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:33.938895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"28'477","reported_seq":982,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.802778+0000","last_change":"2024-05-04T00:31:19.184947+0000","last_active":"2024-05-04T01:02:31.802778+0000","last_peered":"2024-05-04T01:02:31.802778+0000","last_clean":"2024-05-04T01:02:31.802778+0000","last_became_active":"2024-05-04T00:31:19.184606+0000","last_became_peered":"2024-05-04T00:31:19.184606+0000","last_unstale":"2024-05-04T01:02:31.802778+0000","last_undegraded":"2024-05-04T01:02:31.802778+0000","last_fullsized":"2024-05-04T01:02:31.802778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:07:49.638230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109877,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":465,"num_read_kb":490,"num_write":474,"num_write_kb":495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"28'42","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.432000+0000","last_change":"2024-05-04T00:31:21.402799+0000","last_active":"2024-05-04T01:02:31.432000+0000","last_peered":"2024-05-04T01:02:31.432000+0000","last_clean":"2024-05-04T01:02:31.432000+0000","last_became_active":"2024-05-04T00:31:21.401591+0000","last_became_peered":"2024-05-04T00:31:21.401591+0000","last_unstale":"2024-05-04T01:02:31.432000+0000","last_undegraded":"2024-05-04T01:02:31.432000+0000","last_fullsized":"2024-05-04T01:02:31.432000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:28:07.779536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"28'6","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:28.312950+0000","last_change":"2024-05-04T00:31:19.182214+0000","last_active":"2024-05-04T01:02:28.312950+0000","last_peered":"2024-05-04T01:02:28.312950+0000","last_clean":"2024-05-04T01:02:28.312950+0000","last_became_active":"2024-05-04T00:31:19.180317+0000","last_became_peered":"2024-05-04T00:31:19.180317+0000","last_unstale":"2024-05-04T01:02:28.312950+0000","last_undegraded":"2024-05-04T01:02:28.312950+0000","last_fullsized":"2024-05-04T01:02:28.312950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:44.678316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"28'41","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.432070+0000","last_change":"2024-05-04T00:32:21.647507+0000","last_active":"2024-05-04T01:02:31.432070+0000","last_peered":"2024-05-04T01:02:31.432070+0000","last_clean":"2024-05-04T01:02:31.432070+0000","last_became_active":"2024-05-04T00:32:21.646617+0000","last_became_peered":"2024-05-04T00:32:21.646617+0000","last_unstale":"2024-05-04T01:02:31.432070+0000","last_undegraded":"2024-05-04T01:02:31.432070+0000","last_fullsized":"2024-05-04T01:02:31.432070+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:09:35.958415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"28'2","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:28.316123+0000","last_change":"2024-05-04T00:31:19.183991+0000","last_active":"2024-05-04T01:02:28.316123+0000","last_peered":"2024-05-04T01:02:28.316123+0000","last_clean":"2024-05-04T01:02:28.316123+0000","last_became_active":"2024-05-04T00:31:19.179785+0000","last_became_peered":"2024-05-04T00:31:19.179785+0000","last_unstale":"2024-05-04T01:02:28.316123+0000","last_undegraded":"2024-05-04T01:02:28.316123+0000","last_fullsized":"2024-05-04T01:02:28.316123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:29.575176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"28'35","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.677677+0000","last_change":"2024-05-04T00:31:21.342687+0000","last_active":"2024-05-04T01:02:31.677677+0000","last_peered":"2024-05-04T01:02:31.677677+0000","last_clean":"2024-05-04T01:02:31.677677+0000","last_became_active":"2024-05-04T00:31:21.341702+0000","last_became_peered":"2024-05-04T00:31:21.341702+0000","last_unstale":"2024-05-04T01:02:31.677677+0000","last_undegraded":"2024-05-04T01:02:31.677677+0000","last_fullsized":"2024-05-04T01:02:31.677677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:56.687510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":3658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:16.832909+0000","last_change":"2024-05-04T00:31:19.176663+0000","last_active":"2024-05-04T01:02:16.832909+0000","last_peered":"2024-05-04T01:02:16.832909+0000","last_clean":"2024-05-04T01:02:16.832909+0000","last_became_active":"2024-05-04T00:31:19.175616+0000","last_became_peered":"2024-05-04T00:31:19.175616+0000","last_unstale":"2024-05-04T01:02:16.832909+0000","last_undegraded":"2024-05-04T01:02:16.832909+0000","last_fullsized":"2024-05-04T01:02:16.832909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:24:47.124717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'38","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.419685+0000","last_change":"2024-05-04T00:31:21.403129+0000","last_active":"2024-05-04T01:02:31.419685+0000","last_peered":"2024-05-04T01:02:31.419685+0000","last_clean":"2024-05-04T01:02:31.419685+0000","last_became_active":"2024-05-04T00:31:21.402248+0000","last_became_peered":"2024-05-04T00:31:21.402248+0000","last_unstale":"2024-05-04T01:02:31.419685+0000","last_undegraded":"2024-05-04T01:02:31.419685+0000","last_fullsized":"2024-05-04T01:02:31.419685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:10.771050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":1649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"28'1198","reported_seq":1237,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:30.508455+0000","last_change":"2024-05-04T00:31:19.155903+0000","last_active":"2024-05-04T01:02:30.508455+0000","last_peered":"2024-05-04T01:02:30.508455+0000","last_clean":"2024-05-04T01:02:30.508455+0000","last_became_active":"2024-05-04T00:31:19.154909+0000","last_became_peered":"2024-05-04T00:31:19.154909+0000","last_unstale":"2024-05-04T01:02:30.508455+0000","last_undegraded":"2024-05-04T01:02:30.508455+0000","last_fullsized":"2024-05-04T01:02:30.508455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1198,"log_dups_size":0,"ondisk_log_size":1198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:53:25.815241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2862,"num_write_kb":974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'37","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.549167+0000","last_change":"2024-05-04T00:31:21.445396+0000","last_active":"2024-05-04T01:02:31.549167+0000","last_peered":"2024-05-04T01:02:31.549167+0000","last_clean":"2024-05-04T01:02:31.549167+0000","last_became_active":"2024-05-04T00:31:21.444934+0000","last_became_peered":"2024-05-04T00:31:21.444934+0000","last_unstale":"2024-05-04T01:02:31.549167+0000","last_undegraded":"2024-05-04T01:02:31.549167+0000","last_fullsized":"2024-05-04T01:02:31.549167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:23:02.407000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'10","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:30.330017+0000","last_change":"2024-05-04T00:31:19.182946+0000","last_active":"2024-05-04T01:02:30.330017+0000","last_peered":"2024-05-04T01:02:30.330017+0000","last_clean":"2024-05-04T01:02:30.330017+0000","last_became_active":"2024-05-04T00:31:19.182050+0000","last_became_peered":"2024-05-04T00:31:19.182050+0000","last_unstale":"2024-05-04T01:02:30.330017+0000","last_undegraded":"2024-05-04T01:02:30.330017+0000","last_fullsized":"2024-05-04T01:02:30.330017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:55:12.448558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'45","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.537417+0000","last_change":"2024-05-04T00:31:21.443100+0000","last_active":"2024-05-04T01:02:31.537417+0000","last_peered":"2024-05-04T01:02:31.537417+0000","last_clean":"2024-05-04T01:02:31.537417+0000","last_became_active":"2024-05-04T00:31:21.442602+0000","last_became_peered":"2024-05-04T00:31:21.442602+0000","last_unstale":"2024-05-04T01:02:31.537417+0000","last_undegraded":"2024-05-04T01:02:31.537417+0000","last_fullsized":"2024-05-04T01:02:31.537417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:16:45.807230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":5859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'4","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:15.855817+0000","last_change":"2024-05-04T00:31:19.248358+0000","last_active":"2024-05-04T01:02:15.855817+0000","last_peered":"2024-05-04T01:02:15.855817+0000","last_clean":"2024-05-04T01:02:15.855817+0000","last_became_active":"2024-05-04T00:31:19.247822+0000","last_became_peered":"2024-05-04T00:31:19.247822+0000","last_unstale":"2024-05-04T01:02:15.855817+0000","last_undegraded":"2024-05-04T01:02:15.855817+0000","last_fullsized":"2024-05-04T01:02:15.855817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:04.191631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"28'37","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:40.508031+0000","last_change":"2024-05-04T00:31:21.441959+0000","last_active":"2024-05-04T01:01:40.508031+0000","last_peered":"2024-05-04T01:01:40.508031+0000","last_clean":"2024-05-04T01:01:40.508031+0000","last_became_active":"2024-05-04T00:31:21.441015+0000","last_became_peered":"2024-05-04T00:31:21.441015+0000","last_unstale":"2024-05-04T01:01:40.508031+0000","last_undegraded":"2024-05-04T01:01:40.508031+0000","last_fullsized":"2024-05-04T01:01:40.508031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:54:30.187813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'10","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:23.316808+0000","last_change":"2024-05-04T00:31:19.159146+0000","last_active":"2024-05-04T01:02:23.316808+0000","last_peered":"2024-05-04T01:02:23.316808+0000","last_clean":"2024-05-04T01:02:23.316808+0000","last_became_active":"2024-05-04T00:31:19.158366+0000","last_became_peered":"2024-05-04T00:31:19.158366+0000","last_unstale":"2024-05-04T01:02:23.316808+0000","last_undegraded":"2024-05-04T01:02:23.316808+0000","last_fullsized":"2024-05-04T01:02:23.316808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:07.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'51","reported_seq":86,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.533109+0000","last_change":"2024-05-04T00:31:21.441521+0000","last_active":"2024-05-04T01:02:31.533109+0000","last_peered":"2024-05-04T01:02:31.533109+0000","last_clean":"2024-05-04T01:02:31.533109+0000","last_became_active":"2024-05-04T00:31:21.441074+0000","last_became_peered":"2024-05-04T00:31:21.441074+0000","last_unstale":"2024-05-04T01:02:31.533109+0000","last_undegraded":"2024-05-04T01:02:31.533109+0000","last_fullsized":"2024-05-04T01:02:31.533109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:31.926158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"28'3","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:02.977229+0000","last_change":"2024-05-04T00:31:19.174493+0000","last_active":"2024-05-04T01:02:02.977229+0000","last_peered":"2024-05-04T01:02:02.977229+0000","last_clean":"2024-05-04T01:02:02.977229+0000","last_became_active":"2024-05-04T00:31:19.174113+0000","last_became_peered":"2024-05-04T00:31:19.174113+0000","last_unstale":"2024-05-04T01:02:02.977229+0000","last_undegraded":"2024-05-04T01:02:02.977229+0000","last_fullsized":"2024-05-04T01:02:02.977229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:54.336528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"28'49","reported_seq":83,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.436970+0000","last_change":"2024-05-04T00:31:21.406782+0000","last_active":"2024-05-04T01:02:31.436970+0000","last_peered":"2024-05-04T01:02:31.436970+0000","last_clean":"2024-05-04T01:02:31.436970+0000","last_became_active":"2024-05-04T00:31:21.406008+0000","last_became_peered":"2024-05-04T00:31:21.406008+0000","last_unstale":"2024-05-04T01:02:31.436970+0000","last_undegraded":"2024-05-04T01:02:31.436970+0000","last_fullsized":"2024-05-04T01:02:31.436970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:24:01.565048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":5340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"28'574","reported_seq":612,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:03.886093+0000","last_change":"2024-05-04T00:31:19.248682+0000","last_active":"2024-05-04T01:02:03.886093+0000","last_peered":"2024-05-04T01:02:03.886093+0000","last_clean":"2024-05-04T01:02:03.886093+0000","last_became_active":"2024-05-04T00:31:19.247736+0000","last_became_peered":"2024-05-04T00:31:19.247736+0000","last_unstale":"2024-05-04T01:02:03.886093+0000","last_undegraded":"2024-05-04T01:02:03.886093+0000","last_fullsized":"2024-05-04T01:02:03.886093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:42:59.459764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":570,"num_write_kb":4382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"28'46","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.694414+0000","last_change":"2024-05-04T00:31:21.401858+0000","last_active":"2024-05-04T01:02:31.694414+0000","last_peered":"2024-05-04T01:02:31.694414+0000","last_clean":"2024-05-04T01:02:31.694414+0000","last_became_active":"2024-05-04T00:31:21.400935+0000","last_became_peered":"2024-05-04T00:31:21.400935+0000","last_unstale":"2024-05-04T01:02:31.694414+0000","last_undegraded":"2024-05-04T01:02:31.694414+0000","last_fullsized":"2024-05-04T01:02:31.694414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:50:11.762845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"28'52","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.696600+0000","last_change":"2024-05-04T00:31:21.392918+0000","last_active":"2024-05-04T01:02:31.696600+0000","last_peered":"2024-05-04T01:02:31.696600+0000","last_clean":"2024-05-04T01:02:31.696600+0000","last_became_active":"2024-05-04T00:31:21.392020+0000","last_became_peered":"2024-05-04T00:31:21.392020+0000","last_unstale":"2024-05-04T01:02:31.696600+0000","last_undegraded":"2024-05-04T01:02:31.696600+0000","last_fullsized":"2024-05-04T01:02:31.696600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:19:30.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":3157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:32.731087+0000","last_change":"2024-05-04T00:31:19.187930+0000","last_active":"2024-05-04T01:01:32.731087+0000","last_peered":"2024-05-04T01:01:32.731087+0000","last_clean":"2024-05-04T01:01:32.731087+0000","last_became_active":"2024-05-04T00:31:19.185156+0000","last_became_peered":"2024-05-04T00:31:19.185156+0000","last_unstale":"2024-05-04T01:01:32.731087+0000","last_undegraded":"2024-05-04T01:01:32.731087+0000","last_fullsized":"2024-05-04T01:01:32.731087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:40.266177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'39","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.367470+0000","last_change":"2024-05-04T00:31:21.397596+0000","last_active":"2024-05-04T01:02:31.367470+0000","last_peered":"2024-05-04T01:02:31.367470+0000","last_clean":"2024-05-04T01:02:31.367470+0000","last_became_active":"2024-05-04T00:31:21.396023+0000","last_became_peered":"2024-05-04T00:31:21.396023+0000","last_unstale":"2024-05-04T01:02:31.367470+0000","last_undegraded":"2024-05-04T01:02:31.367470+0000","last_fullsized":"2024-05-04T01:02:31.367470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:02:02.166274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"28'11","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:15.854981+0000","last_change":"2024-05-04T00:31:19.189413+0000","last_active":"2024-05-04T01:02:15.854981+0000","last_peered":"2024-05-04T01:02:15.854981+0000","last_clean":"2024-05-04T01:02:15.854981+0000","last_became_active":"2024-05-04T00:31:19.188359+0000","last_became_peered":"2024-05-04T00:31:19.188359+0000","last_unstale":"2024-05-04T01:02:15.854981+0000","last_undegraded":"2024-05-04T01:02:15.854981+0000","last_fullsized":"2024-05-04T01:02:15.854981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:16:43.456248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"28'51","reported_seq":87,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.471110+0000","last_change":"2024-05-04T00:31:21.417364+0000","last_active":"2024-05-04T01:02:31.471110+0000","last_peered":"2024-05-04T01:02:31.471110+0000","last_clean":"2024-05-04T01:02:31.471110+0000","last_became_active":"2024-05-04T00:31:21.416267+0000","last_became_peered":"2024-05-04T00:31:21.416267+0000","last_unstale":"2024-05-04T01:02:31.471110+0000","last_undegraded":"2024-05-04T01:02:31.471110+0000","last_fullsized":"2024-05-04T01:02:31.471110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:42:31.303120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":6244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"28'119","reported_seq":159,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.967954+0000","last_change":"2024-05-04T00:31:19.187081+0000","last_active":"2024-05-04T01:02:31.967954+0000","last_peered":"2024-05-04T01:02:31.967954+0000","last_clean":"2024-05-04T01:02:31.967954+0000","last_became_active":"2024-05-04T00:31:19.186483+0000","last_became_peered":"2024-05-04T00:31:19.186483+0000","last_unstale":"2024-05-04T01:02:31.967954+0000","last_undegraded":"2024-05-04T01:02:31.967954+0000","last_fullsized":"2024-05-04T01:02:31.967954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:07.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092188,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":1130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"28'29","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.430195+0000","last_change":"2024-05-04T00:31:21.414034+0000","last_active":"2024-05-04T01:02:31.430195+0000","last_peered":"2024-05-04T01:02:31.430195+0000","last_clean":"2024-05-04T01:02:31.430195+0000","last_became_active":"2024-05-04T00:31:21.413330+0000","last_became_peered":"2024-05-04T00:31:21.413330+0000","last_unstale":"2024-05-04T01:02:31.430195+0000","last_undegraded":"2024-05-04T01:02:31.430195+0000","last_fullsized":"2024-05-04T01:02:31.430195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:07.135906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":2406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"28'620","reported_seq":660,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:11.537008+0000","last_change":"2024-05-04T00:31:19.175936+0000","last_active":"2024-05-04T01:02:11.537008+0000","last_peered":"2024-05-04T01:02:11.537008+0000","last_clean":"2024-05-04T01:02:11.537008+0000","last_became_active":"2024-05-04T00:31:19.175356+0000","last_became_peered":"2024-05-04T00:31:19.175356+0000","last_unstale":"2024-05-04T01:02:11.537008+0000","last_undegraded":"2024-05-04T01:02:11.537008+0000","last_fullsized":"2024-05-04T01:02:11.537008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:33.026019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":4428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2165,"num_write_kb":250211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2827,"ondisk_log_size":2827,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22178359,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":465,"num_read_kb":490,"num_write":6723,"num_write_kb":24988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44507136,"data_stored":44356718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5158,"ondisk_log_size":5158,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509830,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":4396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":4501504,"data_stored":4307686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509830,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35536,"kb_used_data":8520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336304,"statfs":{"total":96636764160,"available":96600375296,"internally_reserved":0,"allocated":8724480,"data_stored":8502444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509831,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43828,"kb_used_data":8492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328012,"statfs":{"total":96636764160,"available":96591884288,"internally_reserved":0,"allocated":8695808,"data_stored":8500910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509831,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":897024,"data_stored":702124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509830,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43900,"kb_used_data":4404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327940,"statfs":{"total":96636764160,"available":96591810560,"internally_reserved":0,"allocated":4509696,"data_stored":4307216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542533,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1523712,"data_stored":1313341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542533,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41496,"kb_used_data":6160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330344,"statfs":{"total":96636764160,"available":96594272256,"internally_reserved":0,"allocated":6307840,"data_stored":6098491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542533,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52088,"kb_used_data":12592,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319752,"statfs":{"total":96636764160,"available":96583426048,"internally_reserved":0,"allocated":12894208,"data_stored":12695734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4195620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12599296,"data_stored":12584138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8429568,"data_stored":8390848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5419008,"data_stored":5397665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4196090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1228800,"data_stored":1202883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T01:02:39.023 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-04T01:02:39.023 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T01:02:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.217+0000 7f94602b1640 1 Processor -- start 2024-05-04T01:02:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.217+0000 7f94602b1640 1 -- start start 2024-05-04T01:02:39.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.217+0000 7f94602b1640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94581541f0 0x7f9458159e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:39.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.217+0000 7f94602b1640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f94580c5800 0x7f94580ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:39.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.217+0000 7f94602b1640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f945815a6c0 con 0x7f94580c5c10 2024-05-04T01:02:39.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.217+0000 7f94602b1640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f94580c4db0 con 0x7f94580c5800 2024-05-04T01:02:39.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.217+0000 7f94602b1640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f945815a9a0 con 0x7f94581541f0 2024-05-04T01:02:39.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.217+0000 7f945e84e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f94580c5c10 0x7f945815d470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48750/0 (socket says 172.21.15.6:48750) 2024-05-04T01:02:39.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.217+0000 7f945e84e640 1 -- 172.21.15.6:0/3724637567 learned_addr learned my addr 172.21.15.6:0/3724637567 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T01:02:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.225+0000 7f945d84c640 1 --2- 172.21.15.6:0/3724637567 >> v2:172.21.15.163:3300/0 conn(0x7f94580c5800 0x7f94580ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:39.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.229+0000 7f945e04d640 1 --2- 172.21.15.6:0/3724637567 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94581541f0 0x7f9458159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:39.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.233+0000 7f945d84c640 1 -- 172.21.15.6:0/3724637567 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94581541f0 msgr2=0x7f9458159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:39.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.233+0000 7f945d84c640 1 --2- 172.21.15.6:0/3724637567 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94581541f0 0x7f9458159e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:39.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.233+0000 7f945d84c640 1 -- 172.21.15.6:0/3724637567 >> v1:172.21.15.6:6789/0 conn(0x7f94580c5c10 legacy=0x7f945815d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:39.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.233+0000 7f945d84c640 1 -- 172.21.15.6:0/3724637567 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945815ac80 con 0x7f94580c5800 2024-05-04T01:02:39.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.241+0000 7f945d84c640 1 --2- 172.21.15.6:0/3724637567 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94580c5800 0x7f94580ca420 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f944c0097c0 tx=0x7f944c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c6ce26e0f597542 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.361+0000 7f945d04b640 1 -- 172.21.15.6:0/3724637567 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c0b0070 con 0x7f94580c5800 2024-05-04T01:02:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.361+0000 7f945d04b640 1 -- 172.21.15.6:0/3724637567 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f944c0ab600 con 0x7f94580c5800 2024-05-04T01:02:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.361+0000 7f945d04b640 1 -- 172.21.15.6:0/3724637567 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c0ab9d0 con 0x7f94580c5800 2024-05-04T01:02:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.361+0000 7f94602b1640 1 -- 172.21.15.6:0/3724637567 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94580c5800 msgr2=0x7f94580ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.361+0000 7f94602b1640 1 --2- 172.21.15.6:0/3724637567 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94580c5800 0x7f94580ca420 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f944c0097c0 tx=0x7f944c01c4a0 comp rx=0 tx=0).stop 2024-05-04T01:02:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.361+0000 7f94602b1640 1 -- 172.21.15.6:0/3724637567 shutdown_connections 2024-05-04T01:02:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.361+0000 7f94602b1640 1 --2- 172.21.15.6:0/3724637567 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94580c5800 0x7f94580ca420 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.361+0000 7f94602b1640 1 --2- 172.21.15.6:0/3724637567 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94581541f0 0x7f9458159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.361+0000 7f94602b1640 1 -- 172.21.15.6:0/3724637567 >> 172.21.15.6:0/3724637567 conn(0x7f9458072ce0 msgr2=0x7f94580704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.361+0000 7f94602b1640 1 -- 172.21.15.6:0/3724637567 shutdown_connections 2024-05-04T01:02:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.361+0000 7f94602b1640 1 -- 172.21.15.6:0/3724637567 wait complete. 2024-05-04T01:02:39.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.365+0000 7f94602b1640 1 Processor -- start 2024-05-04T01:02:39.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.365+0000 7f94602b1640 1 -- start start 2024-05-04T01:02:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.369+0000 7f94602b1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94580c5800 0x7f94580b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.369+0000 7f94602b1640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94580c5c10 0x7f9458145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.369+0000 7f94602b1640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94581541f0 0x7f9458146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.369+0000 7f94602b1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9458070de0 con 0x7f94580c5800 2024-05-04T01:02:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.369+0000 7f94602b1640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f94580cb800 con 0x7f94581541f0 2024-05-04T01:02:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.369+0000 7f94602b1640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f9458070f60 con 0x7f94580c5c10 2024-05-04T01:02:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.369+0000 7f945e04d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94580c5800 0x7f94580b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.369+0000 7f945e04d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94580c5800 0x7f94580b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57532/0 (socket says 172.21.15.6:57532) 2024-05-04T01:02:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.369+0000 7f945e04d640 1 -- 172.21.15.6:0/680121899 learned_addr learned my addr 172.21.15.6:0/680121899 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.373+0000 7f945d84c640 1 --2- 172.21.15.6:0/680121899 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94580c5c10 0x7f9458145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.377+0000 7f945e04d640 1 -- 172.21.15.6:0/680121899 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94580c5c10 msgr2=0x7f9458145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.377+0000 7f945e04d640 1 --2- 172.21.15.6:0/680121899 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94580c5c10 0x7f9458145ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.377+0000 7f945e04d640 1 -- 172.21.15.6:0/680121899 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94581541f0 msgr2=0x7f9458146400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.377+0000 7f945e04d640 1 --2- 172.21.15.6:0/680121899 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94581541f0 0x7f9458146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.377+0000 7f945e04d640 1 -- 172.21.15.6:0/680121899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94580b4390 con 0x7f94580c5800 2024-05-04T01:02:39.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.377+0000 7f945e04d640 1 --2- 172.21.15.6:0/680121899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94580c5800 0x7f94580b3bc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f944800c820 tx=0x7f944800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.385+0000 7f9456ffd640 1 -- 172.21.15.6:0/680121899 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9448015070 con 0x7f94580c5800 2024-05-04T01:02:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.385+0000 7f9456ffd640 1 -- 172.21.15.6:0/680121899 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9448007a30 con 0x7f94580c5800 2024-05-04T01:02:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.385+0000 7f94602b1640 1 -- 172.21.15.6:0/680121899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94580b4930 con 0x7f94580c5800 2024-05-04T01:02:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.385+0000 7f9456ffd640 1 -- 172.21.15.6:0/680121899 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9448007e20 con 0x7f94580c5800 2024-05-04T01:02:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.385+0000 7f94602b1640 1 -- 172.21.15.6:0/680121899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94580b4650 con 0x7f94580c5800 2024-05-04T01:02:39.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.385+0000 7f94602b1640 1 -- 172.21.15.6:0/680121899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9458069a50 con 0x7f94580c5800 2024-05-04T01:02:39.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.737+0000 7f9456ffd640 1 -- 172.21.15.6:0/680121899 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9448018070 con 0x7f94580c5800 2024-05-04T01:02:39.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.737+0000 7f9456ffd640 1 --2- 172.21.15.6:0/680121899 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f944406f450 0x7f9444071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:39.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.737+0000 7f945d84c640 1 --2- 172.21.15.6:0/680121899 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f944406f450 0x7f9444071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:39.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.741+0000 7f945d84c640 1 --2- 172.21.15.6:0/680121899 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f944406f450 0x7f9444071960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f944c0ad000 tx=0x7f944c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.777+0000 7f9456ffd640 1 -- 172.21.15.6:0/680121899 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f94480580b0 con 0x7f94580c5800 2024-05-04T01:02:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.781+0000 7f9456ffd640 1 -- 172.21.15.6:0/680121899 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f944805be20 con 0x7f94580c5800 2024-05-04T01:02:39.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.965+0000 7f94602b1640 1 -- 172.21.15.6:0/680121899 --> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f94580caf60 con 0x7f944406f450 2024-05-04T01:02:39.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.985+0000 7f9456ffd640 1 -- 172.21.15.6:0/680121899 <== mgr.4103 v2:172.21.15.163:6800/2152694980 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252720 (secure 0 0 0) 0x7f94580caf60 con 0x7f944406f450 2024-05-04T01:02:39.989 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T01:02:39.991 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-04T01:02:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.989+0000 7f94602b1640 1 -- 172.21.15.6:0/680121899 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f944406f450 msgr2=0x7f9444071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.989+0000 7f94602b1640 1 --2- 172.21.15.6:0/680121899 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f944406f450 0x7f9444071960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f944c0ad000 tx=0x7f944c008040 comp rx=0 tx=0).stop 2024-05-04T01:02:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.989+0000 7f94602b1640 1 -- 172.21.15.6:0/680121899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94580c5800 msgr2=0x7f94580b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.989+0000 7f94602b1640 1 --2- 172.21.15.6:0/680121899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94580c5800 0x7f94580b3bc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f944800c820 tx=0x7f944800cce0 comp rx=0 tx=0).stop 2024-05-04T01:02:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.989+0000 7f94602b1640 1 -- 172.21.15.6:0/680121899 shutdown_connections 2024-05-04T01:02:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.989+0000 7f94602b1640 1 --2- 172.21.15.6:0/680121899 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94581541f0 0x7f9458146400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:39.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.989+0000 7f94602b1640 1 --2- 172.21.15.6:0/680121899 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f944406f450 0x7f9444071960 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:39.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.989+0000 7f94602b1640 1 --2- 172.21.15.6:0/680121899 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94580c5c10 0x7f9458145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:39.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.989+0000 7f94602b1640 1 --2- 172.21.15.6:0/680121899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94580c5800 0x7f94580b3bc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:39.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.989+0000 7f94602b1640 1 -- 172.21.15.6:0/680121899 >> 172.21.15.6:0/680121899 conn(0x7f9458072ce0 msgr2=0x7f94580cba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:39.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.989+0000 7f94602b1640 1 -- 172.21.15.6:0/680121899 shutdown_connections 2024-05-04T01:02:39.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:39.989+0000 7f94602b1640 1 -- 172.21.15.6:0/680121899 wait complete. 2024-05-04T01:02:40.016 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":987,"stamp":"2024-05-04T01:02:38.385928+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22768727,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":531,"num_read_kb":545,"num_write":8989,"num_write_kb":276827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8057,"ondisk_log_size":8057,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317136,"kb_used_data":46928,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754657584,"statfs":{"total":773094113280,"available":772769366016,"internally_reserved":0,"allocated":48054272,"data_stored":46427946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51017,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":52,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005691"},"pg_stats":[{"pgid":"3.3f","version":"28'39","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.841929+0000","last_change":"2024-05-04T00:31:21.410516+0000","last_active":"2024-05-04T01:02:31.841929+0000","last_peered":"2024-05-04T01:02:31.841929+0000","last_clean":"2024-05-04T01:02:31.841929+0000","last_became_active":"2024-05-04T00:31:21.409386+0000","last_became_peered":"2024-05-04T00:31:21.409386+0000","last_unstale":"2024-05-04T01:02:31.841929+0000","last_undegraded":"2024-05-04T01:02:31.841929+0000","last_fullsized":"2024-05-04T01:02:31.841929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:09:40.562107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":2475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'39","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.471532+0000","last_change":"2024-05-04T00:31:21.397440+0000","last_active":"2024-05-04T01:02:31.471532+0000","last_peered":"2024-05-04T01:02:31.471532+0000","last_clean":"2024-05-04T01:02:31.471532+0000","last_became_active":"2024-05-04T00:31:21.396255+0000","last_became_peered":"2024-05-04T00:31:21.396255+0000","last_unstale":"2024-05-04T01:02:31.471532+0000","last_undegraded":"2024-05-04T01:02:31.471532+0000","last_fullsized":"2024-05-04T01:02:31.471532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:07.460897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":1259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'53","reported_seq":89,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.469843+0000","last_change":"2024-05-04T00:31:21.442932+0000","last_active":"2024-05-04T01:02:31.469843+0000","last_peered":"2024-05-04T01:02:31.469843+0000","last_clean":"2024-05-04T01:02:31.469843+0000","last_became_active":"2024-05-04T00:31:21.442507+0000","last_became_peered":"2024-05-04T00:31:21.442507+0000","last_unstale":"2024-05-04T01:02:31.469843+0000","last_undegraded":"2024-05-04T01:02:31.469843+0000","last_fullsized":"2024-05-04T01:02:31.469843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:52:48.345813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":2592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"28'34","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.685927+0000","last_change":"2024-05-04T00:31:21.442087+0000","last_active":"2024-05-04T01:02:31.685927+0000","last_peered":"2024-05-04T01:02:31.685927+0000","last_clean":"2024-05-04T01:02:31.685927+0000","last_became_active":"2024-05-04T00:31:21.440935+0000","last_became_peered":"2024-05-04T00:31:21.440935+0000","last_unstale":"2024-05-04T01:02:31.685927+0000","last_undegraded":"2024-05-04T01:02:31.685927+0000","last_fullsized":"2024-05-04T01:02:31.685927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:02:02.166274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":1417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'35","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.835987+0000","last_change":"2024-05-04T00:31:21.408892+0000","last_active":"2024-05-04T01:02:31.835987+0000","last_peered":"2024-05-04T01:02:31.835987+0000","last_clean":"2024-05-04T01:02:31.835987+0000","last_became_active":"2024-05-04T00:31:21.402554+0000","last_became_peered":"2024-05-04T00:31:21.402554+0000","last_unstale":"2024-05-04T01:02:31.835987+0000","last_undegraded":"2024-05-04T01:02:31.835987+0000","last_fullsized":"2024-05-04T01:02:31.835987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:07.135906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":2934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'51","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.677056+0000","last_change":"2024-05-04T00:31:21.442773+0000","last_active":"2024-05-04T01:02:31.677056+0000","last_peered":"2024-05-04T01:02:31.677056+0000","last_clean":"2024-05-04T01:02:31.677056+0000","last_became_active":"2024-05-04T00:31:21.441082+0000","last_became_peered":"2024-05-04T00:31:21.441082+0000","last_unstale":"2024-05-04T01:02:31.677056+0000","last_undegraded":"2024-05-04T01:02:31.677056+0000","last_fullsized":"2024-05-04T01:02:31.677056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:54.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":4527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"28'38","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.824772+0000","last_change":"2024-05-04T00:31:21.441617+0000","last_active":"2024-05-04T01:02:31.824772+0000","last_peered":"2024-05-04T01:02:31.824772+0000","last_clean":"2024-05-04T01:02:31.824772+0000","last_became_active":"2024-05-04T00:31:21.440766+0000","last_became_peered":"2024-05-04T00:31:21.440766+0000","last_unstale":"2024-05-04T01:02:31.824772+0000","last_undegraded":"2024-05-04T01:02:31.824772+0000","last_fullsized":"2024-05-04T01:02:31.824772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:28:07.779536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":2716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"28'27","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.469564+0000","last_change":"2024-05-04T00:31:21.408515+0000","last_active":"2024-05-04T01:02:31.469564+0000","last_peered":"2024-05-04T01:02:31.469564+0000","last_clean":"2024-05-04T01:02:31.469564+0000","last_became_active":"2024-05-04T00:31:21.407785+0000","last_became_peered":"2024-05-04T00:31:21.407785+0000","last_unstale":"2024-05-04T01:02:31.469564+0000","last_undegraded":"2024-05-04T01:02:31.469564+0000","last_fullsized":"2024-05-04T01:02:31.469564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:42.617159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"28'58","reported_seq":91,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.367510+0000","last_change":"2024-05-04T00:31:21.400836+0000","last_active":"2024-05-04T01:02:31.367510+0000","last_peered":"2024-05-04T01:02:31.367510+0000","last_clean":"2024-05-04T01:02:31.367510+0000","last_became_active":"2024-05-04T00:31:21.400001+0000","last_became_peered":"2024-05-04T00:31:21.400001+0000","last_unstale":"2024-05-04T01:02:31.367510+0000","last_undegraded":"2024-05-04T01:02:31.367510+0000","last_fullsized":"2024-05-04T01:02:31.367510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:56.687510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":3953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"28'49","reported_seq":82,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.843190+0000","last_change":"2024-05-04T00:31:21.391806+0000","last_active":"2024-05-04T01:02:31.843190+0000","last_peered":"2024-05-04T01:02:31.843190+0000","last_clean":"2024-05-04T01:02:31.843190+0000","last_became_active":"2024-05-04T00:31:21.389347+0000","last_became_peered":"2024-05-04T00:31:21.389347+0000","last_unstale":"2024-05-04T01:02:31.843190+0000","last_undegraded":"2024-05-04T01:02:31.843190+0000","last_fullsized":"2024-05-04T01:02:31.843190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:40:12.379274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":5065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'36","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.843911+0000","last_change":"2024-05-04T00:31:21.396045+0000","last_active":"2024-05-04T01:02:31.843911+0000","last_peered":"2024-05-04T01:02:31.843911+0000","last_clean":"2024-05-04T01:02:31.843911+0000","last_became_active":"2024-05-04T00:31:21.385949+0000","last_became_peered":"2024-05-04T00:31:21.385949+0000","last_unstale":"2024-05-04T01:02:31.843911+0000","last_undegraded":"2024-05-04T01:02:31.843911+0000","last_fullsized":"2024-05-04T01:02:31.843911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:33.187636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"28'26","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.840904+0000","last_change":"2024-05-04T00:31:21.407987+0000","last_active":"2024-05-04T01:02:31.840904+0000","last_peered":"2024-05-04T01:02:31.840904+0000","last_clean":"2024-05-04T01:02:31.840904+0000","last_became_active":"2024-05-04T00:31:21.404557+0000","last_became_peered":"2024-05-04T00:31:21.404557+0000","last_unstale":"2024-05-04T01:02:31.840904+0000","last_undegraded":"2024-05-04T01:02:31.840904+0000","last_fullsized":"2024-05-04T01:02:31.840904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:00:51.313452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'80","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.427750+0000","last_change":"2024-05-04T00:31:21.389251+0000","last_active":"2024-05-04T01:02:31.427750+0000","last_peered":"2024-05-04T01:02:31.427750+0000","last_clean":"2024-05-04T01:02:31.427750+0000","last_became_active":"2024-05-04T00:31:21.387958+0000","last_became_peered":"2024-05-04T00:31:21.387958+0000","last_unstale":"2024-05-04T01:02:31.427750+0000","last_undegraded":"2024-05-04T01:02:31.427750+0000","last_fullsized":"2024-05-04T01:02:31.427750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:31.926158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":3559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"28'48","reported_seq":82,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.420705+0000","last_change":"2024-05-04T00:31:21.402284+0000","last_active":"2024-05-04T01:02:31.420705+0000","last_peered":"2024-05-04T01:02:31.420705+0000","last_clean":"2024-05-04T01:02:31.420705+0000","last_became_active":"2024-05-04T00:31:21.401495+0000","last_became_peered":"2024-05-04T00:31:21.401495+0000","last_unstale":"2024-05-04T01:02:31.420705+0000","last_undegraded":"2024-05-04T01:02:31.420705+0000","last_fullsized":"2024-05-04T01:02:31.420705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:09.622538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":5060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"28'52","reported_seq":86,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.443478+0000","last_change":"2024-05-04T00:31:21.410958+0000","last_active":"2024-05-04T01:02:31.443478+0000","last_peered":"2024-05-04T01:02:31.443478+0000","last_clean":"2024-05-04T01:02:31.443478+0000","last_became_active":"2024-05-04T00:31:21.410489+0000","last_became_peered":"2024-05-04T00:31:21.410489+0000","last_unstale":"2024-05-04T01:02:31.443478+0000","last_undegraded":"2024-05-04T01:02:31.443478+0000","last_fullsized":"2024-05-04T01:02:31.443478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:05:47.448392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'49","reported_seq":83,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.698662+0000","last_change":"2024-05-04T00:31:21.187055+0000","last_active":"2024-05-04T01:02:31.698662+0000","last_peered":"2024-05-04T01:02:31.698662+0000","last_clean":"2024-05-04T01:02:31.698662+0000","last_became_active":"2024-05-04T00:31:21.186141+0000","last_became_peered":"2024-05-04T00:31:21.186141+0000","last_unstale":"2024-05-04T01:02:31.698662+0000","last_undegraded":"2024-05-04T01:02:31.698662+0000","last_fullsized":"2024-05-04T01:02:31.698662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:53:13.451818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":5921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"28'39","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.685239+0000","last_change":"2024-05-04T00:31:21.406402+0000","last_active":"2024-05-04T01:02:31.685239+0000","last_peered":"2024-05-04T01:02:31.685239+0000","last_clean":"2024-05-04T01:02:31.685239+0000","last_became_active":"2024-05-04T00:31:21.389108+0000","last_became_peered":"2024-05-04T00:31:21.389108+0000","last_unstale":"2024-05-04T01:02:31.685239+0000","last_undegraded":"2024-05-04T01:02:31.685239+0000","last_fullsized":"2024-05-04T01:02:31.685239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:11:03.598993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'50","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.449234+0000","last_change":"2024-05-04T00:31:21.418601+0000","last_active":"2024-05-04T01:02:31.449234+0000","last_peered":"2024-05-04T01:02:31.449234+0000","last_clean":"2024-05-04T01:02:31.449234+0000","last_became_active":"2024-05-04T00:31:21.417914+0000","last_became_peered":"2024-05-04T00:31:21.417914+0000","last_unstale":"2024-05-04T01:02:31.449234+0000","last_undegraded":"2024-05-04T01:02:31.449234+0000","last_fullsized":"2024-05-04T01:02:31.449234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:23:35.270037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":3403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"28'50","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.692446+0000","last_change":"2024-05-04T00:31:21.441868+0000","last_active":"2024-05-04T01:02:31.692446+0000","last_peered":"2024-05-04T01:02:31.692446+0000","last_clean":"2024-05-04T01:02:31.692446+0000","last_became_active":"2024-05-04T00:31:21.440945+0000","last_became_peered":"2024-05-04T00:31:21.440945+0000","last_unstale":"2024-05-04T01:02:31.692446+0000","last_undegraded":"2024-05-04T01:02:31.692446+0000","last_fullsized":"2024-05-04T01:02:31.692446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:47:43.629512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":6197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"28'63","reported_seq":97,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.839764+0000","last_change":"2024-05-04T00:31:21.395356+0000","last_active":"2024-05-04T01:02:31.839764+0000","last_peered":"2024-05-04T01:02:31.839764+0000","last_clean":"2024-05-04T01:02:31.839764+0000","last_became_active":"2024-05-04T00:31:21.394461+0000","last_became_peered":"2024-05-04T00:31:21.394461+0000","last_unstale":"2024-05-04T01:02:31.839764+0000","last_undegraded":"2024-05-04T01:02:31.839764+0000","last_fullsized":"2024-05-04T01:02:31.839764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:42:31.303120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"28'59","reported_seq":93,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.540103+0000","last_change":"2024-05-04T00:31:21.446878+0000","last_active":"2024-05-04T01:02:31.540103+0000","last_peered":"2024-05-04T01:02:31.540103+0000","last_clean":"2024-05-04T01:02:31.540103+0000","last_became_active":"2024-05-04T00:31:21.446250+0000","last_became_peered":"2024-05-04T00:31:21.446250+0000","last_unstale":"2024-05-04T01:02:31.540103+0000","last_undegraded":"2024-05-04T01:02:31.540103+0000","last_fullsized":"2024-05-04T01:02:31.540103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:42.617159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":5743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"28'39","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.368262+0000","last_change":"2024-05-04T00:31:21.414182+0000","last_active":"2024-05-04T01:02:31.368262+0000","last_peered":"2024-05-04T01:02:31.368262+0000","last_clean":"2024-05-04T01:02:31.368262+0000","last_became_active":"2024-05-04T00:31:21.413073+0000","last_became_peered":"2024-05-04T00:31:21.413073+0000","last_unstale":"2024-05-04T01:02:31.368262+0000","last_undegraded":"2024-05-04T01:02:31.368262+0000","last_fullsized":"2024-05-04T01:02:31.368262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:23.471892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"28'57","reported_seq":91,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.457014+0000","last_change":"2024-05-04T00:31:21.403827+0000","last_active":"2024-05-04T01:02:31.457014+0000","last_peered":"2024-05-04T01:02:31.457014+0000","last_clean":"2024-05-04T01:02:31.457014+0000","last_became_active":"2024-05-04T00:31:21.402985+0000","last_became_peered":"2024-05-04T00:31:21.402985+0000","last_unstale":"2024-05-04T01:02:31.457014+0000","last_undegraded":"2024-05-04T01:02:31.457014+0000","last_fullsized":"2024-05-04T01:02:31.457014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:43:15.203235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":5055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'40","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.684142+0000","last_change":"2024-05-04T00:31:21.393270+0000","last_active":"2024-05-04T01:02:31.684142+0000","last_peered":"2024-05-04T01:02:31.684142+0000","last_clean":"2024-05-04T01:02:31.684142+0000","last_became_active":"2024-05-04T00:31:21.392368+0000","last_became_peered":"2024-05-04T00:31:21.392368+0000","last_unstale":"2024-05-04T01:02:31.684142+0000","last_undegraded":"2024-05-04T01:02:31.684142+0000","last_fullsized":"2024-05-04T01:02:31.684142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:49:22.354637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":4444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"28'33","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.431054+0000","last_change":"2024-05-04T00:31:21.416800+0000","last_active":"2024-05-04T01:02:31.431054+0000","last_peered":"2024-05-04T01:02:31.431054+0000","last_clean":"2024-05-04T01:02:31.431054+0000","last_became_active":"2024-05-04T00:31:21.415540+0000","last_became_peered":"2024-05-04T00:31:21.415540+0000","last_unstale":"2024-05-04T01:02:31.431054+0000","last_undegraded":"2024-05-04T01:02:31.431054+0000","last_fullsized":"2024-05-04T01:02:31.431054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:00:51.313452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"28'72","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.700962+0000","last_change":"2024-05-04T00:31:21.188504+0000","last_active":"2024-05-04T01:02:31.700962+0000","last_peered":"2024-05-04T01:02:31.700962+0000","last_clean":"2024-05-04T01:02:31.700962+0000","last_became_active":"2024-05-04T00:31:21.187877+0000","last_became_peered":"2024-05-04T00:31:21.187877+0000","last_unstale":"2024-05-04T01:02:31.700962+0000","last_undegraded":"2024-05-04T01:02:31.700962+0000","last_fullsized":"2024-05-04T01:02:31.700962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:48:39.671984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":3181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"28'39","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.408156+0000","last_change":"2024-05-04T00:31:21.393500+0000","last_active":"2024-05-04T01:02:31.408156+0000","last_peered":"2024-05-04T01:02:31.408156+0000","last_clean":"2024-05-04T01:02:31.408156+0000","last_became_active":"2024-05-04T00:31:21.392579+0000","last_became_peered":"2024-05-04T00:31:21.392579+0000","last_unstale":"2024-05-04T01:02:31.408156+0000","last_undegraded":"2024-05-04T01:02:31.408156+0000","last_fullsized":"2024-05-04T01:02:31.408156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:16.804136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":2828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"28'30","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.428999+0000","last_change":"2024-05-04T00:31:21.395778+0000","last_active":"2024-05-04T01:02:31.428999+0000","last_peered":"2024-05-04T01:02:31.428999+0000","last_clean":"2024-05-04T01:02:31.428999+0000","last_became_active":"2024-05-04T00:31:21.394966+0000","last_became_peered":"2024-05-04T00:31:21.394966+0000","last_unstale":"2024-05-04T01:02:31.428999+0000","last_undegraded":"2024-05-04T01:02:31.428999+0000","last_fullsized":"2024-05-04T01:02:31.428999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:53:28.166224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"28'34","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.456236+0000","last_change":"2024-05-04T00:31:21.405250+0000","last_active":"2024-05-04T01:02:31.456236+0000","last_peered":"2024-05-04T01:02:31.456236+0000","last_clean":"2024-05-04T01:02:31.456236+0000","last_became_active":"2024-05-04T00:31:21.403779+0000","last_became_peered":"2024-05-04T00:31:21.403779+0000","last_unstale":"2024-05-04T01:02:31.456236+0000","last_undegraded":"2024-05-04T01:02:31.456236+0000","last_fullsized":"2024-05-04T01:02:31.456236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:33.187636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":2736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"28'56","reported_seq":92,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.691846+0000","last_change":"2024-05-04T00:31:21.399896+0000","last_active":"2024-05-04T01:02:31.691846+0000","last_peered":"2024-05-04T01:02:31.691846+0000","last_clean":"2024-05-04T01:02:31.691846+0000","last_became_active":"2024-05-04T00:31:21.398994+0000","last_became_peered":"2024-05-04T00:31:21.398994+0000","last_unstale":"2024-05-04T01:02:31.691846+0000","last_undegraded":"2024-05-04T01:02:31.691846+0000","last_fullsized":"2024-05-04T01:02:31.691846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:32:42.591423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":5289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"28'49","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.449650+0000","last_change":"2024-05-04T00:31:21.416130+0000","last_active":"2024-05-04T01:02:31.449650+0000","last_peered":"2024-05-04T01:02:31.449650+0000","last_clean":"2024-05-04T01:02:31.449650+0000","last_became_active":"2024-05-04T00:31:21.415395+0000","last_became_peered":"2024-05-04T00:31:21.415395+0000","last_unstale":"2024-05-04T01:02:31.449650+0000","last_undegraded":"2024-05-04T01:02:31.449650+0000","last_fullsized":"2024-05-04T01:02:31.449650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:33:22.819977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":6794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'61","reported_seq":97,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.691358+0000","last_change":"2024-05-04T00:31:21.342105+0000","last_active":"2024-05-04T01:02:31.691358+0000","last_peered":"2024-05-04T01:02:31.691358+0000","last_clean":"2024-05-04T01:02:31.691358+0000","last_became_active":"2024-05-04T00:31:21.341333+0000","last_became_peered":"2024-05-04T00:31:21.341333+0000","last_unstale":"2024-05-04T01:02:31.691358+0000","last_undegraded":"2024-05-04T01:02:31.691358+0000","last_fullsized":"2024-05-04T01:02:31.691358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:23.471892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":5609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"28'25","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.370813+0000","last_change":"2024-05-04T00:31:21.405647+0000","last_active":"2024-05-04T01:02:31.370813+0000","last_peered":"2024-05-04T01:02:31.370813+0000","last_clean":"2024-05-04T01:02:31.370813+0000","last_became_active":"2024-05-04T00:31:21.403998+0000","last_became_peered":"2024-05-04T00:31:21.403998+0000","last_unstale":"2024-05-04T01:02:31.370813+0000","last_undegraded":"2024-05-04T01:02:31.370813+0000","last_fullsized":"2024-05-04T01:02:31.370813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:54.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"28'495","reported_seq":532,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:23.318163+0000","last_change":"2024-05-04T00:31:19.185018+0000","last_active":"2024-05-04T01:02:23.318163+0000","last_peered":"2024-05-04T01:02:23.318163+0000","last_clean":"2024-05-04T01:02:23.318163+0000","last_became_active":"2024-05-04T00:31:19.181107+0000","last_became_peered":"2024-05-04T00:31:19.181107+0000","last_unstale":"2024-05-04T01:02:23.318163+0000","last_undegraded":"2024-05-04T01:02:23.318163+0000","last_fullsized":"2024-05-04T01:02:23.318163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:14.453153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"28'45","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.542677+0000","last_change":"2024-05-04T00:31:21.446209+0000","last_active":"2024-05-04T01:02:31.542677+0000","last_peered":"2024-05-04T01:02:31.542677+0000","last_clean":"2024-05-04T01:02:31.542677+0000","last_became_active":"2024-05-04T00:31:21.445793+0000","last_became_peered":"2024-05-04T00:31:21.445793+0000","last_unstale":"2024-05-04T01:02:31.542677+0000","last_undegraded":"2024-05-04T01:02:31.542677+0000","last_fullsized":"2024-05-04T01:02:31.542677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:54:48.084884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"28'359","reported_seq":396,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:23.320461+0000","last_change":"2024-05-04T00:31:19.185102+0000","last_active":"2024-05-04T01:02:23.320461+0000","last_peered":"2024-05-04T01:02:23.320461+0000","last_clean":"2024-05-04T01:02:23.320461+0000","last_became_active":"2024-05-04T00:31:19.183394+0000","last_became_peered":"2024-05-04T00:31:19.183394+0000","last_unstale":"2024-05-04T01:02:23.320461+0000","last_undegraded":"2024-05-04T01:02:23.320461+0000","last_fullsized":"2024-05-04T01:02:23.320461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:36:38.420366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":4278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T00:58:02.556311+0000","last_change":"2024-05-04T00:31:19.158945+0000","last_active":"2024-05-04T00:58:02.556311+0000","last_peered":"2024-05-04T00:58:02.556311+0000","last_clean":"2024-05-04T00:58:02.556311+0000","last_became_active":"2024-05-04T00:31:19.158152+0000","last_became_peered":"2024-05-04T00:31:19.158152+0000","last_unstale":"2024-05-04T00:58:02.556311+0000","last_undegraded":"2024-05-04T00:58:02.556311+0000","last_fullsized":"2024-05-04T00:58:02.556311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:52.040804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'48","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.458775+0000","last_change":"2024-05-04T00:31:21.397183+0000","last_active":"2024-05-04T01:02:31.458775+0000","last_peered":"2024-05-04T01:02:31.458775+0000","last_clean":"2024-05-04T01:02:31.458775+0000","last_became_active":"2024-05-04T00:31:21.393014+0000","last_became_peered":"2024-05-04T00:31:21.393014+0000","last_unstale":"2024-05-04T01:02:31.458775+0000","last_undegraded":"2024-05-04T01:02:31.458775+0000","last_fullsized":"2024-05-04T01:02:31.458775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:40:12.379274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":2972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"28'7","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:52.153404+0000","last_change":"2024-05-04T00:31:19.186007+0000","last_active":"2024-05-04T01:01:52.153404+0000","last_peered":"2024-05-04T01:01:52.153404+0000","last_clean":"2024-05-04T01:01:52.153404+0000","last_became_active":"2024-05-04T00:31:19.184526+0000","last_became_peered":"2024-05-04T00:31:19.184526+0000","last_unstale":"2024-05-04T01:01:52.153404+0000","last_undegraded":"2024-05-04T01:01:52.153404+0000","last_fullsized":"2024-05-04T01:01:52.153404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:01:33.042606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"28'43","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.553685+0000","last_change":"2024-05-04T00:31:21.447258+0000","last_active":"2024-05-04T01:02:31.553685+0000","last_peered":"2024-05-04T01:02:31.553685+0000","last_clean":"2024-05-04T01:02:31.553685+0000","last_became_active":"2024-05-04T00:31:21.446842+0000","last_became_peered":"2024-05-04T00:31:21.446842+0000","last_unstale":"2024-05-04T01:02:31.553685+0000","last_undegraded":"2024-05-04T01:02:31.553685+0000","last_fullsized":"2024-05-04T01:02:31.553685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:10:57.675700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"28'10","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:58.543037+0000","last_change":"2024-05-04T00:31:19.190422+0000","last_active":"2024-05-04T01:01:58.543037+0000","last_peered":"2024-05-04T01:01:58.543037+0000","last_clean":"2024-05-04T01:01:58.543037+0000","last_became_active":"2024-05-04T00:31:19.189517+0000","last_became_peered":"2024-05-04T00:31:19.189517+0000","last_unstale":"2024-05-04T01:01:58.543037+0000","last_undegraded":"2024-05-04T01:01:58.543037+0000","last_fullsized":"2024-05-04T01:01:58.543037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:16:41.367677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"28'52","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.702363+0000","last_change":"2024-05-04T00:31:21.184586+0000","last_active":"2024-05-04T01:02:31.702363+0000","last_peered":"2024-05-04T01:02:31.702363+0000","last_clean":"2024-05-04T01:02:31.702363+0000","last_became_active":"2024-05-04T00:31:21.183698+0000","last_became_peered":"2024-05-04T00:31:21.183698+0000","last_unstale":"2024-05-04T01:02:31.702363+0000","last_undegraded":"2024-05-04T01:02:31.702363+0000","last_fullsized":"2024-05-04T01:02:31.702363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:47:25.699731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":3598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"28'5","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:02.892394+0000","last_change":"2024-05-04T00:31:19.186623+0000","last_active":"2024-05-04T01:02:02.892394+0000","last_peered":"2024-05-04T01:02:02.892394+0000","last_clean":"2024-05-04T01:02:02.892394+0000","last_became_active":"2024-05-04T00:31:19.185633+0000","last_became_peered":"2024-05-04T00:31:19.185633+0000","last_unstale":"2024-05-04T01:02:02.892394+0000","last_undegraded":"2024-05-04T01:02:02.892394+0000","last_fullsized":"2024-05-04T01:02:02.892394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:10:55.324717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"28'45","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.442971+0000","last_change":"2024-05-04T00:31:21.410329+0000","last_active":"2024-05-04T01:02:31.442971+0000","last_peered":"2024-05-04T01:02:31.442971+0000","last_clean":"2024-05-04T01:02:31.442971+0000","last_became_active":"2024-05-04T00:31:21.409655+0000","last_became_peered":"2024-05-04T00:31:21.409655+0000","last_unstale":"2024-05-04T01:02:31.442971+0000","last_undegraded":"2024-05-04T01:02:31.442971+0000","last_fullsized":"2024-05-04T01:02:31.442971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:09:40.562107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":5409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"28'348","reported_seq":385,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:30.340190+0000","last_change":"2024-05-04T00:31:19.178130+0000","last_active":"2024-05-04T01:02:30.340190+0000","last_peered":"2024-05-04T01:02:30.340190+0000","last_clean":"2024-05-04T01:02:30.340190+0000","last_became_active":"2024-05-04T00:31:19.177283+0000","last_became_peered":"2024-05-04T00:31:19.177283+0000","last_unstale":"2024-05-04T01:02:30.340190+0000","last_undegraded":"2024-05-04T01:02:30.340190+0000","last_fullsized":"2024-05-04T01:02:30.340190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:42:41.790988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"28'47","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.699191+0000","last_change":"2024-05-04T00:31:21.187102+0000","last_active":"2024-05-04T01:02:31.699191+0000","last_peered":"2024-05-04T01:02:31.699191+0000","last_clean":"2024-05-04T01:02:31.699191+0000","last_became_active":"2024-05-04T00:31:21.186167+0000","last_became_peered":"2024-05-04T00:31:21.186167+0000","last_unstale":"2024-05-04T01:02:31.699191+0000","last_undegraded":"2024-05-04T01:02:31.699191+0000","last_fullsized":"2024-05-04T01:02:31.699191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:05:04.013367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"28'812","reported_seq":850,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:28.319115+0000","last_change":"2024-05-04T00:31:19.251247+0000","last_active":"2024-05-04T01:02:28.319115+0000","last_peered":"2024-05-04T01:02:28.319115+0000","last_clean":"2024-05-04T01:02:28.319115+0000","last_became_active":"2024-05-04T00:31:19.250003+0000","last_became_peered":"2024-05-04T00:31:19.250003+0000","last_unstale":"2024-05-04T01:02:28.319115+0000","last_undegraded":"2024-05-04T01:02:28.319115+0000","last_fullsized":"2024-05-04T01:02:28.319115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:40:06.774090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":4562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"28'32","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.835367+0000","last_change":"2024-05-04T00:31:21.401432+0000","last_active":"2024-05-04T01:02:31.835367+0000","last_peered":"2024-05-04T01:02:31.835367+0000","last_clean":"2024-05-04T01:02:31.835367+0000","last_became_active":"2024-05-04T00:31:21.397220+0000","last_became_peered":"2024-05-04T00:31:21.397220+0000","last_unstale":"2024-05-04T01:02:31.835367+0000","last_undegraded":"2024-05-04T01:02:31.835367+0000","last_fullsized":"2024-05-04T01:02:31.835367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:07.460897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:40.484170+0000","last_change":"2024-05-04T00:31:19.183674+0000","last_active":"2024-05-04T01:01:40.484170+0000","last_peered":"2024-05-04T01:01:40.484170+0000","last_clean":"2024-05-04T01:01:40.484170+0000","last_became_active":"2024-05-04T00:31:19.183331+0000","last_became_peered":"2024-05-04T00:31:19.183331+0000","last_unstale":"2024-05-04T01:01:40.484170+0000","last_undegraded":"2024-05-04T01:01:40.484170+0000","last_fullsized":"2024-05-04T01:01:40.484170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:13:52.447627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"28'47","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.421027+0000","last_change":"2024-05-04T00:31:21.342578+0000","last_active":"2024-05-04T01:02:31.421027+0000","last_peered":"2024-05-04T01:02:31.421027+0000","last_clean":"2024-05-04T01:02:31.421027+0000","last_became_active":"2024-05-04T00:31:21.342064+0000","last_became_peered":"2024-05-04T00:31:21.342064+0000","last_unstale":"2024-05-04T01:02:31.421027+0000","last_undegraded":"2024-05-04T01:02:31.421027+0000","last_fullsized":"2024-05-04T01:02:31.421027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:35.377002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"28'10","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:16.788884+0000","last_change":"2024-05-04T00:31:19.184166+0000","last_active":"2024-05-04T01:02:16.788884+0000","last_peered":"2024-05-04T01:02:16.788884+0000","last_clean":"2024-05-04T01:02:16.788884+0000","last_became_active":"2024-05-04T00:31:19.181304+0000","last_became_peered":"2024-05-04T00:31:19.181304+0000","last_unstale":"2024-05-04T01:02:16.788884+0000","last_undegraded":"2024-05-04T01:02:16.788884+0000","last_fullsized":"2024-05-04T01:02:16.788884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:49:04.376111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'62","reported_seq":96,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.695730+0000","last_change":"2024-05-04T00:31:21.390252+0000","last_active":"2024-05-04T01:02:31.695730+0000","last_peered":"2024-05-04T01:02:31.695730+0000","last_clean":"2024-05-04T01:02:31.695730+0000","last_became_active":"2024-05-04T00:31:21.389360+0000","last_became_peered":"2024-05-04T00:31:21.389360+0000","last_unstale":"2024-05-04T01:02:31.695730+0000","last_undegraded":"2024-05-04T01:02:31.695730+0000","last_fullsized":"2024-05-04T01:02:31.695730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:45:23.177550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":7948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:57.630518+0000","last_change":"2024-05-04T00:31:19.176756+0000","last_active":"2024-05-04T01:01:57.630518+0000","last_peered":"2024-05-04T01:01:57.630518+0000","last_clean":"2024-05-04T01:01:57.630518+0000","last_became_active":"2024-05-04T00:31:19.175779+0000","last_became_peered":"2024-05-04T00:31:19.175779+0000","last_unstale":"2024-05-04T01:01:57.630518+0000","last_undegraded":"2024-05-04T01:01:57.630518+0000","last_fullsized":"2024-05-04T01:01:57.630518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:14.453153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'46","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.361428+0000","last_change":"2024-05-04T00:31:21.397306+0000","last_active":"2024-05-04T01:02:31.361428+0000","last_peered":"2024-05-04T01:02:31.361428+0000","last_clean":"2024-05-04T01:02:31.361428+0000","last_became_active":"2024-05-04T00:31:21.394863+0000","last_became_peered":"2024-05-04T00:31:21.394863+0000","last_unstale":"2024-05-04T01:02:31.361428+0000","last_undegraded":"2024-05-04T01:02:31.361428+0000","last_fullsized":"2024-05-04T01:02:31.361428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:46:38.463068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":4347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"28'17","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:42.389948+0000","last_change":"2024-05-04T00:31:19.177402+0000","last_active":"2024-05-04T01:01:42.389948+0000","last_peered":"2024-05-04T01:01:42.389948+0000","last_clean":"2024-05-04T01:01:42.389948+0000","last_became_active":"2024-05-04T00:31:19.176805+0000","last_became_peered":"2024-05-04T00:31:19.176805+0000","last_unstale":"2024-05-04T01:01:42.389948+0000","last_undegraded":"2024-05-04T01:01:42.389948+0000","last_fullsized":"2024-05-04T01:01:42.389948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:31.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'47","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.694612+0000","last_change":"2024-05-04T00:31:21.188457+0000","last_active":"2024-05-04T01:02:31.694612+0000","last_peered":"2024-05-04T01:02:31.694612+0000","last_clean":"2024-05-04T01:02:31.694612+0000","last_became_active":"2024-05-04T00:31:21.187554+0000","last_became_peered":"2024-05-04T00:31:21.187554+0000","last_unstale":"2024-05-04T01:02:31.694612+0000","last_undegraded":"2024-05-04T01:02:31.694612+0000","last_fullsized":"2024-05-04T01:02:31.694612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:31:55.671261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":6499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:23.368856+0000","last_change":"2024-05-04T00:31:19.176641+0000","last_active":"2024-05-04T01:02:23.368856+0000","last_peered":"2024-05-04T01:02:23.368856+0000","last_clean":"2024-05-04T01:02:23.368856+0000","last_became_active":"2024-05-04T00:31:19.175715+0000","last_became_peered":"2024-05-04T00:31:19.175715+0000","last_unstale":"2024-05-04T01:02:23.368856+0000","last_undegraded":"2024-05-04T01:02:23.368856+0000","last_fullsized":"2024-05-04T01:02:23.368856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:05:45.097410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"28'30","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.700719+0000","last_change":"2024-05-04T00:31:21.407554+0000","last_active":"2024-05-04T01:02:31.700719+0000","last_peered":"2024-05-04T01:02:31.700719+0000","last_clean":"2024-05-04T01:02:31.700719+0000","last_became_active":"2024-05-04T00:31:21.403004+0000","last_became_peered":"2024-05-04T00:31:21.403004+0000","last_unstale":"2024-05-04T01:02:31.700719+0000","last_undegraded":"2024-05-04T01:02:31.700719+0000","last_fullsized":"2024-05-04T01:02:31.700719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:33.938895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:23.316664+0000","last_change":"2024-05-04T00:31:19.187116+0000","last_active":"2024-05-04T01:02:23.316664+0000","last_peered":"2024-05-04T01:02:23.316664+0000","last_clean":"2024-05-04T01:02:23.316664+0000","last_became_active":"2024-05-04T00:31:19.186540+0000","last_became_peered":"2024-05-04T00:31:19.186540+0000","last_unstale":"2024-05-04T01:02:23.316664+0000","last_undegraded":"2024-05-04T01:02:23.316664+0000","last_fullsized":"2024-05-04T01:02:23.316664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:08.420067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"28'41","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.841254+0000","last_change":"2024-05-04T00:31:21.407986+0000","last_active":"2024-05-04T01:02:31.841254+0000","last_peered":"2024-05-04T01:02:31.841254+0000","last_clean":"2024-05-04T01:02:31.841254+0000","last_became_active":"2024-05-04T00:31:21.404350+0000","last_became_peered":"2024-05-04T00:31:21.404350+0000","last_unstale":"2024-05-04T01:02:31.841254+0000","last_undegraded":"2024-05-04T01:02:31.841254+0000","last_fullsized":"2024-05-04T01:02:31.841254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:12:34.898595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'2","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:00:35.381044+0000","last_change":"2024-05-04T00:31:19.190045+0000","last_active":"2024-05-04T01:00:35.381044+0000","last_peered":"2024-05-04T01:00:35.381044+0000","last_clean":"2024-05-04T01:00:35.381044+0000","last_became_active":"2024-05-04T00:31:19.189166+0000","last_became_peered":"2024-05-04T00:31:19.189166+0000","last_unstale":"2024-05-04T01:00:35.381044+0000","last_undegraded":"2024-05-04T01:00:35.381044+0000","last_fullsized":"2024-05-04T01:00:35.381044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:31.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"28'36","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.835864+0000","last_change":"2024-05-04T00:31:21.402171+0000","last_active":"2024-05-04T01:02:31.835864+0000","last_peered":"2024-05-04T01:02:31.835864+0000","last_clean":"2024-05-04T01:02:31.835864+0000","last_became_active":"2024-05-04T00:31:21.401467+0000","last_became_peered":"2024-05-04T00:31:21.401467+0000","last_unstale":"2024-05-04T01:02:31.835864+0000","last_undegraded":"2024-05-04T01:02:31.835864+0000","last_fullsized":"2024-05-04T01:02:31.835864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:34:25.722557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:03.938611+0000","last_change":"2024-05-04T00:31:19.155210+0000","last_active":"2024-05-04T01:02:03.938611+0000","last_peered":"2024-05-04T01:02:03.938611+0000","last_clean":"2024-05-04T01:02:03.938611+0000","last_became_active":"2024-05-04T00:31:19.154504+0000","last_became_peered":"2024-05-04T00:31:19.154504+0000","last_unstale":"2024-05-04T01:02:03.938611+0000","last_undegraded":"2024-05-04T01:02:03.938611+0000","last_fullsized":"2024-05-04T01:02:03.938611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:47:23.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'47","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.696865+0000","last_change":"2024-05-04T00:31:21.406273+0000","last_active":"2024-05-04T01:02:31.696865+0000","last_peered":"2024-05-04T01:02:31.696865+0000","last_clean":"2024-05-04T01:02:31.696865+0000","last_became_active":"2024-05-04T00:31:21.405283+0000","last_became_peered":"2024-05-04T00:31:21.405283+0000","last_unstale":"2024-05-04T01:02:31.696865+0000","last_undegraded":"2024-05-04T01:02:31.696865+0000","last_fullsized":"2024-05-04T01:02:31.696865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:20:31.795673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":136,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T00:58:47.566980+0000","last_change":"2024-05-04T00:30:40.841283+0000","last_active":"2024-05-04T00:58:47.566980+0000","last_peered":"2024-05-04T00:58:47.566980+0000","last_clean":"2024-05-04T00:58:47.566980+0000","last_became_active":"2024-05-04T00:30:40.838353+0000","last_became_peered":"2024-05-04T00:30:40.838353+0000","last_unstale":"2024-05-04T00:58:47.566980+0000","last_undegraded":"2024-05-04T00:58:47.566980+0000","last_fullsized":"2024-05-04T00:58:47.566980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:30:37.159356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:30:37.159356+0000","last_clean_scrub_stamp":"2024-05-04T00:30:37.159356+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:30:10.374994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"28'7","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:28.311754+0000","last_change":"2024-05-04T00:31:19.248691+0000","last_active":"2024-05-04T01:02:28.311754+0000","last_peered":"2024-05-04T01:02:28.311754+0000","last_clean":"2024-05-04T01:02:28.311754+0000","last_became_active":"2024-05-04T00:31:19.247815+0000","last_became_peered":"2024-05-04T00:31:19.247815+0000","last_unstale":"2024-05-04T01:02:28.311754+0000","last_undegraded":"2024-05-04T01:02:28.311754+0000","last_fullsized":"2024-05-04T01:02:28.311754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:46:05.720208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"28'34","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.533474+0000","last_change":"2024-05-04T00:31:21.446500+0000","last_active":"2024-05-04T01:02:31.533474+0000","last_peered":"2024-05-04T01:02:31.533474+0000","last_clean":"2024-05-04T01:02:31.533474+0000","last_became_active":"2024-05-04T00:31:21.446100+0000","last_became_peered":"2024-05-04T00:31:21.446100+0000","last_unstale":"2024-05-04T01:02:31.533474+0000","last_undegraded":"2024-05-04T01:02:31.533474+0000","last_fullsized":"2024-05-04T01:02:31.533474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:06.542614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"28'10","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:15.858216+0000","last_change":"2024-05-04T00:31:19.184044+0000","last_active":"2024-05-04T01:02:15.858216+0000","last_peered":"2024-05-04T01:02:15.858216+0000","last_clean":"2024-05-04T01:02:15.858216+0000","last_became_active":"2024-05-04T00:31:19.181956+0000","last_became_peered":"2024-05-04T00:31:19.181956+0000","last_unstale":"2024-05-04T01:02:15.858216+0000","last_undegraded":"2024-05-04T01:02:15.858216+0000","last_fullsized":"2024-05-04T01:02:15.858216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:09:33.607433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"28'23","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.425515+0000","last_change":"2024-05-04T00:31:21.343953+0000","last_active":"2024-05-04T01:02:31.425515+0000","last_peered":"2024-05-04T01:02:31.425515+0000","last_clean":"2024-05-04T01:02:31.425515+0000","last_became_active":"2024-05-04T00:31:21.343499+0000","last_became_peered":"2024-05-04T00:31:21.343499+0000","last_unstale":"2024-05-04T01:02:31.425515+0000","last_undegraded":"2024-05-04T01:02:31.425515+0000","last_fullsized":"2024-05-04T01:02:31.425515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:33.938895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"28'477","reported_seq":982,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.802778+0000","last_change":"2024-05-04T00:31:19.184947+0000","last_active":"2024-05-04T01:02:31.802778+0000","last_peered":"2024-05-04T01:02:31.802778+0000","last_clean":"2024-05-04T01:02:31.802778+0000","last_became_active":"2024-05-04T00:31:19.184606+0000","last_became_peered":"2024-05-04T00:31:19.184606+0000","last_unstale":"2024-05-04T01:02:31.802778+0000","last_undegraded":"2024-05-04T01:02:31.802778+0000","last_fullsized":"2024-05-04T01:02:31.802778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:07:49.638230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109877,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":465,"num_read_kb":490,"num_write":474,"num_write_kb":495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"28'42","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.432000+0000","last_change":"2024-05-04T00:31:21.402799+0000","last_active":"2024-05-04T01:02:31.432000+0000","last_peered":"2024-05-04T01:02:31.432000+0000","last_clean":"2024-05-04T01:02:31.432000+0000","last_became_active":"2024-05-04T00:31:21.401591+0000","last_became_peered":"2024-05-04T00:31:21.401591+0000","last_unstale":"2024-05-04T01:02:31.432000+0000","last_undegraded":"2024-05-04T01:02:31.432000+0000","last_fullsized":"2024-05-04T01:02:31.432000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:28:07.779536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"28'6","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:28.312950+0000","last_change":"2024-05-04T00:31:19.182214+0000","last_active":"2024-05-04T01:02:28.312950+0000","last_peered":"2024-05-04T01:02:28.312950+0000","last_clean":"2024-05-04T01:02:28.312950+0000","last_became_active":"2024-05-04T00:31:19.180317+0000","last_became_peered":"2024-05-04T00:31:19.180317+0000","last_unstale":"2024-05-04T01:02:28.312950+0000","last_undegraded":"2024-05-04T01:02:28.312950+0000","last_fullsized":"2024-05-04T01:02:28.312950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:44.678316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"28'41","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.432070+0000","last_change":"2024-05-04T00:32:21.647507+0000","last_active":"2024-05-04T01:02:31.432070+0000","last_peered":"2024-05-04T01:02:31.432070+0000","last_clean":"2024-05-04T01:02:31.432070+0000","last_became_active":"2024-05-04T00:32:21.646617+0000","last_became_peered":"2024-05-04T00:32:21.646617+0000","last_unstale":"2024-05-04T01:02:31.432070+0000","last_undegraded":"2024-05-04T01:02:31.432070+0000","last_fullsized":"2024-05-04T01:02:31.432070+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:09:35.958415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"28'2","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:28.316123+0000","last_change":"2024-05-04T00:31:19.183991+0000","last_active":"2024-05-04T01:02:28.316123+0000","last_peered":"2024-05-04T01:02:28.316123+0000","last_clean":"2024-05-04T01:02:28.316123+0000","last_became_active":"2024-05-04T00:31:19.179785+0000","last_became_peered":"2024-05-04T00:31:19.179785+0000","last_unstale":"2024-05-04T01:02:28.316123+0000","last_undegraded":"2024-05-04T01:02:28.316123+0000","last_fullsized":"2024-05-04T01:02:28.316123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:29.575176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"28'35","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.677677+0000","last_change":"2024-05-04T00:31:21.342687+0000","last_active":"2024-05-04T01:02:31.677677+0000","last_peered":"2024-05-04T01:02:31.677677+0000","last_clean":"2024-05-04T01:02:31.677677+0000","last_became_active":"2024-05-04T00:31:21.341702+0000","last_became_peered":"2024-05-04T00:31:21.341702+0000","last_unstale":"2024-05-04T01:02:31.677677+0000","last_undegraded":"2024-05-04T01:02:31.677677+0000","last_fullsized":"2024-05-04T01:02:31.677677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:56.687510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":3658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:16.832909+0000","last_change":"2024-05-04T00:31:19.176663+0000","last_active":"2024-05-04T01:02:16.832909+0000","last_peered":"2024-05-04T01:02:16.832909+0000","last_clean":"2024-05-04T01:02:16.832909+0000","last_became_active":"2024-05-04T00:31:19.175616+0000","last_became_peered":"2024-05-04T00:31:19.175616+0000","last_unstale":"2024-05-04T01:02:16.832909+0000","last_undegraded":"2024-05-04T01:02:16.832909+0000","last_fullsized":"2024-05-04T01:02:16.832909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:24:47.124717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'38","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.419685+0000","last_change":"2024-05-04T00:31:21.403129+0000","last_active":"2024-05-04T01:02:31.419685+0000","last_peered":"2024-05-04T01:02:31.419685+0000","last_clean":"2024-05-04T01:02:31.419685+0000","last_became_active":"2024-05-04T00:31:21.402248+0000","last_became_peered":"2024-05-04T00:31:21.402248+0000","last_unstale":"2024-05-04T01:02:31.419685+0000","last_undegraded":"2024-05-04T01:02:31.419685+0000","last_fullsized":"2024-05-04T01:02:31.419685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:10.771050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":1649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"28'1198","reported_seq":1237,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:30.508455+0000","last_change":"2024-05-04T00:31:19.155903+0000","last_active":"2024-05-04T01:02:30.508455+0000","last_peered":"2024-05-04T01:02:30.508455+0000","last_clean":"2024-05-04T01:02:30.508455+0000","last_became_active":"2024-05-04T00:31:19.154909+0000","last_became_peered":"2024-05-04T00:31:19.154909+0000","last_unstale":"2024-05-04T01:02:30.508455+0000","last_undegraded":"2024-05-04T01:02:30.508455+0000","last_fullsized":"2024-05-04T01:02:30.508455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1198,"log_dups_size":0,"ondisk_log_size":1198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:53:25.815241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2862,"num_write_kb":974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'37","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.549167+0000","last_change":"2024-05-04T00:31:21.445396+0000","last_active":"2024-05-04T01:02:31.549167+0000","last_peered":"2024-05-04T01:02:31.549167+0000","last_clean":"2024-05-04T01:02:31.549167+0000","last_became_active":"2024-05-04T00:31:21.444934+0000","last_became_peered":"2024-05-04T00:31:21.444934+0000","last_unstale":"2024-05-04T01:02:31.549167+0000","last_undegraded":"2024-05-04T01:02:31.549167+0000","last_fullsized":"2024-05-04T01:02:31.549167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:23:02.407000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'10","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:30.330017+0000","last_change":"2024-05-04T00:31:19.182946+0000","last_active":"2024-05-04T01:02:30.330017+0000","last_peered":"2024-05-04T01:02:30.330017+0000","last_clean":"2024-05-04T01:02:30.330017+0000","last_became_active":"2024-05-04T00:31:19.182050+0000","last_became_peered":"2024-05-04T00:31:19.182050+0000","last_unstale":"2024-05-04T01:02:30.330017+0000","last_undegraded":"2024-05-04T01:02:30.330017+0000","last_fullsized":"2024-05-04T01:02:30.330017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:55:12.448558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'45","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.537417+0000","last_change":"2024-05-04T00:31:21.443100+0000","last_active":"2024-05-04T01:02:31.537417+0000","last_peered":"2024-05-04T01:02:31.537417+0000","last_clean":"2024-05-04T01:02:31.537417+0000","last_became_active":"2024-05-04T00:31:21.442602+0000","last_became_peered":"2024-05-04T00:31:21.442602+0000","last_unstale":"2024-05-04T01:02:31.537417+0000","last_undegraded":"2024-05-04T01:02:31.537417+0000","last_fullsized":"2024-05-04T01:02:31.537417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:16:45.807230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":5859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'4","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:15.855817+0000","last_change":"2024-05-04T00:31:19.248358+0000","last_active":"2024-05-04T01:02:15.855817+0000","last_peered":"2024-05-04T01:02:15.855817+0000","last_clean":"2024-05-04T01:02:15.855817+0000","last_became_active":"2024-05-04T00:31:19.247822+0000","last_became_peered":"2024-05-04T00:31:19.247822+0000","last_unstale":"2024-05-04T01:02:15.855817+0000","last_undegraded":"2024-05-04T01:02:15.855817+0000","last_fullsized":"2024-05-04T01:02:15.855817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:04.191631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"28'37","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:40.508031+0000","last_change":"2024-05-04T00:31:21.441959+0000","last_active":"2024-05-04T01:01:40.508031+0000","last_peered":"2024-05-04T01:01:40.508031+0000","last_clean":"2024-05-04T01:01:40.508031+0000","last_became_active":"2024-05-04T00:31:21.441015+0000","last_became_peered":"2024-05-04T00:31:21.441015+0000","last_unstale":"2024-05-04T01:01:40.508031+0000","last_undegraded":"2024-05-04T01:01:40.508031+0000","last_fullsized":"2024-05-04T01:01:40.508031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:54:30.187813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'10","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:23.316808+0000","last_change":"2024-05-04T00:31:19.159146+0000","last_active":"2024-05-04T01:02:23.316808+0000","last_peered":"2024-05-04T01:02:23.316808+0000","last_clean":"2024-05-04T01:02:23.316808+0000","last_became_active":"2024-05-04T00:31:19.158366+0000","last_became_peered":"2024-05-04T00:31:19.158366+0000","last_unstale":"2024-05-04T01:02:23.316808+0000","last_undegraded":"2024-05-04T01:02:23.316808+0000","last_fullsized":"2024-05-04T01:02:23.316808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:07.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'51","reported_seq":86,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.533109+0000","last_change":"2024-05-04T00:31:21.441521+0000","last_active":"2024-05-04T01:02:31.533109+0000","last_peered":"2024-05-04T01:02:31.533109+0000","last_clean":"2024-05-04T01:02:31.533109+0000","last_became_active":"2024-05-04T00:31:21.441074+0000","last_became_peered":"2024-05-04T00:31:21.441074+0000","last_unstale":"2024-05-04T01:02:31.533109+0000","last_undegraded":"2024-05-04T01:02:31.533109+0000","last_fullsized":"2024-05-04T01:02:31.533109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:31.926158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"28'3","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:02.977229+0000","last_change":"2024-05-04T00:31:19.174493+0000","last_active":"2024-05-04T01:02:02.977229+0000","last_peered":"2024-05-04T01:02:02.977229+0000","last_clean":"2024-05-04T01:02:02.977229+0000","last_became_active":"2024-05-04T00:31:19.174113+0000","last_became_peered":"2024-05-04T00:31:19.174113+0000","last_unstale":"2024-05-04T01:02:02.977229+0000","last_undegraded":"2024-05-04T01:02:02.977229+0000","last_fullsized":"2024-05-04T01:02:02.977229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:54.336528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"28'49","reported_seq":83,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.436970+0000","last_change":"2024-05-04T00:31:21.406782+0000","last_active":"2024-05-04T01:02:31.436970+0000","last_peered":"2024-05-04T01:02:31.436970+0000","last_clean":"2024-05-04T01:02:31.436970+0000","last_became_active":"2024-05-04T00:31:21.406008+0000","last_became_peered":"2024-05-04T00:31:21.406008+0000","last_unstale":"2024-05-04T01:02:31.436970+0000","last_undegraded":"2024-05-04T01:02:31.436970+0000","last_fullsized":"2024-05-04T01:02:31.436970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:24:01.565048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":5340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"28'574","reported_seq":612,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:03.886093+0000","last_change":"2024-05-04T00:31:19.248682+0000","last_active":"2024-05-04T01:02:03.886093+0000","last_peered":"2024-05-04T01:02:03.886093+0000","last_clean":"2024-05-04T01:02:03.886093+0000","last_became_active":"2024-05-04T00:31:19.247736+0000","last_became_peered":"2024-05-04T00:31:19.247736+0000","last_unstale":"2024-05-04T01:02:03.886093+0000","last_undegraded":"2024-05-04T01:02:03.886093+0000","last_fullsized":"2024-05-04T01:02:03.886093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:42:59.459764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":570,"num_write_kb":4382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"28'46","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.694414+0000","last_change":"2024-05-04T00:31:21.401858+0000","last_active":"2024-05-04T01:02:31.694414+0000","last_peered":"2024-05-04T01:02:31.694414+0000","last_clean":"2024-05-04T01:02:31.694414+0000","last_became_active":"2024-05-04T00:31:21.400935+0000","last_became_peered":"2024-05-04T00:31:21.400935+0000","last_unstale":"2024-05-04T01:02:31.694414+0000","last_undegraded":"2024-05-04T01:02:31.694414+0000","last_fullsized":"2024-05-04T01:02:31.694414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:50:11.762845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"28'52","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.696600+0000","last_change":"2024-05-04T00:31:21.392918+0000","last_active":"2024-05-04T01:02:31.696600+0000","last_peered":"2024-05-04T01:02:31.696600+0000","last_clean":"2024-05-04T01:02:31.696600+0000","last_became_active":"2024-05-04T00:31:21.392020+0000","last_became_peered":"2024-05-04T00:31:21.392020+0000","last_unstale":"2024-05-04T01:02:31.696600+0000","last_undegraded":"2024-05-04T01:02:31.696600+0000","last_fullsized":"2024-05-04T01:02:31.696600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:19:30.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":3157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:32.731087+0000","last_change":"2024-05-04T00:31:19.187930+0000","last_active":"2024-05-04T01:01:32.731087+0000","last_peered":"2024-05-04T01:01:32.731087+0000","last_clean":"2024-05-04T01:01:32.731087+0000","last_became_active":"2024-05-04T00:31:19.185156+0000","last_became_peered":"2024-05-04T00:31:19.185156+0000","last_unstale":"2024-05-04T01:01:32.731087+0000","last_undegraded":"2024-05-04T01:01:32.731087+0000","last_fullsized":"2024-05-04T01:01:32.731087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:40.266177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'39","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.367470+0000","last_change":"2024-05-04T00:31:21.397596+0000","last_active":"2024-05-04T01:02:31.367470+0000","last_peered":"2024-05-04T01:02:31.367470+0000","last_clean":"2024-05-04T01:02:31.367470+0000","last_became_active":"2024-05-04T00:31:21.396023+0000","last_became_peered":"2024-05-04T00:31:21.396023+0000","last_unstale":"2024-05-04T01:02:31.367470+0000","last_undegraded":"2024-05-04T01:02:31.367470+0000","last_fullsized":"2024-05-04T01:02:31.367470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:02:02.166274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"28'11","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:15.854981+0000","last_change":"2024-05-04T00:31:19.189413+0000","last_active":"2024-05-04T01:02:15.854981+0000","last_peered":"2024-05-04T01:02:15.854981+0000","last_clean":"2024-05-04T01:02:15.854981+0000","last_became_active":"2024-05-04T00:31:19.188359+0000","last_became_peered":"2024-05-04T00:31:19.188359+0000","last_unstale":"2024-05-04T01:02:15.854981+0000","last_undegraded":"2024-05-04T01:02:15.854981+0000","last_fullsized":"2024-05-04T01:02:15.854981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:16:43.456248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"28'51","reported_seq":87,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.471110+0000","last_change":"2024-05-04T00:31:21.417364+0000","last_active":"2024-05-04T01:02:31.471110+0000","last_peered":"2024-05-04T01:02:31.471110+0000","last_clean":"2024-05-04T01:02:31.471110+0000","last_became_active":"2024-05-04T00:31:21.416267+0000","last_became_peered":"2024-05-04T00:31:21.416267+0000","last_unstale":"2024-05-04T01:02:31.471110+0000","last_undegraded":"2024-05-04T01:02:31.471110+0000","last_fullsized":"2024-05-04T01:02:31.471110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:42:31.303120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":6244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"28'119","reported_seq":159,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.967954+0000","last_change":"2024-05-04T00:31:19.187081+0000","last_active":"2024-05-04T01:02:31.967954+0000","last_peered":"2024-05-04T01:02:31.967954+0000","last_clean":"2024-05-04T01:02:31.967954+0000","last_became_active":"2024-05-04T00:31:19.186483+0000","last_became_peered":"2024-05-04T00:31:19.186483+0000","last_unstale":"2024-05-04T01:02:31.967954+0000","last_undegraded":"2024-05-04T01:02:31.967954+0000","last_fullsized":"2024-05-04T01:02:31.967954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:07.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092188,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":1130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"28'29","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.430195+0000","last_change":"2024-05-04T00:31:21.414034+0000","last_active":"2024-05-04T01:02:31.430195+0000","last_peered":"2024-05-04T01:02:31.430195+0000","last_clean":"2024-05-04T01:02:31.430195+0000","last_became_active":"2024-05-04T00:31:21.413330+0000","last_became_peered":"2024-05-04T00:31:21.413330+0000","last_unstale":"2024-05-04T01:02:31.430195+0000","last_undegraded":"2024-05-04T01:02:31.430195+0000","last_fullsized":"2024-05-04T01:02:31.430195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:07.135906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":2406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"28'620","reported_seq":660,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:11.537008+0000","last_change":"2024-05-04T00:31:19.175936+0000","last_active":"2024-05-04T01:02:11.537008+0000","last_peered":"2024-05-04T01:02:11.537008+0000","last_clean":"2024-05-04T01:02:11.537008+0000","last_became_active":"2024-05-04T00:31:19.175356+0000","last_became_peered":"2024-05-04T00:31:19.175356+0000","last_unstale":"2024-05-04T01:02:11.537008+0000","last_undegraded":"2024-05-04T01:02:11.537008+0000","last_fullsized":"2024-05-04T01:02:11.537008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:33.026019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":4428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2165,"num_write_kb":250211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2827,"ondisk_log_size":2827,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22178359,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":465,"num_read_kb":490,"num_write":6723,"num_write_kb":24988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44507136,"data_stored":44356718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5158,"ondisk_log_size":5158,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509830,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":4396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":4501504,"data_stored":4307686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509830,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35536,"kb_used_data":8520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336304,"statfs":{"total":96636764160,"available":96600375296,"internally_reserved":0,"allocated":8724480,"data_stored":8502444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509831,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43828,"kb_used_data":8492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328012,"statfs":{"total":96636764160,"available":96591884288,"internally_reserved":0,"allocated":8695808,"data_stored":8500910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509831,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":897024,"data_stored":702124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509830,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43900,"kb_used_data":4404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327940,"statfs":{"total":96636764160,"available":96591810560,"internally_reserved":0,"allocated":4509696,"data_stored":4307216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542533,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1523712,"data_stored":1313341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542533,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41496,"kb_used_data":6160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330344,"statfs":{"total":96636764160,"available":96594272256,"internally_reserved":0,"allocated":6307840,"data_stored":6098491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542533,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52088,"kb_used_data":12592,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319752,"statfs":{"total":96636764160,"available":96583426048,"internally_reserved":0,"allocated":12894208,"data_stored":12695734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4195620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12599296,"data_stored":12584138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8429568,"data_stored":8390848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5419008,"data_stored":5397665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4196090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1228800,"data_stored":1202883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T01:02:40.020 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T01:02:40.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.217+0000 7f2ddd5c4640 1 Processor -- start 2024-05-04T01:02:40.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.217+0000 7f2ddd5c4640 1 -- start start 2024-05-04T01:02:40.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.217+0000 7f2ddd5c4640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2dd80c9320 0x7f2dd8160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:40.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.217+0000 7f2ddd5c4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2dd80631c0 0x7f2dd80635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:40.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.217+0000 7f2ddd5c4640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dd81568d0 con 0x7f2dd806d690 2024-05-04T01:02:40.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.217+0000 7f2ddd5c4640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f2dd815f810 con 0x7f2dd80631c0 2024-05-04T01:02:40.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.217+0000 7f2ddd5c4640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f2dd806ca40 con 0x7f2dd80c9320 2024-05-04T01:02:40.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.221+0000 7f2dd77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2dd80631c0 0x7f2dd80635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:40.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.225+0000 7f2dd77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2dd80631c0 0x7f2dd80635d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57540/0 (socket says 172.21.15.6:57540) 2024-05-04T01:02:40.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.225+0000 7f2dd77fe640 1 -- 172.21.15.6:0/3917950649 learned_addr learned my addr 172.21.15.6:0/3917950649 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:40.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.229+0000 7f2dd77fe640 1 -- 172.21.15.6:0/3917950649 >> v2:172.21.15.163:3300/0 conn(0x7f2dd80c9320 msgr2=0x7f2dd8160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:40.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.229+0000 7f2dd77fe640 1 --2- 172.21.15.6:0/3917950649 >> v2:172.21.15.163:3300/0 conn(0x7f2dd80c9320 0x7f2dd8160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:40.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.229+0000 7f2dd77fe640 1 -- 172.21.15.6:0/3917950649 >> v1:172.21.15.163:6789/0 conn(0x7f2dd806d690 legacy=0x7f2dd81561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:40.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.229+0000 7f2dd77fe640 1 -- 172.21.15.6:0/3917950649 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd806cd20 con 0x7f2dd80631c0 2024-05-04T01:02:40.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.233+0000 7f2dd77fe640 1 --2- 172.21.15.6:0/3917950649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dd80631c0 0x7f2dd80635d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8074ee0 tx=0x7f2dd001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c98dcbbbd36b74 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:40.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.237+0000 7f2dd67fc640 1 -- 172.21.15.6:0/3917950649 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd00a5710 con 0x7f2dd80631c0 2024-05-04T01:02:40.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.237+0000 7f2dd67fc640 1 -- 172.21.15.6:0/3917950649 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd00a58b0 con 0x7f2dd80631c0 2024-05-04T01:02:40.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.237+0000 7f2dd67fc640 1 -- 172.21.15.6:0/3917950649 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd00a5c80 con 0x7f2dd80631c0 2024-05-04T01:02:40.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.241+0000 7f2ddd5c4640 1 -- 172.21.15.6:0/3917950649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dd80631c0 msgr2=0x7f2dd80635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:40.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.241+0000 7f2ddd5c4640 1 --2- 172.21.15.6:0/3917950649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dd80631c0 0x7f2dd80635d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8074ee0 tx=0x7f2dd001c980 comp rx=0 tx=0).stop 2024-05-04T01:02:40.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.241+0000 7f2ddd5c4640 1 -- 172.21.15.6:0/3917950649 shutdown_connections 2024-05-04T01:02:40.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.241+0000 7f2ddd5c4640 1 --2- 172.21.15.6:0/3917950649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dd80631c0 0x7f2dd80635d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:40.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.241+0000 7f2ddd5c4640 1 --2- 172.21.15.6:0/3917950649 >> v2:172.21.15.163:3300/0 conn(0x7f2dd80c9320 0x7f2dd8160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:40.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.241+0000 7f2ddd5c4640 1 -- 172.21.15.6:0/3917950649 >> 172.21.15.6:0/3917950649 conn(0x7f2dd80ce410 msgr2=0x7f2dd80ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:40.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.241+0000 7f2ddd5c4640 1 -- 172.21.15.6:0/3917950649 shutdown_connections 2024-05-04T01:02:40.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.241+0000 7f2ddd5c4640 1 -- 172.21.15.6:0/3917950649 wait complete. 2024-05-04T01:02:40.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.241+0000 7f2ddd5c4640 1 Processor -- start 2024-05-04T01:02:40.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.241+0000 7f2ddd5c4640 1 -- start start 2024-05-04T01:02:40.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.241+0000 7f2ddd5c4640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2dd80631c0 0x7f2dd81491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:40.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.241+0000 7f2ddd5c4640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2dd806d690 0x7f2dd814ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:40.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.241+0000 7f2ddd5c4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dd80c9320 0x7f2dd8143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:40.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.241+0000 7f2ddd5c4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd81695d0 con 0x7f2dd80c9320 2024-05-04T01:02:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.241+0000 7f2ddd5c4640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd806d2c0 con 0x7f2dd80631c0 2024-05-04T01:02:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.241+0000 7f2ddd5c4640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd8169750 con 0x7f2dd806d690 2024-05-04T01:02:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.245+0000 7f2dce7fc640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2dd806d690 0x7f2dd814ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:40.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.245+0000 7f2dd6ffd640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2dd80631c0 0x7f2dd81491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:40.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.245+0000 7f2dce7fc640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2dd806d690 0x7f2dd814ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:51430/0 (socket says 172.21.15.6:51430) 2024-05-04T01:02:40.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.245+0000 7f2dce7fc640 1 -- 172.21.15.6:0/2840707655 learned_addr learned my addr 172.21.15.6:0/2840707655 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:40.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.245+0000 7f2dd77fe640 1 --2- 172.21.15.6:0/2840707655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dd80c9320 0x7f2dd8143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.257+0000 7f2dd6ffd640 1 -- 172.21.15.6:0/2840707655 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2dd806d690 msgr2=0x7f2dd814ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.257+0000 7f2dd6ffd640 1 --2- 172.21.15.6:0/2840707655 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2dd806d690 0x7f2dd814ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.257+0000 7f2dd6ffd640 1 -- 172.21.15.6:0/2840707655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dd80c9320 msgr2=0x7f2dd8143960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.257+0000 7f2dd6ffd640 1 --2- 172.21.15.6:0/2840707655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dd80c9320 0x7f2dd8143960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:40.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.257+0000 7f2dd6ffd640 1 -- 172.21.15.6:0/2840707655 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd815bac0 con 0x7f2dd80631c0 2024-05-04T01:02:40.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.265+0000 7f2dd6ffd640 1 --2- 172.21.15.6:0/2840707655 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2dd80631c0 0x7f2dd81491e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800b440 tx=0x7f2dc800b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:40.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.449+0000 7f2dcffff640 1 -- 172.21.15.6:0/2840707655 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8011830 con 0x7f2dd80631c0 2024-05-04T01:02:40.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.449+0000 7f2dcffff640 1 -- 172.21.15.6:0/2840707655 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc8016070 con 0x7f2dd80631c0 2024-05-04T01:02:40.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.449+0000 7f2dcffff640 1 -- 172.21.15.6:0/2840707655 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8011c10 con 0x7f2dd80631c0 2024-05-04T01:02:40.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.449+0000 7f2ddd5c4640 1 -- 172.21.15.6:0/2840707655 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd815bda0 con 0x7f2dd80631c0 2024-05-04T01:02:40.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.449+0000 7f2ddd5c4640 1 -- 172.21.15.6:0/2840707655 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd814d6b0 con 0x7f2dd80631c0 2024-05-04T01:02:40.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.449+0000 7f2ddd5c4640 1 -- 172.21.15.6:0/2840707655 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd8148f70 con 0x7f2dd80631c0 2024-05-04T01:02:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.809+0000 7f2dcffff640 1 -- 172.21.15.6:0/2840707655 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2dc8004020 con 0x7f2dd80631c0 2024-05-04T01:02:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.809+0000 7f2dcffff640 1 --2- 172.21.15.6:0/2840707655 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f2db806f480 0x7f2db8071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:40.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.813+0000 7f2dce7fc640 1 --2- 172.21.15.6:0/2840707655 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f2db806f480 0x7f2db8071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.813+0000 7f2dce7fc640 1 --2- 172.21.15.6:0/2840707655 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f2db806f480 0x7f2db8071990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2dd81f9b30 tx=0x7f2dc00090e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.817+0000 7f2dcffff640 1 -- 172.21.15.6:0/2840707655 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f2dc8058490 con 0x7f2dd80631c0 2024-05-04T01:02:40.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:40.845+0000 7f2dcffff640 1 -- 172.21.15.6:0/2840707655 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2dd8148f70 con 0x7f2dd80631c0 2024-05-04T01:02:41.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:41.033+0000 7f2ddd5c4640 1 -- 172.21.15.6:0/2840707655 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2dd8069a50 con 0x7f2dd80631c0 2024-05-04T01:02:41.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:41.221+0000 7f2dcffff640 1 -- 172.21.15.6:0/2840707655 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+16585 (secure 0 0 0) 0x7f2dc805c200 con 0x7f2dd80631c0 2024-05-04T01:02:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T01:02:41.225 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":28,"fsid":"ad5951ed-0d5e-4770-b5d9-995e08a00213","created":"2024-05-04T00:30:11.236352+0000","modified":"2024-05-04T00:32:21.477287+0000","last_up_change":"2024-05-04T00:30:35.679943+0000","last_in_change":"2024-05-04T00:30:24.926330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T00:30:36.311072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T00:31:17.278288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T00:31:18.957819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a907d753-b7cf-499c-ae36-81e44ed933a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6805","nonce":489144503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6810","nonce":489144503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6824","nonce":489144503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6813","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6817","nonce":489144503}]},"public_addr":"172.21.15.6:6805/489144503","cluster_addr":"172.21.15.6:6810/489144503","heartbeat_back_addr":"172.21.15.6:6824/489144503","heartbeat_front_addr":"172.21.15.6:6817/489144503","state":["exists","up"]},{"osd":1,"uuid":"eab41a32-d5f1-43b8-8835-f2d4bffc9cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6802","nonce":3099957279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6807","nonce":3099957279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6819","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6823","nonce":3099957279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6815","nonce":3099957279}]},"public_addr":"172.21.15.6:6802/3099957279","cluster_addr":"172.21.15.6:6807/3099957279","heartbeat_back_addr":"172.21.15.6:6823/3099957279","heartbeat_front_addr":"172.21.15.6:6815/3099957279","state":["exists","up"]},{"osd":2,"uuid":"f2540144-b533-4ffc-a9cf-24f0e4910a9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6801","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6806","nonce":2770857903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6809","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6812","nonce":2770857903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6827","nonce":2770857903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6821","nonce":2770857903}]},"public_addr":"172.21.15.6:6806/2770857903","cluster_addr":"172.21.15.6:6812/2770857903","heartbeat_back_addr":"172.21.15.6:6827/2770857903","heartbeat_front_addr":"172.21.15.6:6821/2770857903","state":["exists","up"]},{"osd":3,"uuid":"982b7ace-fd02-4f03-aef2-0428468f8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6818","nonce":3149875909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6826","nonce":3149875909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6831","nonce":3149875909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6829","nonce":3149875909}]},"public_addr":"172.21.15.6:6818/3149875909","cluster_addr":"172.21.15.6:6826/3149875909","heartbeat_back_addr":"172.21.15.6:6831/3149875909","heartbeat_front_addr":"172.21.15.6:6829/3149875909","state":["exists","up"]},{"osd":4,"uuid":"ecf94166-cfdf-4ac8-a659-6ae907686e8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6818","nonce":2508264225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6821","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6824","nonce":2508264225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6833","nonce":2508264225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6831","nonce":2508264225}]},"public_addr":"172.21.15.163:6818/2508264225","cluster_addr":"172.21.15.163:6824/2508264225","heartbeat_back_addr":"172.21.15.163:6833/2508264225","heartbeat_front_addr":"172.21.15.163:6831/2508264225","state":["exists","up"]},{"osd":5,"uuid":"fc5cfa90-0e3a-4fc2-829c-5ff57d7a5953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6815","nonce":167619435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6820","nonce":167619435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6827","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6829","nonce":167619435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6825","nonce":167619435}]},"public_addr":"172.21.15.163:6815/167619435","cluster_addr":"172.21.15.163:6820/167619435","heartbeat_back_addr":"172.21.15.163:6829/167619435","heartbeat_front_addr":"172.21.15.163:6825/167619435","state":["exists","up"]},{"osd":6,"uuid":"ed95f0cf-f309-4861-b47c-4a5a6b44ffdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6811","nonce":1460767610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6813","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6814","nonce":1460767610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6830","nonce":1460767610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6819","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6822","nonce":1460767610}]},"public_addr":"172.21.15.163:6811/1460767610","cluster_addr":"172.21.15.163:6814/1460767610","heartbeat_back_addr":"172.21.15.163:6830/1460767610","heartbeat_front_addr":"172.21.15.163:6822/1460767610","state":["exists","up"]},{"osd":7,"uuid":"2f57afcd-567f-44f6-9db7-df0342c8c4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6803","nonce":239650691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6805","nonce":239650691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6809","nonce":239650691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6807","nonce":239650691}]},"public_addr":"172.21.15.163:6803/239650691","cluster_addr":"172.21.15.163:6805/239650691","heartbeat_back_addr":"172.21.15.163:6809/239650691","heartbeat_front_addr":"172.21.15.163:6807/239650691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.818870+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.749094+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.805522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.576430+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.740084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.755726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.797961+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.577731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T01:02:41.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:41.225+0000 7f2ddd5c4640 1 -- 172.21.15.6:0/2840707655 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f2db806f480 msgr2=0x7f2db8071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:41.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:41.225+0000 7f2ddd5c4640 1 --2- 172.21.15.6:0/2840707655 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f2db806f480 0x7f2db8071990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2dd81f9b30 tx=0x7f2dc00090e0 comp rx=0 tx=0).stop 2024-05-04T01:02:41.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:41.225+0000 7f2ddd5c4640 1 -- 172.21.15.6:0/2840707655 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2dd80631c0 msgr2=0x7f2dd81491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:41.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:41.225+0000 7f2ddd5c4640 1 --2- 172.21.15.6:0/2840707655 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2dd80631c0 0x7f2dd81491e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800b440 tx=0x7f2dc800b900 comp rx=0 tx=0).stop 2024-05-04T01:02:41.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:41.225+0000 7f2ddd5c4640 1 -- 172.21.15.6:0/2840707655 shutdown_connections 2024-05-04T01:02:41.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:41.225+0000 7f2ddd5c4640 1 --2- 172.21.15.6:0/2840707655 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f2db806f480 0x7f2db8071990 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:41.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:41.225+0000 7f2ddd5c4640 1 --2- 172.21.15.6:0/2840707655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dd80c9320 0x7f2dd8143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:41.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:41.225+0000 7f2ddd5c4640 1 --2- 172.21.15.6:0/2840707655 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2dd806d690 0x7f2dd814ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:41.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:41.225+0000 7f2ddd5c4640 1 --2- 172.21.15.6:0/2840707655 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2dd80631c0 0x7f2dd81491e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:41.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:41.225+0000 7f2ddd5c4640 1 -- 172.21.15.6:0/2840707655 >> 172.21.15.6:0/2840707655 conn(0x7f2dd80ce410 msgr2=0x7f2dd80ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:41.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:41.225+0000 7f2ddd5c4640 1 -- 172.21.15.6:0/2840707655 shutdown_connections 2024-05-04T01:02:41.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:41.225+0000 7f2ddd5c4640 1 -- 172.21.15.6:0/2840707655 wait complete. 2024-05-04T01:02:42.264 INFO:tasks.ceph:Scrubbing osd.0 2024-05-04T01:02:42.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-04T01:02:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.433+0000 7f9a8a3ff640 1 Processor -- start 2024-05-04T01:02:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.437+0000 7f9a8a3ff640 1 -- start start 2024-05-04T01:02:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.437+0000 7f9a8a3ff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a840c85c0 0x7f9a8414f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.437+0000 7f9a8a3ff640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9a840caea0 0x7f9a84163640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:42.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.437+0000 7f9a8a3ff640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a840b3fe0 con 0x7f9a840caa90 2024-05-04T01:02:42.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.437+0000 7f9a8a3ff640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f9a84074590 con 0x7f9a840caea0 2024-05-04T01:02:42.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.437+0000 7f9a8a3ff640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f9a84074870 con 0x7f9a840c85c0 2024-05-04T01:02:42.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.437+0000 7f9a83fff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a840c85c0 0x7f9a8414f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:42.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.441+0000 7f9a837fe640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f9a840caa90 0x7f9a841592f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:34268/0 (socket says 172.21.15.6:34268) 2024-05-04T01:02:42.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.441+0000 7f9a837fe640 1 -- 172.21.15.6:0/1982873454 learned_addr learned my addr 172.21.15.6:0/1982873454 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T01:02:42.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.441+0000 7f9a8899c640 1 --2- 172.21.15.6:0/1982873454 >> v2:172.21.15.163:3300/0 conn(0x7f9a840caea0 0x7f9a84163640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:42.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.449+0000 7f9a83fff640 1 -- 172.21.15.6:0/1982873454 >> v2:172.21.15.163:3300/0 conn(0x7f9a840caea0 msgr2=0x7f9a84163640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:42.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.449+0000 7f9a83fff640 1 --2- 172.21.15.6:0/1982873454 >> v2:172.21.15.163:3300/0 conn(0x7f9a840caea0 0x7f9a84163640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:42.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.449+0000 7f9a83fff640 1 -- 172.21.15.6:0/1982873454 >> v1:172.21.15.163:6789/0 conn(0x7f9a840caa90 legacy=0x7f9a841592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:42.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.449+0000 7f9a83fff640 1 -- 172.21.15.6:0/1982873454 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a84074b50 con 0x7f9a840c85c0 2024-05-04T01:02:42.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.453+0000 7f9a83fff640 1 --2- 172.21.15.6:0/1982873454 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a840c85c0 0x7f9a8414f530 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0097c0 tx=0x7f9a7c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4d8dd8d401340b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:42.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.465+0000 7f9a82ffd640 1 -- 172.21.15.6:0/1982873454 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c0b5070 con 0x7f9a840c85c0 2024-05-04T01:02:42.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.465+0000 7f9a82ffd640 1 -- 172.21.15.6:0/1982873454 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a7c0a8990 con 0x7f9a840c85c0 2024-05-04T01:02:42.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.465+0000 7f9a82ffd640 1 -- 172.21.15.6:0/1982873454 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c0a8d60 con 0x7f9a840c85c0 2024-05-04T01:02:42.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.469+0000 7f9a8a3ff640 1 -- 172.21.15.6:0/1982873454 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a840c85c0 msgr2=0x7f9a8414f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:42.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.469+0000 7f9a8a3ff640 1 --2- 172.21.15.6:0/1982873454 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a840c85c0 0x7f9a8414f530 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0097c0 tx=0x7f9a7c01ec90 comp rx=0 tx=0).stop 2024-05-04T01:02:42.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.469+0000 7f9a8a3ff640 1 -- 172.21.15.6:0/1982873454 shutdown_connections 2024-05-04T01:02:42.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.469+0000 7f9a8a3ff640 1 --2- 172.21.15.6:0/1982873454 >> v2:172.21.15.163:3300/0 conn(0x7f9a840caea0 0x7f9a84163640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:42.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.469+0000 7f9a8a3ff640 1 --2- 172.21.15.6:0/1982873454 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a840c85c0 0x7f9a8414f530 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:42.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.469+0000 7f9a8a3ff640 1 -- 172.21.15.6:0/1982873454 >> 172.21.15.6:0/1982873454 conn(0x7f9a8406cb80 msgr2=0x7f9a8406cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:42.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.469+0000 7f9a8a3ff640 1 -- 172.21.15.6:0/1982873454 shutdown_connections 2024-05-04T01:02:42.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.469+0000 7f9a8a3ff640 1 -- 172.21.15.6:0/1982873454 wait complete. 2024-05-04T01:02:42.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.469+0000 7f9a8a3ff640 1 Processor -- start 2024-05-04T01:02:42.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.469+0000 7f9a8a3ff640 1 -- start start 2024-05-04T01:02:42.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.473+0000 7f9a8a3ff640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a840c85c0 0x7f9a841f34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:42.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.473+0000 7f9a8a3ff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a840caa90 0x7f9a8414eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:42.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.473+0000 7f9a8a3ff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a840caea0 0x7f9a841e5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:42.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.473+0000 7f9a8a3ff640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9a840cb2b0 con 0x7f9a840caa90 2024-05-04T01:02:42.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.473+0000 7f9a8a3ff640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9a84158dd0 con 0x7f9a840c85c0 2024-05-04T01:02:42.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.473+0000 7f9a8a3ff640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f9a841532d0 con 0x7f9a840caea0 2024-05-04T01:02:42.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.473+0000 7f9a837fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a840caa90 0x7f9a8414eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:42.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.473+0000 7f9a83fff640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a840c85c0 0x7f9a841f34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:42.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.473+0000 7f9a837fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a840caa90 0x7f9a8414eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57550/0 (socket says 172.21.15.6:57550) 2024-05-04T01:02:42.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.473+0000 7f9a837fe640 1 -- 172.21.15.6:0/1128707057 learned_addr learned my addr 172.21.15.6:0/1128707057 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.477+0000 7f9a837fe640 1 -- 172.21.15.6:0/1128707057 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a840caea0 msgr2=0x7f9a841e5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.477+0000 7f9a837fe640 1 --2- 172.21.15.6:0/1128707057 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a840caea0 0x7f9a841e5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.477+0000 7f9a837fe640 1 -- 172.21.15.6:0/1128707057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a840c85c0 msgr2=0x7f9a841f34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.477+0000 7f9a837fe640 1 --2- 172.21.15.6:0/1128707057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a840c85c0 0x7f9a841f34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.477+0000 7f9a837fe640 1 -- 172.21.15.6:0/1128707057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a841585e0 con 0x7f9a840caa90 2024-05-04T01:02:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.481+0000 7f9a837fe640 1 --2- 172.21.15.6:0/1128707057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a840caa90 0x7f9a8414eaa0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00c3c0 tx=0x7f9a6c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.485+0000 7f9a80ff9640 1 -- 172.21.15.6:0/1128707057 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c017070 con 0x7f9a840caa90 2024-05-04T01:02:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.485+0000 7f9a80ff9640 1 -- 172.21.15.6:0/1128707057 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a6c005d10 con 0x7f9a840caa90 2024-05-04T01:02:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.485+0000 7f9a8a3ff640 1 -- 172.21.15.6:0/1128707057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a841463f0 con 0x7f9a840caa90 2024-05-04T01:02:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.485+0000 7f9a80ff9640 1 -- 172.21.15.6:0/1128707057 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c007310 con 0x7f9a840caa90 2024-05-04T01:02:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.485+0000 7f9a8a3ff640 1 -- 172.21.15.6:0/1128707057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a841f29c0 con 0x7f9a840caa90 2024-05-04T01:02:42.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.489+0000 7f9a8a3ff640 1 -- 172.21.15.6:0/1128707057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9a84069a50 con 0x7f9a840caa90 2024-05-04T01:02:42.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.513+0000 7f9a80ff9640 1 -- 172.21.15.6:0/1128707057 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9a6c01a070 con 0x7f9a840caa90 2024-05-04T01:02:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.513+0000 7f9a80ff9640 1 --2- 172.21.15.6:0/1128707057 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f9a6406f450 0x7f9a64071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.513+0000 7f9a83fff640 1 --2- 172.21.15.6:0/1128707057 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f9a6406f450 0x7f9a64071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:42.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.517+0000 7f9a83fff640 1 --2- 172.21.15.6:0/1128707057 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f9a6406f450 0x7f9a64071960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0b2000 tx=0x7f9a7c0aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:42.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.525+0000 7f9a80ff9640 1 -- 172.21.15.6:0/1128707057 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f9a6c0576d0 con 0x7f9a840caa90 2024-05-04T01:02:42.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.525+0000 7f9a80ff9640 1 --2- 172.21.15.6:0/1128707057 >> [v2:172.21.15.6:6803/489144503,v1:172.21.15.6:6805/489144503] conn(0x7f9a64077700 0x7f9a64079b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:42.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.525+0000 7f9a80ff9640 1 -- 172.21.15.6:0/1128707057 --> [v2:172.21.15.6:6803/489144503,v1:172.21.15.6:6805/489144503] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a6407a240 con 0x7f9a64077700 2024-05-04T01:02:42.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.525+0000 7f9a8899c640 1 --2- 172.21.15.6:0/1128707057 >> [v2:172.21.15.6:6803/489144503,v1:172.21.15.6:6805/489144503] conn(0x7f9a64077700 0x7f9a64079b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:42.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.525+0000 7f9a8899c640 1 --2- 172.21.15.6:0/1128707057 >> [v2:172.21.15.6:6803/489144503,v1:172.21.15.6:6805/489144503] conn(0x7f9a64077700 0x7f9a64079b70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:42.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.525+0000 7f9a80ff9640 1 -- 172.21.15.6:0/1128707057 <== osd.0 v2:172.21.15.6:6803/489144503 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9a6407a240 con 0x7f9a64077700 2024-05-04T01:02:42.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.545+0000 7f9a80ff9640 1 -- 172.21.15.6:0/1128707057 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9a6c057a90 con 0x7f9a840caa90 2024-05-04T01:02:42.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.545+0000 7f9a8a3ff640 1 -- 172.21.15.6:0/1128707057 --> [v2:172.21.15.6:6803/489144503,v1:172.21.15.6:6805/489144503] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9a840cea30 con 0x7f9a64077700 2024-05-04T01:02:42.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.545+0000 7f9a80ff9640 1 -- 172.21.15.6:0/1128707057 <== osd.0 v2:172.21.15.6:6803/489144503 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9a840cea30 con 0x7f9a64077700 2024-05-04T01:02:42.549 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-04T01:02:42.550 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T01:02:42.550 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-04T01:02:42.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.549+0000 7f9a8a3ff640 1 -- 172.21.15.6:0/1128707057 >> [v2:172.21.15.6:6803/489144503,v1:172.21.15.6:6805/489144503] conn(0x7f9a64077700 msgr2=0x7f9a64079b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:42.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.549+0000 7f9a8a3ff640 1 --2- 172.21.15.6:0/1128707057 >> [v2:172.21.15.6:6803/489144503,v1:172.21.15.6:6805/489144503] conn(0x7f9a64077700 0x7f9a64079b70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:42.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.549+0000 7f9a8a3ff640 1 -- 172.21.15.6:0/1128707057 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f9a6406f450 msgr2=0x7f9a64071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:42.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.549+0000 7f9a8a3ff640 1 --2- 172.21.15.6:0/1128707057 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f9a6406f450 0x7f9a64071960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0b2000 tx=0x7f9a7c0aa070 comp rx=0 tx=0).stop 2024-05-04T01:02:42.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.549+0000 7f9a8a3ff640 1 -- 172.21.15.6:0/1128707057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a840caa90 msgr2=0x7f9a8414eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:42.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.549+0000 7f9a8a3ff640 1 --2- 172.21.15.6:0/1128707057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a840caa90 0x7f9a8414eaa0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00c3c0 tx=0x7f9a6c00c880 comp rx=0 tx=0).stop 2024-05-04T01:02:42.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.549+0000 7f9a8899c640 1 -- 172.21.15.6:0/1128707057 reap_dead start 2024-05-04T01:02:42.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.549+0000 7f9a8a3ff640 1 -- 172.21.15.6:0/1128707057 shutdown_connections 2024-05-04T01:02:42.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.549+0000 7f9a8a3ff640 1 -- 172.21.15.6:0/1128707057 >> 172.21.15.6:0/1128707057 conn(0x7f9a8406cb80 msgr2=0x7f9a84070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:42.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.549+0000 7f9a8a3ff640 1 -- 172.21.15.6:0/1128707057 shutdown_connections 2024-05-04T01:02:42.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.549+0000 7f9a8a3ff640 1 -- 172.21.15.6:0/1128707057 wait complete. 2024-05-04T01:02:42.581 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-04T01:02:42.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.737+0000 7fb91eca8640 1 Processor -- start 2024-05-04T01:02:42.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.737+0000 7fb91eca8640 1 -- start start 2024-05-04T01:02:42.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.737+0000 7fb91eca8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb91815c3d0 0x7fb9180c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:42.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.737+0000 7fb91eca8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9180c5910 con 0x7fb918070c70 2024-05-04T01:02:42.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.737+0000 7fb91eca8640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9180c7b90 con 0x7fb9180c9030 2024-05-04T01:02:42.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.737+0000 7fb91eca8640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fb9180c5bb0 con 0x7fb91815c3d0 2024-05-04T01:02:42.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.737+0000 7fb91d245640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb918070c70 0x7fb918163760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48766/0 (socket says 172.21.15.6:48766) 2024-05-04T01:02:42.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.737+0000 7fb91d245640 1 -- 172.21.15.6:0/247964138 learned_addr learned my addr 172.21.15.6:0/247964138 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T01:02:42.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.741+0000 7fb9177fe640 1 -- 172.21.15.6:0/247964138 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 806616318 0 0) 0x7fb9180c5910 con 0x7fb918070c70 2024-05-04T01:02:42.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.741+0000 7fb9177fe640 1 -- 172.21.15.6:0/247964138 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb908003530 con 0x7fb918070c70 2024-05-04T01:02:42.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.745+0000 7fb9177fe640 1 -- 172.21.15.6:0/247964138 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3736734481 0 0) 0x7fb908003530 con 0x7fb918070c70 2024-05-04T01:02:42.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.745+0000 7fb9177fe640 1 -- 172.21.15.6:0/247964138 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb91815c3d0 msgr2=0x7fb9180c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:42.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.745+0000 7fb9177fe640 1 --2- 172.21.15.6:0/247964138 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb91815c3d0 0x7fb9180c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:42.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.745+0000 7fb9177fe640 1 -- 172.21.15.6:0/247964138 >> v1:172.21.15.163:6789/0 conn(0x7fb9180c9030 legacy=0x7fb918071a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:42.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.745+0000 7fb9177fe640 1 -- 172.21.15.6:0/247964138 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9180c5e90 con 0x7fb918070c70 2024-05-04T01:02:42.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.745+0000 7fb9177fe640 1 -- 172.21.15.6:0/247964138 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 557976392 0 0) 0x7fb910001aa0 con 0x7fb918070c70 2024-05-04T01:02:42.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.745+0000 7fb9177fe640 1 -- 172.21.15.6:0/247964138 >> v1:172.21.15.6:6789/0 conn(0x7fb918070c70 legacy=0x7fb918163760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:42.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.745+0000 7fb9177fe640 1 --2- 172.21.15.6:0/247964138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb908003a40 0x7fb908003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.745+0000 7fb9177fe640 1 --2- 172.21.15.6:0/247964138 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb908004810 0x7fb908004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.745+0000 7fb9177fe640 1 --2- 172.21.15.6:0/247964138 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb91815c3d0 0x7fb90800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.745+0000 7fb9177fe640 1 -- 172.21.15.6:0/247964138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb9180c5bb0 con 0x7fb908003a40 2024-05-04T01:02:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.745+0000 7fb9177fe640 1 -- 172.21.15.6:0/247964138 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb90800bf10 con 0x7fb908004810 2024-05-04T01:02:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.745+0000 7fb9177fe640 1 -- 172.21.15.6:0/247964138 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fb90800c090 con 0x7fb91815c3d0 2024-05-04T01:02:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.749+0000 7fb91ca44640 1 --2- 172.21.15.6:0/247964138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb908003a40 0x7fb908003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:42.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.753+0000 7fb91ca44640 1 -- 172.21.15.6:0/247964138 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb91815c3d0 msgr2=0x7fb90800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:42.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.753+0000 7fb91ca44640 1 --2- 172.21.15.6:0/247964138 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb91815c3d0 0x7fb90800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.753+0000 7fb91ca44640 1 -- 172.21.15.6:0/247964138 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb908004810 msgr2=0x7fb908004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.753+0000 7fb91ca44640 1 --2- 172.21.15.6:0/247964138 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb908004810 0x7fb908004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.753+0000 7fb91ca44640 1 -- 172.21.15.6:0/247964138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb908003530 con 0x7fb908003a40 2024-05-04T01:02:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.757+0000 7fb91ca44640 1 --2- 172.21.15.6:0/247964138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb908003a40 0x7fb908003eb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009890 tx=0x7fb90c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53ce8ca6ebea750 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.761+0000 7fb9177fe640 1 -- 172.21.15.6:0/247964138 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c0b0070 con 0x7fb908003a40 2024-05-04T01:02:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.761+0000 7fb9177fe640 1 -- 172.21.15.6:0/247964138 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb90c0ab620 con 0x7fb908003a40 2024-05-04T01:02:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.761+0000 7fb9177fe640 1 -- 172.21.15.6:0/247964138 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c009460 con 0x7fb908003a40 2024-05-04T01:02:42.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.761+0000 7fb91eca8640 1 -- 172.21.15.6:0/247964138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb908003a40 msgr2=0x7fb908003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:42.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.761+0000 7fb91eca8640 1 --2- 172.21.15.6:0/247964138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb908003a40 0x7fb908003eb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009890 tx=0x7fb90c01c3c0 comp rx=0 tx=0).stop 2024-05-04T01:02:42.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.761+0000 7fb91d245640 1 -- 172.21.15.6:0/247964138 reap_dead start 2024-05-04T01:02:42.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.761+0000 7fb91eca8640 1 -- 172.21.15.6:0/247964138 shutdown_connections 2024-05-04T01:02:42.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.761+0000 7fb91eca8640 1 -- 172.21.15.6:0/247964138 >> 172.21.15.6:0/247964138 conn(0x7fb9180cb310 msgr2=0x7fb9180cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:42.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.761+0000 7fb91eca8640 1 -- 172.21.15.6:0/247964138 shutdown_connections 2024-05-04T01:02:42.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.761+0000 7fb91eca8640 1 -- 172.21.15.6:0/247964138 wait complete. 2024-05-04T01:02:42.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.765+0000 7fb91eca8640 1 Processor -- start 2024-05-04T01:02:42.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.765+0000 7fb91eca8640 1 -- start start 2024-05-04T01:02:42.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.765+0000 7fb91eca8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb908003a40 0x7fb9181553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:42.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.765+0000 7fb91eca8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181567c0 0x7fb9181e4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:42.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.765+0000 7fb91eca8640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb9181526b0 0x7fb91814dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:42.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.765+0000 7fb91eca8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb9180c6450 con 0x7fb9181567c0 2024-05-04T01:02:42.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.765+0000 7fb91eca8640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb9180c7e30 con 0x7fb9181526b0 2024-05-04T01:02:42.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.765+0000 7fb91eca8640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fb9180c65d0 con 0x7fb908003a40 2024-05-04T01:02:42.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.769+0000 7fb917fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181567c0 0x7fb9181e4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:42.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.769+0000 7fb917fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181567c0 0x7fb9181e4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57560/0 (socket says 172.21.15.6:57560) 2024-05-04T01:02:42.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.769+0000 7fb917fff640 1 -- 172.21.15.6:0/1209966367 learned_addr learned my addr 172.21.15.6:0/1209966367 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:42.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.773+0000 7fb917fff640 1 -- 172.21.15.6:0/1209966367 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb908003a40 msgr2=0x7fb9181553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:42.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.773+0000 7fb917fff640 1 --2- 172.21.15.6:0/1209966367 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb908003a40 0x7fb9181553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:42.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.773+0000 7fb917fff640 1 -- 172.21.15.6:0/1209966367 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb9181526b0 msgr2=0x7fb91814dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:42.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.773+0000 7fb917fff640 1 --2- 172.21.15.6:0/1209966367 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb9181526b0 0x7fb91814dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:42.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.773+0000 7fb917fff640 1 -- 172.21.15.6:0/1209966367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb918076590 con 0x7fb9181567c0 2024-05-04T01:02:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.777+0000 7fb917fff640 1 --2- 172.21.15.6:0/1209966367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181567c0 0x7fb9181e4b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb90400c480 tx=0x7fb90400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:42.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.781+0000 7fb9157fa640 1 -- 172.21.15.6:0/1209966367 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb904017070 con 0x7fb9181567c0 2024-05-04T01:02:42.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.781+0000 7fb9157fa640 1 -- 172.21.15.6:0/1209966367 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb904003600 con 0x7fb9181567c0 2024-05-04T01:02:42.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.781+0000 7fb9157fa640 1 -- 172.21.15.6:0/1209966367 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9040039f0 con 0x7fb9181567c0 2024-05-04T01:02:42.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.781+0000 7fb91eca8640 1 -- 172.21.15.6:0/1209966367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9181e4400 con 0x7fb9181567c0 2024-05-04T01:02:42.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.781+0000 7fb91eca8640 1 -- 172.21.15.6:0/1209966367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb918155fc0 con 0x7fb9181567c0 2024-05-04T01:02:42.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:42.785+0000 7fb91eca8640 1 -- 172.21.15.6:0/1209966367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9181e4170 con 0x7fb9181567c0 2024-05-04T01:02:43.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.105+0000 7fb9157fa640 1 -- 172.21.15.6:0/1209966367 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb90401a070 con 0x7fb9181567c0 2024-05-04T01:02:43.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.105+0000 7fb9157fa640 1 --2- 172.21.15.6:0/1209966367 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb8fc06f480 0x7fb8fc071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.109+0000 7fb91ca44640 1 --2- 172.21.15.6:0/1209966367 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb8fc06f480 0x7fb8fc071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.109+0000 7fb91ca44640 1 --2- 172.21.15.6:0/1209966367 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb8fc06f480 0x7fb8fc071990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0ad000 tx=0x7fb90c0047e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:43.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.149+0000 7fb9157fa640 1 -- 172.21.15.6:0/1209966367 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7fb9040575c0 con 0x7fb9181567c0 2024-05-04T01:02:43.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.149+0000 7fb9157fa640 1 -- 172.21.15.6:0/1209966367 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb904021020 con 0x7fb9181567c0 2024-05-04T01:02:43.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.333+0000 7fb91eca8640 1 -- 172.21.15.6:0/1209966367 --> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fb918069a50 con 0x7fb8fc06f480 2024-05-04T01:02:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.333+0000 7fb9157fa640 1 -- 172.21.15.6:0/1209966367 <== mgr.4103 v2:172.21.15.163:6800/2152694980 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb918069a50 con 0x7fb8fc06f480 2024-05-04T01:02:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 0 to deep-scrub 2024-05-04T01:02:43.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.337+0000 7fb91eca8640 1 -- 172.21.15.6:0/1209966367 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb8fc06f480 msgr2=0x7fb8fc071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:43.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.337+0000 7fb91eca8640 1 --2- 172.21.15.6:0/1209966367 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb8fc06f480 0x7fb8fc071990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0ad000 tx=0x7fb90c0047e0 comp rx=0 tx=0).stop 2024-05-04T01:02:43.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.337+0000 7fb91eca8640 1 -- 172.21.15.6:0/1209966367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181567c0 msgr2=0x7fb9181e4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:43.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.337+0000 7fb91eca8640 1 --2- 172.21.15.6:0/1209966367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181567c0 0x7fb9181e4b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb90400c480 tx=0x7fb90400c940 comp rx=0 tx=0).stop 2024-05-04T01:02:43.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.337+0000 7fb91eca8640 1 -- 172.21.15.6:0/1209966367 shutdown_connections 2024-05-04T01:02:43.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.337+0000 7fb91eca8640 1 --2- 172.21.15.6:0/1209966367 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb9181526b0 0x7fb91814dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:43.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.337+0000 7fb91eca8640 1 --2- 172.21.15.6:0/1209966367 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fb8fc06f480 0x7fb8fc071990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:43.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.337+0000 7fb91eca8640 1 --2- 172.21.15.6:0/1209966367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181567c0 0x7fb9181e4b10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.337+0000 7fb91eca8640 1 --2- 172.21.15.6:0/1209966367 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb908003a40 0x7fb9181553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.337+0000 7fb91eca8640 1 -- 172.21.15.6:0/1209966367 >> 172.21.15.6:0/1209966367 conn(0x7fb9180cb310 msgr2=0x7fb918150100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.337+0000 7fb91eca8640 1 -- 172.21.15.6:0/1209966367 shutdown_connections 2024-05-04T01:02:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.337+0000 7fb91eca8640 1 -- 172.21.15.6:0/1209966367 wait complete. 2024-05-04T01:02:43.362 INFO:tasks.ceph:Scrubbing osd.1 2024-05-04T01:02:43.362 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-04T01:02:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.521+0000 7f4e211f7640 1 Processor -- start 2024-05-04T01:02:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.521+0000 7f4e211f7640 1 -- start start 2024-05-04T01:02:43.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.525+0000 7f4e211f7640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4e1c0ca380 0x7f4e1c0c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:43.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.525+0000 7f4e211f7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e1c0ca8c0 con 0x7f4e1c0cba60 2024-05-04T01:02:43.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.525+0000 7f4e211f7640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e1c071010 con 0x7f4e1c0c4ae0 2024-05-04T01:02:43.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.525+0000 7f4e211f7640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f4e1c0cad70 con 0x7f4e1c0ca380 2024-05-04T01:02:43.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.525+0000 7f4e1a59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4e1c0cba60 0x7f4e1c15d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52036/0 (socket says 172.21.15.6:52036) 2024-05-04T01:02:43.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.525+0000 7f4e1a59c640 1 -- 172.21.15.6:0/1065257277 learned_addr learned my addr 172.21.15.6:0/1065257277 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T01:02:43.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.525+0000 7f4e1ad9d640 1 --2- 172.21.15.6:0/1065257277 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4e1c0ca380 0x7f4e1c0c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.529+0000 7f4e19d9b640 1 -- 172.21.15.6:0/1065257277 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4284716239 0 0) 0x7f4e1c0ca8c0 con 0x7f4e1c0cba60 2024-05-04T01:02:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.529+0000 7f4e19d9b640 1 -- 172.21.15.6:0/1065257277 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e08003530 con 0x7f4e1c0cba60 2024-05-04T01:02:43.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.533+0000 7f4e19d9b640 1 -- 172.21.15.6:0/1065257277 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1168267994 0 0) 0x7f4e08003530 con 0x7f4e1c0cba60 2024-05-04T01:02:43.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.533+0000 7f4e19d9b640 1 -- 172.21.15.6:0/1065257277 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4e1c0ca380 msgr2=0x7f4e1c0c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:43.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.533+0000 7f4e19d9b640 1 --2- 172.21.15.6:0/1065257277 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4e1c0ca380 0x7f4e1c0c45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:43.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.533+0000 7f4e19d9b640 1 -- 172.21.15.6:0/1065257277 >> v1:172.21.15.163:6789/0 conn(0x7f4e1c0c4ae0 legacy=0x7f4e1c15db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.533+0000 7f4e19d9b640 1 -- 172.21.15.6:0/1065257277 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e1c0712f0 con 0x7f4e1c0cba60 2024-05-04T01:02:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.533+0000 7f4e19d9b640 1 -- 172.21.15.6:0/1065257277 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 557976392 0 0) 0x7f4e04001a80 con 0x7f4e1c0cba60 2024-05-04T01:02:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.533+0000 7f4e19d9b640 1 -- 172.21.15.6:0/1065257277 >> v1:172.21.15.6:6789/0 conn(0x7f4e1c0cba60 legacy=0x7f4e1c15d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.533+0000 7f4e19d9b640 1 --2- 172.21.15.6:0/1065257277 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4e1c0ca380 0x7f4e08003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.533+0000 7f4e19d9b640 1 --2- 172.21.15.6:0/1065257277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e08004060 0x7f4e08004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.533+0000 7f4e19d9b640 1 --2- 172.21.15.6:0/1065257277 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e08004e20 0x7f4e0800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.533+0000 7f4e19d9b640 1 -- 172.21.15.6:0/1065257277 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4e08005660 con 0x7f4e08004060 2024-05-04T01:02:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.533+0000 7f4e19d9b640 1 -- 172.21.15.6:0/1065257277 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0800bf10 con 0x7f4e08004e20 2024-05-04T01:02:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.533+0000 7f4e19d9b640 1 -- 172.21.15.6:0/1065257277 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0800c110 con 0x7f4e1c0ca380 2024-05-04T01:02:43.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.537+0000 7f4e1a59c640 1 --2- 172.21.15.6:0/1065257277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e08004060 0x7f4e08004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:43.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.541+0000 7f4e1b59e640 1 --2- 172.21.15.6:0/1065257277 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e08004e20 0x7f4e0800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:43.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.541+0000 7f4e1a59c640 1 -- 172.21.15.6:0/1065257277 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4e1c0ca380 msgr2=0x7f4e08003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:43.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.541+0000 7f4e1a59c640 1 --2- 172.21.15.6:0/1065257277 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4e1c0ca380 0x7f4e08003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:43.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.541+0000 7f4e1a59c640 1 -- 172.21.15.6:0/1065257277 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e08004e20 msgr2=0x7f4e0800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:43.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.541+0000 7f4e1a59c640 1 --2- 172.21.15.6:0/1065257277 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e08004e20 0x7f4e0800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:43.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.541+0000 7f4e1a59c640 1 -- 172.21.15.6:0/1065257277 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e08003530 con 0x7f4e08004060 2024-05-04T01:02:43.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.545+0000 7f4e1a59c640 1 --2- 172.21.15.6:0/1065257277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e08004060 0x7f4e08004810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c0745b0 tx=0x7f4e0401d1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4048c1f7d07f929 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:43.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.549+0000 7f4e19d9b640 1 -- 172.21.15.6:0/1065257277 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0400a3d0 con 0x7f4e08004060 2024-05-04T01:02:43.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.549+0000 7f4e19d9b640 1 -- 172.21.15.6:0/1065257277 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e040ad650 con 0x7f4e08004060 2024-05-04T01:02:43.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.549+0000 7f4e19d9b640 1 -- 172.21.15.6:0/1065257277 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e040ada40 con 0x7f4e08004060 2024-05-04T01:02:43.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.549+0000 7f4e211f7640 1 -- 172.21.15.6:0/1065257277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e08004060 msgr2=0x7f4e08004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:43.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.549+0000 7f4e211f7640 1 --2- 172.21.15.6:0/1065257277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e08004060 0x7f4e08004810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c0745b0 tx=0x7f4e0401d1e0 comp rx=0 tx=0).stop 2024-05-04T01:02:43.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.549+0000 7f4e1b59e640 1 -- 172.21.15.6:0/1065257277 reap_dead start 2024-05-04T01:02:43.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.549+0000 7f4e211f7640 1 -- 172.21.15.6:0/1065257277 shutdown_connections 2024-05-04T01:02:43.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.549+0000 7f4e211f7640 1 -- 172.21.15.6:0/1065257277 >> 172.21.15.6:0/1065257277 conn(0x7f4e1c0cfb10 msgr2=0x7f4e1c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:43.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.549+0000 7f4e211f7640 1 -- 172.21.15.6:0/1065257277 shutdown_connections 2024-05-04T01:02:43.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.549+0000 7f4e211f7640 1 -- 172.21.15.6:0/1065257277 wait complete. 2024-05-04T01:02:43.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.553+0000 7f4e211f7640 1 Processor -- start 2024-05-04T01:02:43.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.553+0000 7f4e211f7640 1 -- start start 2024-05-04T01:02:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.553+0000 7f4e211f7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e08004060 0x7f4e1c1f9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.553+0000 7f4e211f7640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4e1c0c8cd0 0x7f4e1c1596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.553+0000 7f4e211f7640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e1c14ac00 0x7f4e1c14b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.553+0000 7f4e211f7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c166000 con 0x7f4e08004060 2024-05-04T01:02:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.553+0000 7f4e211f7640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c071c20 con 0x7f4e1c14ac00 2024-05-04T01:02:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.553+0000 7f4e211f7640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f4e1c166180 con 0x7f4e1c0c8cd0 2024-05-04T01:02:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.557+0000 7f4e1ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e08004060 0x7f4e1c1f9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.557+0000 7f4e1ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e08004060 0x7f4e1c1f9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50870/0 (socket says 172.21.15.6:50870) 2024-05-04T01:02:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.557+0000 7f4e1ad9d640 1 -- 172.21.15.6:0/4018219469 learned_addr learned my addr 172.21.15.6:0/4018219469 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.557+0000 7f4e1b59e640 1 --2- 172.21.15.6:0/4018219469 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e1c14ac00 0x7f4e1c14b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.557+0000 7f4e1a59c640 1 --2- 172.21.15.6:0/4018219469 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4e1c0c8cd0 0x7f4e1c1596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.561+0000 7f4e1ad9d640 1 -- 172.21.15.6:0/4018219469 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4e1c0c8cd0 msgr2=0x7f4e1c1596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.561+0000 7f4e1ad9d640 1 --2- 172.21.15.6:0/4018219469 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4e1c0c8cd0 0x7f4e1c1596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.561+0000 7f4e1ad9d640 1 -- 172.21.15.6:0/4018219469 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e1c14ac00 msgr2=0x7f4e1c14b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.561+0000 7f4e1ad9d640 1 --2- 172.21.15.6:0/4018219469 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e1c14ac00 0x7f4e1c14b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.561+0000 7f4e1ad9d640 1 -- 172.21.15.6:0/4018219469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e1c1f9940 con 0x7f4e08004060 2024-05-04T01:02:43.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.565+0000 7f4e1ad9d640 1 --2- 172.21.15.6:0/4018219469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e08004060 0x7f4e1c1f9400 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00e7d0 tx=0x7f4e0c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:43.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.573+0000 7f4e137fe640 1 -- 172.21.15.6:0/4018219469 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c017070 con 0x7f4e08004060 2024-05-04T01:02:43.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.573+0000 7f4e137fe640 1 -- 172.21.15.6:0/4018219469 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e0c00c940 con 0x7f4e08004060 2024-05-04T01:02:43.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.573+0000 7f4e137fe640 1 -- 172.21.15.6:0/4018219469 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c00cd10 con 0x7f4e08004060 2024-05-04T01:02:43.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.573+0000 7f4e211f7640 1 -- 172.21.15.6:0/4018219469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e1c15a0b0 con 0x7f4e08004060 2024-05-04T01:02:43.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.573+0000 7f4e211f7640 1 -- 172.21.15.6:0/4018219469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e1c15a630 con 0x7f4e08004060 2024-05-04T01:02:43.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.573+0000 7f4e211f7640 1 -- 172.21.15.6:0/4018219469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4e1c069a50 con 0x7f4e08004060 2024-05-04T01:02:43.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.609+0000 7f4e137fe640 1 -- 172.21.15.6:0/4018219469 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4e0c01a070 con 0x7f4e08004060 2024-05-04T01:02:43.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.609+0000 7f4e137fe640 1 --2- 172.21.15.6:0/4018219469 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f4dfc06f450 0x7f4dfc071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:43.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.609+0000 7f4e1a59c640 1 --2- 172.21.15.6:0/4018219469 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f4dfc06f450 0x7f4dfc071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:43.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.609+0000 7f4e1a59c640 1 --2- 172.21.15.6:0/4018219469 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f4dfc06f450 0x7f4dfc071960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c0745b0 tx=0x7f4e1c0caa90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:43.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.617+0000 7f4e137fe640 1 -- 172.21.15.6:0/4018219469 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f4e0c0583b0 con 0x7f4e08004060 2024-05-04T01:02:43.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.617+0000 7f4e137fe640 1 --2- 172.21.15.6:0/4018219469 >> [v2:172.21.15.6:6800/3099957279,v1:172.21.15.6:6802/3099957279] conn(0x7f4dfc0776a0 0x7f4dfc079b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:43.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.617+0000 7f4e137fe640 1 -- 172.21.15.6:0/4018219469 --> [v2:172.21.15.6:6800/3099957279,v1:172.21.15.6:6802/3099957279] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e0c016ec0 con 0x7f4dfc0776a0 2024-05-04T01:02:43.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.617+0000 7f4e137fe640 1 -- 172.21.15.6:0/4018219469 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4e0c058770 con 0x7f4e08004060 2024-05-04T01:02:43.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.617+0000 7f4e1b59e640 1 --2- 172.21.15.6:0/4018219469 >> [v2:172.21.15.6:6800/3099957279,v1:172.21.15.6:6802/3099957279] conn(0x7f4dfc0776a0 0x7f4dfc079b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:43.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.617+0000 7f4e1b59e640 1 --2- 172.21.15.6:0/4018219469 >> [v2:172.21.15.6:6800/3099957279,v1:172.21.15.6:6802/3099957279] conn(0x7f4dfc0776a0 0x7f4dfc079b10 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:43.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.617+0000 7f4e137fe640 1 -- 172.21.15.6:0/4018219469 <== osd.1 v2:172.21.15.6:6800/3099957279 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4e0c016ec0 con 0x7f4dfc0776a0 2024-05-04T01:02:43.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.637+0000 7f4e211f7640 1 -- 172.21.15.6:0/4018219469 --> [v2:172.21.15.6:6800/3099957279,v1:172.21.15.6:6802/3099957279] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4e1c0cb630 con 0x7f4dfc0776a0 2024-05-04T01:02:43.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.637+0000 7f4e137fe640 1 -- 172.21.15.6:0/4018219469 <== osd.1 v2:172.21.15.6:6800/3099957279 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4e1c0cb630 con 0x7f4dfc0776a0 2024-05-04T01:02:43.639 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-04T01:02:43.639 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T01:02:43.639 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-04T01:02:43.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.637+0000 7f4e211f7640 1 -- 172.21.15.6:0/4018219469 >> [v2:172.21.15.6:6800/3099957279,v1:172.21.15.6:6802/3099957279] conn(0x7f4dfc0776a0 msgr2=0x7f4dfc079b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:43.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.637+0000 7f4e211f7640 1 --2- 172.21.15.6:0/4018219469 >> [v2:172.21.15.6:6800/3099957279,v1:172.21.15.6:6802/3099957279] conn(0x7f4dfc0776a0 0x7f4dfc079b10 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:43.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.637+0000 7f4e211f7640 1 -- 172.21.15.6:0/4018219469 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f4dfc06f450 msgr2=0x7f4dfc071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:43.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.637+0000 7f4e211f7640 1 --2- 172.21.15.6:0/4018219469 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f4dfc06f450 0x7f4dfc071960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c0745b0 tx=0x7f4e1c0caa90 comp rx=0 tx=0).stop 2024-05-04T01:02:43.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.637+0000 7f4e211f7640 1 -- 172.21.15.6:0/4018219469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e08004060 msgr2=0x7f4e1c1f9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:43.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.637+0000 7f4e211f7640 1 --2- 172.21.15.6:0/4018219469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e08004060 0x7f4e1c1f9400 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00e7d0 tx=0x7f4e0c00ec90 comp rx=0 tx=0).stop 2024-05-04T01:02:43.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.637+0000 7f4e1b59e640 1 -- 172.21.15.6:0/4018219469 reap_dead start 2024-05-04T01:02:43.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.637+0000 7f4e211f7640 1 -- 172.21.15.6:0/4018219469 shutdown_connections 2024-05-04T01:02:43.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.637+0000 7f4e211f7640 1 -- 172.21.15.6:0/4018219469 >> 172.21.15.6:0/4018219469 conn(0x7f4e1c0cfb10 msgr2=0x7f4e1c151190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:43.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.637+0000 7f4e211f7640 1 -- 172.21.15.6:0/4018219469 shutdown_connections 2024-05-04T01:02:43.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.637+0000 7f4e211f7640 1 -- 172.21.15.6:0/4018219469 wait complete. 2024-05-04T01:02:43.665 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-04T01:02:43.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.821+0000 7f91d222e640 1 Processor -- start 2024-05-04T01:02:43.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.821+0000 7f91d222e640 1 -- start start 2024-05-04T01:02:43.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.821+0000 7f91d222e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f91cc0cb320 0x7f91cc1562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:43.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.821+0000 7f91d222e640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91cc0cba20 0x7f91cc0cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:43.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.821+0000 7f91d222e640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91cc1567f0 con 0x7f91cc15fb30 2024-05-04T01:02:43.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.821+0000 7f91d222e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f91cc15f6a0 con 0x7f91cc0cb320 2024-05-04T01:02:43.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.821+0000 7f91d222e640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f91cc0ca360 con 0x7f91cc0cba20 2024-05-04T01:02:43.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.821+0000 7f91cb7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f91cc0cb320 0x7f91cc1562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:43.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.825+0000 7f91cb7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f91cc0cb320 0x7f91cc1562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50880/0 (socket says 172.21.15.6:50880) 2024-05-04T01:02:43.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.825+0000 7f91cb7fe640 1 -- 172.21.15.6:0/578399121 learned_addr learned my addr 172.21.15.6:0/578399121 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:43.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.825+0000 7f91cbfff640 1 --2- 172.21.15.6:0/578399121 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91cc0cba20 0x7f91cc0cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:43.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.825+0000 7f91cb7fe640 1 -- 172.21.15.6:0/578399121 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91cc0cba20 msgr2=0x7f91cc0cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:43.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.825+0000 7f91cb7fe640 1 --2- 172.21.15.6:0/578399121 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91cc0cba20 0x7f91cc0cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:43.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.825+0000 7f91cb7fe640 1 -- 172.21.15.6:0/578399121 >> v1:172.21.15.163:6789/0 conn(0x7f91cc15fb30 legacy=0x7f91cc15ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:43.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.825+0000 7f91cb7fe640 1 -- 172.21.15.6:0/578399121 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91cc0ca640 con 0x7f91cc0cb320 2024-05-04T01:02:43.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.829+0000 7f91cb7fe640 1 --2- 172.21.15.6:0/578399121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91cc0cb320 0x7f91cc1562b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009870 tx=0x7f91bc01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b308b2d73424a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:43.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.837+0000 7f91ca7fc640 1 -- 172.21.15.6:0/578399121 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc0b5070 con 0x7f91cc0cb320 2024-05-04T01:02:43.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.837+0000 7f91ca7fc640 1 -- 172.21.15.6:0/578399121 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91bc0a8a50 con 0x7f91cc0cb320 2024-05-04T01:02:43.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.837+0000 7f91ca7fc640 1 -- 172.21.15.6:0/578399121 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc0a8e20 con 0x7f91cc0cb320 2024-05-04T01:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.837+0000 7f91d222e640 1 -- 172.21.15.6:0/578399121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91cc0cb320 msgr2=0x7f91cc1562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.837+0000 7f91d222e640 1 --2- 172.21.15.6:0/578399121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91cc0cb320 0x7f91cc1562b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009870 tx=0x7f91bc01ed50 comp rx=0 tx=0).stop 2024-05-04T01:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.837+0000 7f91d222e640 1 -- 172.21.15.6:0/578399121 shutdown_connections 2024-05-04T01:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.837+0000 7f91d222e640 1 --2- 172.21.15.6:0/578399121 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91cc0cba20 0x7f91cc0cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.837+0000 7f91d222e640 1 --2- 172.21.15.6:0/578399121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91cc0cb320 0x7f91cc1562b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.837+0000 7f91d222e640 1 -- 172.21.15.6:0/578399121 >> 172.21.15.6:0/578399121 conn(0x7f91cc06e990 msgr2=0x7f91cc06eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.837+0000 7f91d222e640 1 -- 172.21.15.6:0/578399121 shutdown_connections 2024-05-04T01:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.837+0000 7f91d222e640 1 -- 172.21.15.6:0/578399121 wait complete. 2024-05-04T01:02:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.837+0000 7f91d222e640 1 Processor -- start 2024-05-04T01:02:43.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.837+0000 7f91d222e640 1 -- start start 2024-05-04T01:02:43.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.841+0000 7f91d222e640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91cc0cb320 0x7f91cc15d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:43.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.841+0000 7f91d222e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91cc0cba20 0x7f91cc145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:43.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.841+0000 7f91d222e640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91cc15fb30 0x7f91cc13cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:43.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.841+0000 7f91d222e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc0cc370 con 0x7f91cc0cba20 2024-05-04T01:02:43.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.841+0000 7f91d222e640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc15ceb0 con 0x7f91cc15fb30 2024-05-04T01:02:43.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.841+0000 7f91d222e640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f91cc0cc4f0 con 0x7f91cc0cb320 2024-05-04T01:02:43.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.841+0000 7f91caffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91cc0cba20 0x7f91cc145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:43.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.841+0000 7f91caffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91cc0cba20 0x7f91cc145930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50894/0 (socket says 172.21.15.6:50894) 2024-05-04T01:02:43.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.841+0000 7f91caffd640 1 -- 172.21.15.6:0/864367323 learned_addr learned my addr 172.21.15.6:0/864367323 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:43.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.841+0000 7f91cb7fe640 1 --2- 172.21.15.6:0/864367323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91cc0cb320 0x7f91cc15d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:43.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.841+0000 7f91cbfff640 1 --2- 172.21.15.6:0/864367323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91cc15fb30 0x7f91cc13cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:43.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.845+0000 7f91caffd640 1 -- 172.21.15.6:0/864367323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91cc0cb320 msgr2=0x7f91cc15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:43.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.845+0000 7f91caffd640 1 --2- 172.21.15.6:0/864367323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91cc0cb320 0x7f91cc15d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:43.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.845+0000 7f91caffd640 1 -- 172.21.15.6:0/864367323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91cc15fb30 msgr2=0x7f91cc13cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:43.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.845+0000 7f91caffd640 1 --2- 172.21.15.6:0/864367323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91cc15fb30 0x7f91cc13cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:43.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.845+0000 7f91caffd640 1 -- 172.21.15.6:0/864367323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91cc0c65d0 con 0x7f91cc0cba20 2024-05-04T01:02:43.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.849+0000 7f91caffd640 1 --2- 172.21.15.6:0/864367323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91cc0cba20 0x7f91cc145930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f91c000c450 tx=0x7f91c000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:43.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.853+0000 7f91b3fff640 1 -- 172.21.15.6:0/864367323 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c00052d0 con 0x7f91cc0cba20 2024-05-04T01:02:43.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.853+0000 7f91b3fff640 1 -- 172.21.15.6:0/864367323 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c0005470 con 0x7f91cc0cba20 2024-05-04T01:02:43.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.853+0000 7f91b3fff640 1 -- 172.21.15.6:0/864367323 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0012850 con 0x7f91cc0cba20 2024-05-04T01:02:43.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.853+0000 7f91d222e640 1 -- 172.21.15.6:0/864367323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91cc0ce040 con 0x7f91cc0cba20 2024-05-04T01:02:43.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.853+0000 7f91d222e640 1 -- 172.21.15.6:0/864367323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91cc0ce600 con 0x7f91cc0cba20 2024-05-04T01:02:43.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:43.853+0000 7f91d222e640 1 -- 172.21.15.6:0/864367323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91cc06a390 con 0x7f91cc0cba20 2024-05-04T01:02:44.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.245+0000 7f91b3fff640 1 -- 172.21.15.6:0/864367323 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f91c00129f0 con 0x7f91cc0cba20 2024-05-04T01:02:44.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.245+0000 7f91b3fff640 1 --2- 172.21.15.6:0/864367323 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f91b806f480 0x7f91b8071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:44.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.245+0000 7f91cb7fe640 1 --2- 172.21.15.6:0/864367323 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f91b806f480 0x7f91b8071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:44.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.245+0000 7f91cb7fe640 1 --2- 172.21.15.6:0/864367323 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f91b806f480 0x7f91b8071990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0b2000 tx=0x7f91bc0aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:44.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.285+0000 7f91b3fff640 1 -- 172.21.15.6:0/864367323 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f91c0012ce0 con 0x7f91cc0cba20 2024-05-04T01:02:44.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.301+0000 7f91b3fff640 1 -- 172.21.15.6:0/864367323 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f91c005c0e0 con 0x7f91cc0cba20 2024-05-04T01:02:44.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.481+0000 7f91d222e640 1 -- 172.21.15.6:0/864367323 --> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f91cc06f060 con 0x7f91b806f480 2024-05-04T01:02:44.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.481+0000 7f91b3fff640 1 -- 172.21.15.6:0/864367323 <== mgr.4103 v2:172.21.15.163:6800/2152694980 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f91cc06f060 con 0x7f91b806f480 2024-05-04T01:02:44.484 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 1 to deep-scrub 2024-05-04T01:02:44.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.485+0000 7f91d222e640 1 -- 172.21.15.6:0/864367323 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f91b806f480 msgr2=0x7f91b8071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:44.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.485+0000 7f91d222e640 1 --2- 172.21.15.6:0/864367323 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f91b806f480 0x7f91b8071990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0b2000 tx=0x7f91bc0aa070 comp rx=0 tx=0).stop 2024-05-04T01:02:44.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.485+0000 7f91d222e640 1 -- 172.21.15.6:0/864367323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91cc0cba20 msgr2=0x7f91cc145930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:44.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.485+0000 7f91d222e640 1 --2- 172.21.15.6:0/864367323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91cc0cba20 0x7f91cc145930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f91c000c450 tx=0x7f91c000c910 comp rx=0 tx=0).stop 2024-05-04T01:02:44.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.485+0000 7f91d222e640 1 -- 172.21.15.6:0/864367323 shutdown_connections 2024-05-04T01:02:44.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.485+0000 7f91d222e640 1 --2- 172.21.15.6:0/864367323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91cc15fb30 0x7f91cc13cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:44.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.485+0000 7f91d222e640 1 --2- 172.21.15.6:0/864367323 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f91b806f480 0x7f91b8071990 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:44.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.485+0000 7f91d222e640 1 --2- 172.21.15.6:0/864367323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91cc0cba20 0x7f91cc145930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:44.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.485+0000 7f91d222e640 1 --2- 172.21.15.6:0/864367323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91cc0cb320 0x7f91cc15d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:44.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.485+0000 7f91d222e640 1 -- 172.21.15.6:0/864367323 >> 172.21.15.6:0/864367323 conn(0x7f91cc06e990 msgr2=0x7f91cc148f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:44.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.485+0000 7f91d222e640 1 -- 172.21.15.6:0/864367323 shutdown_connections 2024-05-04T01:02:44.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.485+0000 7f91d222e640 1 -- 172.21.15.6:0/864367323 wait complete. 2024-05-04T01:02:44.509 INFO:tasks.ceph:Scrubbing osd.2 2024-05-04T01:02:44.510 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-04T01:02:44.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.661+0000 7f1a55308640 1 Processor -- start 2024-05-04T01:02:44.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.661+0000 7f1a55308640 1 -- start start 2024-05-04T01:02:44.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.665+0000 7f1a55308640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1a500cd090 0x7f1a500cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:44.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.665+0000 7f1a55308640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a5015c4d0 con 0x7f1a50160430 2024-05-04T01:02:44.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.665+0000 7f1a55308640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a5015c7b0 con 0x7f1a500cc2c0 2024-05-04T01:02:44.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.665+0000 7f1a55308640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f1a50156920 con 0x7f1a500cd090 2024-05-04T01:02:44.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.665+0000 7f1a4effd640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1a500cd090 0x7f1a500cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:44.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.665+0000 7f1a4e7fc640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f1a500cc2c0 0x7f1a5015fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:49670/0 (socket says 172.21.15.6:49670) 2024-05-04T01:02:44.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.665+0000 7f1a4e7fc640 1 -- 172.21.15.6:0/1026305372 learned_addr learned my addr 172.21.15.6:0/1026305372 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T01:02:44.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.677+0000 7f1a4effd640 1 -- 172.21.15.6:0/1026305372 >> v1:172.21.15.163:6789/0 conn(0x7f1a500cc2c0 legacy=0x7f1a5015fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:44.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.677+0000 7f1a4effd640 1 -- 172.21.15.6:0/1026305372 >> v1:172.21.15.6:6789/0 conn(0x7f1a50160430 legacy=0x7f1a50166af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:44.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.677+0000 7f1a4effd640 1 -- 172.21.15.6:0/1026305372 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a5015ca90 con 0x7f1a500cd090 2024-05-04T01:02:44.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.689+0000 7f1a4effd640 1 --2- 172.21.15.6:0/1026305372 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a500cd090 0x7f1a500cd4a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1a400097f0 tx=0x7f1a4001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7be03fa58f91f93 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:44.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.829+0000 7f1a4dffb640 1 -- 172.21.15.6:0/1026305372 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a400b0070 con 0x7f1a500cd090 2024-05-04T01:02:44.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.829+0000 7f1a4dffb640 1 -- 172.21.15.6:0/1026305372 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a400ab600 con 0x7f1a500cd090 2024-05-04T01:02:44.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.829+0000 7f1a4dffb640 1 -- 172.21.15.6:0/1026305372 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a400ab9d0 con 0x7f1a500cd090 2024-05-04T01:02:44.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.829+0000 7f1a55308640 1 -- 172.21.15.6:0/1026305372 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a500cd090 msgr2=0x7f1a500cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:44.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.829+0000 7f1a55308640 1 --2- 172.21.15.6:0/1026305372 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a500cd090 0x7f1a500cd4a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1a400097f0 tx=0x7f1a4001c410 comp rx=0 tx=0).stop 2024-05-04T01:02:44.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.829+0000 7f1a55308640 1 -- 172.21.15.6:0/1026305372 shutdown_connections 2024-05-04T01:02:44.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.829+0000 7f1a55308640 1 --2- 172.21.15.6:0/1026305372 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a500cd090 0x7f1a500cd4a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:44.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.829+0000 7f1a55308640 1 -- 172.21.15.6:0/1026305372 >> 172.21.15.6:0/1026305372 conn(0x7f1a5006c780 msgr2=0x7f1a5006cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:44.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.829+0000 7f1a55308640 1 -- 172.21.15.6:0/1026305372 shutdown_connections 2024-05-04T01:02:44.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.829+0000 7f1a55308640 1 -- 172.21.15.6:0/1026305372 wait complete. 2024-05-04T01:02:44.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.837+0000 7f1a55308640 1 Processor -- start 2024-05-04T01:02:44.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.837+0000 7f1a55308640 1 -- start start 2024-05-04T01:02:44.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.837+0000 7f1a55308640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a500cc2c0 0x7f1a501f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:44.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.837+0000 7f1a55308640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a500cd090 0x7f1a5014f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:44.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.837+0000 7f1a55308640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a50157510 0x7f1a50152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:44.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.837+0000 7f1a55308640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1a500cdc40 con 0x7f1a500cc2c0 2024-05-04T01:02:44.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.837+0000 7f1a55308640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5015c170 con 0x7f1a50157510 2024-05-04T01:02:44.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.837+0000 7f1a55308640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f1a500cddc0 con 0x7f1a500cd090 2024-05-04T01:02:44.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.841+0000 7f1a4effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a500cc2c0 0x7f1a501f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:44.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.841+0000 7f1a4e7fc640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a500cd090 0x7f1a5014f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:44.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.841+0000 7f1a4e7fc640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a500cd090 0x7f1a5014f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38744/0 (socket says 172.21.15.6:38744) 2024-05-04T01:02:44.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.841+0000 7f1a4e7fc640 1 -- 172.21.15.6:0/2176984638 learned_addr learned my addr 172.21.15.6:0/2176984638 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:44.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.845+0000 7f1a4f7fe640 1 --2- 172.21.15.6:0/2176984638 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a50157510 0x7f1a50152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:44.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.845+0000 7f1a4e7fc640 1 -- 172.21.15.6:0/2176984638 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a50157510 msgr2=0x7f1a50152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:44.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.845+0000 7f1a4e7fc640 1 --2- 172.21.15.6:0/2176984638 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a50157510 0x7f1a50152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:44.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.845+0000 7f1a4e7fc640 1 -- 172.21.15.6:0/2176984638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a500cc2c0 msgr2=0x7f1a501f5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:44.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.845+0000 7f1a4e7fc640 1 --2- 172.21.15.6:0/2176984638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a500cc2c0 0x7f1a501f5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:44.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.845+0000 7f1a4e7fc640 1 -- 172.21.15.6:0/2176984638 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a50158f70 con 0x7f1a500cd090 2024-05-04T01:02:44.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.849+0000 7f1a4e7fc640 1 --2- 172.21.15.6:0/2176984638 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a500cd090 0x7f1a5014f420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400c400 tx=0x7f1a4400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:44.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.853+0000 7f1a377fe640 1 -- 172.21.15.6:0/2176984638 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44017070 con 0x7f1a500cd090 2024-05-04T01:02:44.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.853+0000 7f1a377fe640 1 -- 172.21.15.6:0/2176984638 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a44005d10 con 0x7f1a500cd090 2024-05-04T01:02:44.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.853+0000 7f1a55308640 1 -- 172.21.15.6:0/2176984638 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a501f93f0 con 0x7f1a500cd090 2024-05-04T01:02:44.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.853+0000 7f1a377fe640 1 -- 172.21.15.6:0/2176984638 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44007310 con 0x7f1a500cd090 2024-05-04T01:02:44.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.853+0000 7f1a55308640 1 -- 172.21.15.6:0/2176984638 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a501f99b0 con 0x7f1a500cd090 2024-05-04T01:02:44.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.853+0000 7f1a55308640 1 -- 172.21.15.6:0/2176984638 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1a501f9d90 con 0x7f1a500cd090 2024-05-04T01:02:44.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.913+0000 7f1a377fe640 1 -- 172.21.15.6:0/2176984638 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1a4401a070 con 0x7f1a500cd090 2024-05-04T01:02:44.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.913+0000 7f1a377fe640 1 --2- 172.21.15.6:0/2176984638 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1a3c06f450 0x7f1a3c071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:44.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.913+0000 7f1a4effd640 1 --2- 172.21.15.6:0/2176984638 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1a3c06f450 0x7f1a3c071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:44.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.913+0000 7f1a4effd640 1 --2- 172.21.15.6:0/2176984638 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1a3c06f450 0x7f1a3c071960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1a400ad000 tx=0x7f1a40008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:44.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.917+0000 7f1a377fe640 1 -- 172.21.15.6:0/2176984638 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f1a440577f0 con 0x7f1a500cd090 2024-05-04T01:02:44.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.917+0000 7f1a377fe640 1 --2- 172.21.15.6:0/2176984638 >> [v2:172.21.15.6:6801/2770857903,v1:172.21.15.6:6806/2770857903] conn(0x7f1a3c0776a0 0x7f1a3c079b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:44.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.917+0000 7f1a377fe640 1 -- 172.21.15.6:0/2176984638 --> [v2:172.21.15.6:6801/2770857903,v1:172.21.15.6:6806/2770857903] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a4401dec0 con 0x7f1a3c0776a0 2024-05-04T01:02:44.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.917+0000 7f1a4f7fe640 1 --2- 172.21.15.6:0/2176984638 >> [v2:172.21.15.6:6801/2770857903,v1:172.21.15.6:6806/2770857903] conn(0x7f1a3c0776a0 0x7f1a3c079b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:44.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.921+0000 7f1a4f7fe640 1 --2- 172.21.15.6:0/2176984638 >> [v2:172.21.15.6:6801/2770857903,v1:172.21.15.6:6806/2770857903] conn(0x7f1a3c0776a0 0x7f1a3c079b10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.921+0000 7f1a377fe640 1 -- 172.21.15.6:0/2176984638 <== osd.2 v2:172.21.15.6:6801/2770857903 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1a4401dec0 con 0x7f1a3c0776a0 2024-05-04T01:02:44.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.933+0000 7f1a55308640 1 -- 172.21.15.6:0/2176984638 --> [v2:172.21.15.6:6801/2770857903,v1:172.21.15.6:6806/2770857903] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1a50158d20 con 0x7f1a3c0776a0 2024-05-04T01:02:44.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.937+0000 7f1a377fe640 1 -- 172.21.15.6:0/2176984638 <== osd.2 v2:172.21.15.6:6801/2770857903 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1a50158d20 con 0x7f1a3c0776a0 2024-05-04T01:02:44.938 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-04T01:02:44.939 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T01:02:44.939 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-04T01:02:44.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.937+0000 7f1a55308640 1 -- 172.21.15.6:0/2176984638 >> [v2:172.21.15.6:6801/2770857903,v1:172.21.15.6:6806/2770857903] conn(0x7f1a3c0776a0 msgr2=0x7f1a3c079b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:44.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.937+0000 7f1a55308640 1 --2- 172.21.15.6:0/2176984638 >> [v2:172.21.15.6:6801/2770857903,v1:172.21.15.6:6806/2770857903] conn(0x7f1a3c0776a0 0x7f1a3c079b10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:44.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.937+0000 7f1a55308640 1 -- 172.21.15.6:0/2176984638 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1a3c06f450 msgr2=0x7f1a3c071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:44.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.937+0000 7f1a55308640 1 --2- 172.21.15.6:0/2176984638 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1a3c06f450 0x7f1a3c071960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1a400ad000 tx=0x7f1a40008040 comp rx=0 tx=0).stop 2024-05-04T01:02:44.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.937+0000 7f1a55308640 1 -- 172.21.15.6:0/2176984638 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a500cd090 msgr2=0x7f1a5014f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:44.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.937+0000 7f1a55308640 1 --2- 172.21.15.6:0/2176984638 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a500cd090 0x7f1a5014f420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400c400 tx=0x7f1a4400c8c0 comp rx=0 tx=0).stop 2024-05-04T01:02:44.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.937+0000 7f1a4f7fe640 1 -- 172.21.15.6:0/2176984638 reap_dead start 2024-05-04T01:02:44.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.937+0000 7f1a55308640 1 -- 172.21.15.6:0/2176984638 shutdown_connections 2024-05-04T01:02:44.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.937+0000 7f1a55308640 1 -- 172.21.15.6:0/2176984638 >> 172.21.15.6:0/2176984638 conn(0x7f1a5006c780 msgr2=0x7f1a500ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:44.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.937+0000 7f1a55308640 1 -- 172.21.15.6:0/2176984638 shutdown_connections 2024-05-04T01:02:44.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:44.937+0000 7f1a55308640 1 -- 172.21.15.6:0/2176984638 wait complete. 2024-05-04T01:02:44.960 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-04T01:02:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.109+0000 7ff6c2294640 1 Processor -- start 2024-05-04T01:02:45.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.109+0000 7ff6c2294640 1 -- start start 2024-05-04T01:02:45.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.109+0000 7ff6c2294640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff6bc159780 0x7ff6bc152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:45.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.109+0000 7ff6c2294640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff6bc073cd0 0x7ff6bc163680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:45.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.109+0000 7ff6c2294640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6bc153420 con 0x7ff6bc0738c0 2024-05-04T01:02:45.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.109+0000 7ff6c2294640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff6bc0c6710 con 0x7ff6bc159780 2024-05-04T01:02:45.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.109+0000 7ff6c2294640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7ff6bc0ca420 con 0x7ff6bc073cd0 2024-05-04T01:02:45.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.109+0000 7ff6bbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff6bc159780 0x7ff6bc152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:45.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.113+0000 7ff6bb7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff6bc0738c0 0x7ff6bc0c45f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52044/0 (socket says 172.21.15.6:52044) 2024-05-04T01:02:45.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.113+0000 7ff6bb7fe640 1 -- 172.21.15.6:0/647814948 learned_addr learned my addr 172.21.15.6:0/647814948 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T01:02:45.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.113+0000 7ff6c0831640 1 --2- 172.21.15.6:0/647814948 >> v2:172.21.15.163:3300/0 conn(0x7ff6bc073cd0 0x7ff6bc163680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.117+0000 7ff6baffd640 1 -- 172.21.15.6:0/647814948 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1170352779 0 0) 0x7ff6bc153420 con 0x7ff6bc0738c0 2024-05-04T01:02:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.117+0000 7ff6baffd640 1 -- 172.21.15.6:0/647814948 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6a4003530 con 0x7ff6bc0738c0 2024-05-04T01:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.117+0000 7ff6bbfff640 1 -- 172.21.15.6:0/647814948 >> v2:172.21.15.163:3300/0 conn(0x7ff6bc073cd0 msgr2=0x7ff6bc163680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.117+0000 7ff6bbfff640 1 --2- 172.21.15.6:0/647814948 >> v2:172.21.15.163:3300/0 conn(0x7ff6bc073cd0 0x7ff6bc163680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.117+0000 7ff6bbfff640 1 -- 172.21.15.6:0/647814948 >> v1:172.21.15.6:6789/0 conn(0x7ff6bc0738c0 legacy=0x7ff6bc0c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.117+0000 7ff6bbfff640 1 -- 172.21.15.6:0/647814948 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6bc072bc0 con 0x7ff6bc159780 2024-05-04T01:02:45.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.125+0000 7ff6bbfff640 1 --2- 172.21.15.6:0/647814948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc159780 0x7ff6bc152ee0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc071900 tx=0x7ff6ac01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd054d0b9a2eb6e server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:45.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.137+0000 7ff6baffd640 1 -- 172.21.15.6:0/647814948 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac0ab650 con 0x7ff6bc159780 2024-05-04T01:02:45.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.137+0000 7ff6baffd640 1 -- 172.21.15.6:0/647814948 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6ac0b0070 con 0x7ff6bc159780 2024-05-04T01:02:45.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.137+0000 7ff6baffd640 1 -- 172.21.15.6:0/647814948 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac0aba10 con 0x7ff6bc159780 2024-05-04T01:02:45.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.141+0000 7ff6c2294640 1 -- 172.21.15.6:0/647814948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc159780 msgr2=0x7ff6bc152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:45.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.141+0000 7ff6c2294640 1 --2- 172.21.15.6:0/647814948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc159780 0x7ff6bc152ee0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc071900 tx=0x7ff6ac01c450 comp rx=0 tx=0).stop 2024-05-04T01:02:45.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.141+0000 7ff6c2294640 1 -- 172.21.15.6:0/647814948 shutdown_connections 2024-05-04T01:02:45.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.141+0000 7ff6c2294640 1 --2- 172.21.15.6:0/647814948 >> v2:172.21.15.163:3300/0 conn(0x7ff6bc073cd0 0x7ff6bc163680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:45.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.141+0000 7ff6c2294640 1 --2- 172.21.15.6:0/647814948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc159780 0x7ff6bc152ee0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:45.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.141+0000 7ff6c2294640 1 -- 172.21.15.6:0/647814948 >> 172.21.15.6:0/647814948 conn(0x7ff6bc06cf70 msgr2=0x7ff6bc0c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:45.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.141+0000 7ff6c2294640 1 -- 172.21.15.6:0/647814948 shutdown_connections 2024-05-04T01:02:45.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.141+0000 7ff6c2294640 1 -- 172.21.15.6:0/647814948 wait complete. 2024-05-04T01:02:45.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.141+0000 7ff6c2294640 1 Processor -- start 2024-05-04T01:02:45.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.141+0000 7ff6c2294640 1 -- start start 2024-05-04T01:02:45.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.145+0000 7ff6c2294640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc0738c0 0x7ff6bc1f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:45.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.145+0000 7ff6c2294640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6bc073cd0 0x7ff6bc14fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:45.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.145+0000 7ff6c2294640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6bc159780 0x7ff6bc15b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:45.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.145+0000 7ff6c2294640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc159b90 con 0x7ff6bc0738c0 2024-05-04T01:02:45.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.145+0000 7ff6c2294640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc0c6f20 con 0x7ff6bc159780 2024-05-04T01:02:45.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.145+0000 7ff6c2294640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7ff6bc0c7440 con 0x7ff6bc073cd0 2024-05-04T01:02:45.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.145+0000 7ff6bbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc0738c0 0x7ff6bc1f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:45.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.145+0000 7ff6bbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc0738c0 0x7ff6bc1f4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50918/0 (socket says 172.21.15.6:50918) 2024-05-04T01:02:45.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.145+0000 7ff6bbfff640 1 -- 172.21.15.6:0/3759585399 learned_addr learned my addr 172.21.15.6:0/3759585399 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:45.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.145+0000 7ff6bb7fe640 1 --2- 172.21.15.6:0/3759585399 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6bc073cd0 0x7ff6bc14fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:45.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.145+0000 7ff6c0831640 1 --2- 172.21.15.6:0/3759585399 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6bc159780 0x7ff6bc15b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:45.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.153+0000 7ff6bbfff640 1 -- 172.21.15.6:0/3759585399 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6bc073cd0 msgr2=0x7ff6bc14fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:45.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.153+0000 7ff6bbfff640 1 --2- 172.21.15.6:0/3759585399 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6bc073cd0 0x7ff6bc14fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:45.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.153+0000 7ff6bbfff640 1 -- 172.21.15.6:0/3759585399 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6bc159780 msgr2=0x7ff6bc15b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:45.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.153+0000 7ff6bbfff640 1 --2- 172.21.15.6:0/3759585399 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6bc159780 0x7ff6bc15b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:45.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.153+0000 7ff6bbfff640 1 -- 172.21.15.6:0/3759585399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6bc15c680 con 0x7ff6bc0738c0 2024-05-04T01:02:45.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.153+0000 7ff6bbfff640 1 --2- 172.21.15.6:0/3759585399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc0738c0 0x7ff6bc1f4e30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac0ad040 tx=0x7ff6ac01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:45.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.157+0000 7ff6b8ff9640 1 -- 172.21.15.6:0/3759585399 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac0bf410 con 0x7ff6bc0738c0 2024-05-04T01:02:45.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.157+0000 7ff6b8ff9640 1 -- 172.21.15.6:0/3759585399 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6ac0bf5d0 con 0x7ff6bc0738c0 2024-05-04T01:02:45.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.157+0000 7ff6c2294640 1 -- 172.21.15.6:0/3759585399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6bc15cc60 con 0x7ff6bc0738c0 2024-05-04T01:02:45.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.157+0000 7ff6b8ff9640 1 -- 172.21.15.6:0/3759585399 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac0bf9c0 con 0x7ff6bc0738c0 2024-05-04T01:02:45.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.157+0000 7ff6c2294640 1 -- 172.21.15.6:0/3759585399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6bc156290 con 0x7ff6bc0738c0 2024-05-04T01:02:45.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.161+0000 7ff6c2294640 1 -- 172.21.15.6:0/3759585399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6bc06a390 con 0x7ff6bc0738c0 2024-05-04T01:02:45.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.185+0000 7ff6b8ff9640 1 -- 172.21.15.6:0/3759585399 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff6ac0bd020 con 0x7ff6bc0738c0 2024-05-04T01:02:45.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.185+0000 7ff6b8ff9640 1 --2- 172.21.15.6:0/3759585399 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7ff6a806f450 0x7ff6a8071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:45.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.185+0000 7ff6bb7fe640 1 --2- 172.21.15.6:0/3759585399 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7ff6a806f450 0x7ff6a8071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:45.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.185+0000 7ff6bb7fe640 1 --2- 172.21.15.6:0/3759585399 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7ff6a806f450 0x7ff6a8071960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0007a70 tx=0x7ff6b00079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:45.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.241+0000 7ff6b8ff9640 1 -- 172.21.15.6:0/3759585399 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7ff6ac0f2c80 con 0x7ff6bc0738c0 2024-05-04T01:02:45.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.513+0000 7ff6b8ff9640 1 -- 172.21.15.6:0/3759585399 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff6ac016070 con 0x7ff6bc0738c0 2024-05-04T01:02:45.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.689+0000 7ff6c2294640 1 -- 172.21.15.6:0/3759585399 --> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7ff6bc1560d0 con 0x7ff6a806f450 2024-05-04T01:02:45.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.693+0000 7ff6b8ff9640 1 -- 172.21.15.6:0/3759585399 <== mgr.4103 v2:172.21.15.163:6800/2152694980 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff6b00058c0 con 0x7ff6a806f450 2024-05-04T01:02:45.694 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 2 to deep-scrub 2024-05-04T01:02:45.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.693+0000 7ff6c2294640 1 -- 172.21.15.6:0/3759585399 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7ff6a806f450 msgr2=0x7ff6a8071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:45.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.693+0000 7ff6c2294640 1 --2- 172.21.15.6:0/3759585399 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7ff6a806f450 0x7ff6a8071960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0007a70 tx=0x7ff6b00079c0 comp rx=0 tx=0).stop 2024-05-04T01:02:45.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.693+0000 7ff6c2294640 1 -- 172.21.15.6:0/3759585399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc0738c0 msgr2=0x7ff6bc1f4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:45.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.693+0000 7ff6c2294640 1 --2- 172.21.15.6:0/3759585399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc0738c0 0x7ff6bc1f4e30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac0ad040 tx=0x7ff6ac01ac90 comp rx=0 tx=0).stop 2024-05-04T01:02:45.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.693+0000 7ff6c2294640 1 -- 172.21.15.6:0/3759585399 shutdown_connections 2024-05-04T01:02:45.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.693+0000 7ff6c2294640 1 --2- 172.21.15.6:0/3759585399 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6bc159780 0x7ff6bc15b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:45.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.693+0000 7ff6c2294640 1 --2- 172.21.15.6:0/3759585399 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7ff6a806f450 0x7ff6a8071960 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:45.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.693+0000 7ff6c2294640 1 --2- 172.21.15.6:0/3759585399 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6bc073cd0 0x7ff6bc14fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:45.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.693+0000 7ff6c2294640 1 --2- 172.21.15.6:0/3759585399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc0738c0 0x7ff6bc1f4e30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:45.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.693+0000 7ff6c2294640 1 -- 172.21.15.6:0/3759585399 >> 172.21.15.6:0/3759585399 conn(0x7ff6bc06cf70 msgr2=0x7ff6bc151eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:45.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.693+0000 7ff6c2294640 1 -- 172.21.15.6:0/3759585399 shutdown_connections 2024-05-04T01:02:45.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.693+0000 7ff6c2294640 1 -- 172.21.15.6:0/3759585399 wait complete. 2024-05-04T01:02:45.719 INFO:tasks.ceph:Scrubbing osd.3 2024-05-04T01:02:45.719 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-04T01:02:45.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.877+0000 7f0fde7dc640 1 Processor -- start 2024-05-04T01:02:45.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.877+0000 7f0fde7dc640 1 -- start start 2024-05-04T01:02:45.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.877+0000 7f0fde7dc640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0fd815cce0 0x7f0fd806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:45.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.877+0000 7f0fde7dc640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fd80c96f0 con 0x7f0fd80c92e0 2024-05-04T01:02:45.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.877+0000 7f0fde7dc640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fd815d1d0 con 0x7f0fd8074360 2024-05-04T01:02:45.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.877+0000 7f0fde7dc640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f0fd806c820 con 0x7f0fd815cce0 2024-05-04T01:02:45.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.881+0000 7f0fcffff640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f0fd8074360 0x7f0fd8063450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:49672/0 (socket says 172.21.15.6:49672) 2024-05-04T01:02:45.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.881+0000 7f0fcffff640 1 -- 172.21.15.6:0/2223590338 learned_addr learned my addr 172.21.15.6:0/2223590338 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T01:02:45.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.881+0000 7f0fd7fff640 1 --2- 172.21.15.6:0/2223590338 >> v2:172.21.15.163:3300/0 conn(0x7f0fd815cce0 0x7f0fd806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:45.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.889+0000 7f0fd7fff640 1 -- 172.21.15.6:0/2223590338 >> v1:172.21.15.163:6789/0 conn(0x7f0fd8074360 legacy=0x7f0fd8063450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:45.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.889+0000 7f0fd7fff640 1 -- 172.21.15.6:0/2223590338 >> v1:172.21.15.6:6789/0 conn(0x7f0fd80c92e0 legacy=0x7f0fd8155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:45.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.889+0000 7f0fd7fff640 1 -- 172.21.15.6:0/2223590338 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd806cb00 con 0x7f0fd815cce0 2024-05-04T01:02:45.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.901+0000 7f0fd7fff640 1 --2- 172.21.15.6:0/2223590338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0fd815cce0 0x7f0fd806d8c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80097c0 tx=0x7f0fc801c2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15ef5490cf74fd11 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:45.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.909+0000 7f0fd77fe640 1 -- 172.21.15.6:0/2223590338 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc80b0070 con 0x7f0fd815cce0 2024-05-04T01:02:45.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.909+0000 7f0fd77fe640 1 -- 172.21.15.6:0/2223590338 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fc80ab600 con 0x7f0fd815cce0 2024-05-04T01:02:45.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.909+0000 7f0fd77fe640 1 -- 172.21.15.6:0/2223590338 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc80ab9d0 con 0x7f0fd815cce0 2024-05-04T01:02:45.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.909+0000 7f0fde7dc640 1 -- 172.21.15.6:0/2223590338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0fd815cce0 msgr2=0x7f0fd806d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:45.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.909+0000 7f0fde7dc640 1 --2- 172.21.15.6:0/2223590338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0fd815cce0 0x7f0fd806d8c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80097c0 tx=0x7f0fc801c2c0 comp rx=0 tx=0).stop 2024-05-04T01:02:45.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.909+0000 7f0fde7dc640 1 -- 172.21.15.6:0/2223590338 shutdown_connections 2024-05-04T01:02:45.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.909+0000 7f0fde7dc640 1 --2- 172.21.15.6:0/2223590338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0fd815cce0 0x7f0fd806d8c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:45.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.909+0000 7f0fde7dc640 1 -- 172.21.15.6:0/2223590338 >> 172.21.15.6:0/2223590338 conn(0x7f0fd8073840 msgr2=0x7f0fd8073c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:45.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.909+0000 7f0fde7dc640 1 -- 172.21.15.6:0/2223590338 shutdown_connections 2024-05-04T01:02:45.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.909+0000 7f0fde7dc640 1 -- 172.21.15.6:0/2223590338 wait complete. 2024-05-04T01:02:45.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.913+0000 7f0fde7dc640 1 Processor -- start 2024-05-04T01:02:45.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.913+0000 7f0fde7dc640 1 -- start start 2024-05-04T01:02:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.917+0000 7f0fde7dc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fd8074360 0x7f0fd81f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.917+0000 7f0fde7dc640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0fd80c92e0 0x7f0fd80c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.917+0000 7f0fde7dc640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0fd815cce0 0x7f0fd8141a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.917+0000 7f0fde7dc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd816a590 con 0x7f0fd8074360 2024-05-04T01:02:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.917+0000 7f0fde7dc640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd816a410 con 0x7f0fd815cce0 2024-05-04T01:02:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.917+0000 7f0fde7dc640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f0fd816a710 con 0x7f0fd80c92e0 2024-05-04T01:02:45.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.937+0000 7f0fcffff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0fd80c92e0 0x7f0fd80c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:45.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.937+0000 7f0fdcd79640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0fd815cce0 0x7f0fd8141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:45.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.937+0000 7f0fcffff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0fd80c92e0 0x7f0fd80c7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38762/0 (socket says 172.21.15.6:38762) 2024-05-04T01:02:45.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.937+0000 7f0fcffff640 1 -- 172.21.15.6:0/1518247264 learned_addr learned my addr 172.21.15.6:0/1518247264 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:45.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.953+0000 7f0fcffff640 1 -- 172.21.15.6:0/1518247264 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0fd815cce0 msgr2=0x7f0fd8141a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:45.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.953+0000 7f0fcffff640 1 --2- 172.21.15.6:0/1518247264 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0fd815cce0 0x7f0fd8141a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:45.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.953+0000 7f0fcffff640 1 -- 172.21.15.6:0/1518247264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fd8074360 msgr2=0x7f0fd81f5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:45.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.953+0000 7f0fcffff640 1 --2- 172.21.15.6:0/1518247264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fd8074360 0x7f0fd81f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:45.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:45.953+0000 7f0fcffff640 1 -- 172.21.15.6:0/1518247264 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd81f62f0 con 0x7f0fd80c92e0 2024-05-04T01:02:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.073+0000 7f0fcffff640 1 --2- 172.21.15.6:0/1518247264 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0fd80c92e0 0x7f0fd80c7b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0fc000c430 tx=0x7f0fc000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:46.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.093+0000 7f0fd57fa640 1 -- 172.21.15.6:0/1518247264 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0017070 con 0x7f0fd80c92e0 2024-05-04T01:02:46.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.093+0000 7f0fd57fa640 1 -- 172.21.15.6:0/1518247264 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fc0005cf0 con 0x7f0fd80c92e0 2024-05-04T01:02:46.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.093+0000 7f0fde7dc640 1 -- 172.21.15.6:0/1518247264 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd8152780 con 0x7f0fd80c92e0 2024-05-04T01:02:46.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.093+0000 7f0fd57fa640 1 -- 172.21.15.6:0/1518247264 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc00072f0 con 0x7f0fd80c92e0 2024-05-04T01:02:46.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.093+0000 7f0fde7dc640 1 -- 172.21.15.6:0/1518247264 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd8152d40 con 0x7f0fd80c92e0 2024-05-04T01:02:46.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.093+0000 7f0fde7dc640 1 -- 172.21.15.6:0/1518247264 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0fd8069a50 con 0x7f0fd80c92e0 2024-05-04T01:02:46.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.157+0000 7f0fd57fa640 1 -- 172.21.15.6:0/1518247264 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0fc001a070 con 0x7f0fd80c92e0 2024-05-04T01:02:46.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.161+0000 7f0fd57fa640 1 --2- 172.21.15.6:0/1518247264 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f0fb806f480 0x7f0fb8071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.161+0000 7f0fd7fff640 1 --2- 172.21.15.6:0/1518247264 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f0fb806f480 0x7f0fb8071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.161+0000 7f0fd7fff640 1 --2- 172.21.15.6:0/1518247264 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f0fb806f480 0x7f0fb8071990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80ad000 tx=0x7f0fc8004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:46.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.165+0000 7f0fd57fa640 1 -- 172.21.15.6:0/1518247264 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f0fc0057820 con 0x7f0fd80c92e0 2024-05-04T01:02:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.165+0000 7f0fd57fa640 1 --2- 172.21.15.6:0/1518247264 >> [v2:172.21.15.6:6814/3149875909,v1:172.21.15.6:6818/3149875909] conn(0x7f0fb8077730 0x7f0fb8079ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.165+0000 7f0fd57fa640 1 -- 172.21.15.6:0/1518247264 --> [v2:172.21.15.6:6814/3149875909,v1:172.21.15.6:6818/3149875909] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0fc001dec0 con 0x7f0fb8077730 2024-05-04T01:02:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.165+0000 7f0fd57fa640 1 -- 172.21.15.6:0/1518247264 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0fc0057be0 con 0x7f0fd80c92e0 2024-05-04T01:02:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.165+0000 7f0fdcd79640 1 --2- 172.21.15.6:0/1518247264 >> [v2:172.21.15.6:6814/3149875909,v1:172.21.15.6:6818/3149875909] conn(0x7f0fb8077730 0x7f0fb8079ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:46.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.169+0000 7f0fdcd79640 1 --2- 172.21.15.6:0/1518247264 >> [v2:172.21.15.6:6814/3149875909,v1:172.21.15.6:6818/3149875909] conn(0x7f0fb8077730 0x7f0fb8079ba0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:46.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.169+0000 7f0fd57fa640 1 -- 172.21.15.6:0/1518247264 <== osd.3 v2:172.21.15.6:6814/3149875909 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0fc001dec0 con 0x7f0fb8077730 2024-05-04T01:02:46.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.189+0000 7f0fde7dc640 1 -- 172.21.15.6:0/1518247264 --> [v2:172.21.15.6:6814/3149875909,v1:172.21.15.6:6818/3149875909] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0fd80c58b0 con 0x7f0fb8077730 2024-05-04T01:02:46.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.189+0000 7f0fd57fa640 1 -- 172.21.15.6:0/1518247264 <== osd.3 v2:172.21.15.6:6814/3149875909 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0fd80c58b0 con 0x7f0fb8077730 2024-05-04T01:02:46.192 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-04T01:02:46.192 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T01:02:46.192 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-04T01:02:46.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.189+0000 7f0fde7dc640 1 -- 172.21.15.6:0/1518247264 >> [v2:172.21.15.6:6814/3149875909,v1:172.21.15.6:6818/3149875909] conn(0x7f0fb8077730 msgr2=0x7f0fb8079ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:46.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.189+0000 7f0fde7dc640 1 --2- 172.21.15.6:0/1518247264 >> [v2:172.21.15.6:6814/3149875909,v1:172.21.15.6:6818/3149875909] conn(0x7f0fb8077730 0x7f0fb8079ba0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:46.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.189+0000 7f0fde7dc640 1 -- 172.21.15.6:0/1518247264 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f0fb806f480 msgr2=0x7f0fb8071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:46.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.189+0000 7f0fde7dc640 1 --2- 172.21.15.6:0/1518247264 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f0fb806f480 0x7f0fb8071990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80ad000 tx=0x7f0fc8004740 comp rx=0 tx=0).stop 2024-05-04T01:02:46.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.189+0000 7f0fde7dc640 1 -- 172.21.15.6:0/1518247264 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0fd80c92e0 msgr2=0x7f0fd80c7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:46.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.189+0000 7f0fde7dc640 1 --2- 172.21.15.6:0/1518247264 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0fd80c92e0 0x7f0fd80c7b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0fc000c430 tx=0x7f0fc000c8f0 comp rx=0 tx=0).stop 2024-05-04T01:02:46.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.189+0000 7f0fdcd79640 1 -- 172.21.15.6:0/1518247264 reap_dead start 2024-05-04T01:02:46.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.189+0000 7f0fde7dc640 1 -- 172.21.15.6:0/1518247264 shutdown_connections 2024-05-04T01:02:46.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.189+0000 7f0fde7dc640 1 -- 172.21.15.6:0/1518247264 >> 172.21.15.6:0/1518247264 conn(0x7f0fd8073840 msgr2=0x7f0fd8063450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:46.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.189+0000 7f0fde7dc640 1 -- 172.21.15.6:0/1518247264 shutdown_connections 2024-05-04T01:02:46.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.189+0000 7f0fde7dc640 1 -- 172.21.15.6:0/1518247264 wait complete. 2024-05-04T01:02:46.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-04T01:02:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.389+0000 7f5679a1d640 1 Processor -- start 2024-05-04T01:02:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.389+0000 7f5679a1d640 1 -- start start 2024-05-04T01:02:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.393+0000 7f5679a1d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f56740c7120 0x7f5674152820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.393+0000 7f5679a1d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56740726f0 0x7f56740c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.393+0000 7f5679a1d640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5674073010 con 0x7f567406f860 2024-05-04T01:02:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.393+0000 7f5679a1d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f56740c5ec0 con 0x7f56740726f0 2024-05-04T01:02:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.393+0000 7f5679a1d640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f56740c61a0 con 0x7f56740c7120 2024-05-04T01:02:46.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.393+0000 7f5672ffd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f56740c7120 0x7f5674152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:46.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.393+0000 7f56737fe640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f567406f860 0x7f5674073c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:49684/0 (socket says 172.21.15.6:49684) 2024-05-04T01:02:46.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.393+0000 7f56737fe640 1 -- 172.21.15.6:0/4016632808 learned_addr learned my addr 172.21.15.6:0/4016632808 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T01:02:46.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.401+0000 7f5672ffd640 1 -- 172.21.15.6:0/4016632808 >> v2:172.21.15.6:3300/0 conn(0x7f56740726f0 msgr2=0x7f56740c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:46.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.401+0000 7f5672ffd640 1 --2- 172.21.15.6:0/4016632808 >> v2:172.21.15.6:3300/0 conn(0x7f56740726f0 0x7f56740c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:46.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.401+0000 7f5672ffd640 1 -- 172.21.15.6:0/4016632808 >> v1:172.21.15.163:6789/0 conn(0x7f567406f860 legacy=0x7f5674073c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:46.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.401+0000 7f5672ffd640 1 -- 172.21.15.6:0/4016632808 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56740c6480 con 0x7f56740c7120 2024-05-04T01:02:46.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.409+0000 7f5672ffd640 1 --2- 172.21.15.6:0/4016632808 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f56740c7120 0x7f5674152820 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f56640097c0 tx=0x7f566401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b32772b7f91e1625 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:46.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.421+0000 7f5671ffb640 1 -- 172.21.15.6:0/4016632808 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56640b5070 con 0x7f56740c7120 2024-05-04T01:02:46.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.421+0000 7f5671ffb640 1 -- 172.21.15.6:0/4016632808 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56640a8990 con 0x7f56740c7120 2024-05-04T01:02:46.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.421+0000 7f5671ffb640 1 -- 172.21.15.6:0/4016632808 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56640a8d60 con 0x7f56740c7120 2024-05-04T01:02:46.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.421+0000 7f5679a1d640 1 -- 172.21.15.6:0/4016632808 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f56740c7120 msgr2=0x7f5674152820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:46.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.421+0000 7f5679a1d640 1 --2- 172.21.15.6:0/4016632808 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f56740c7120 0x7f5674152820 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f56640097c0 tx=0x7f566401ec90 comp rx=0 tx=0).stop 2024-05-04T01:02:46.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.421+0000 7f5679a1d640 1 -- 172.21.15.6:0/4016632808 shutdown_connections 2024-05-04T01:02:46.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.421+0000 7f5679a1d640 1 --2- 172.21.15.6:0/4016632808 >> v2:172.21.15.6:3300/0 conn(0x7f56740726f0 0x7f56740c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:46.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.421+0000 7f5679a1d640 1 --2- 172.21.15.6:0/4016632808 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f56740c7120 0x7f5674152820 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:46.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.421+0000 7f5679a1d640 1 -- 172.21.15.6:0/4016632808 >> 172.21.15.6:0/4016632808 conn(0x7f567406cf70 msgr2=0x7f56740c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:46.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.421+0000 7f5679a1d640 1 -- 172.21.15.6:0/4016632808 shutdown_connections 2024-05-04T01:02:46.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.421+0000 7f5679a1d640 1 -- 172.21.15.6:0/4016632808 wait complete. 2024-05-04T01:02:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.425+0000 7f5679a1d640 1 Processor -- start 2024-05-04T01:02:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.425+0000 7f5679a1d640 1 -- start start 2024-05-04T01:02:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.425+0000 7f5679a1d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f567406f860 0x7f56741f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.425+0000 7f5679a1d640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56740726f0 0x7f56741eebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.425+0000 7f5679a1d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56740c7120 0x7f5674153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.425+0000 7f5679a1d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f56740c6760 con 0x7f56740c7120 2024-05-04T01:02:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.425+0000 7f5679a1d640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f56740c8030 con 0x7f56740726f0 2024-05-04T01:02:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.425+0000 7f5679a1d640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f5674072b00 con 0x7f567406f860 2024-05-04T01:02:46.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.429+0000 7f56727fc640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56740726f0 0x7f56741eebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:46.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.429+0000 7f5672ffd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f567406f860 0x7f56741f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:46.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.429+0000 7f56727fc640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56740726f0 0x7f56741eebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:46826/0 (socket says 172.21.15.6:46826) 2024-05-04T01:02:46.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.429+0000 7f56727fc640 1 -- 172.21.15.6:0/2014975064 learned_addr learned my addr 172.21.15.6:0/2014975064 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:46.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.441+0000 7f56727fc640 1 -- 172.21.15.6:0/2014975064 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f567406f860 msgr2=0x7f56741f2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:46.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.441+0000 7f56727fc640 1 --2- 172.21.15.6:0/2014975064 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f567406f860 0x7f56741f2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:46.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.441+0000 7f56727fc640 1 -- 172.21.15.6:0/2014975064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56740c7120 msgr2=0x7f5674153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:46.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.441+0000 7f56727fc640 1 --2- 172.21.15.6:0/2014975064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56740c7120 0x7f5674153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:46.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.441+0000 7f56727fc640 1 -- 172.21.15.6:0/2014975064 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567414c930 con 0x7f56740726f0 2024-05-04T01:02:46.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.449+0000 7f56727fc640 1 --2- 172.21.15.6:0/2014975064 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56740726f0 0x7f56741eebf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f566800b410 tx=0x7f566800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:46.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.461+0000 7f565bfff640 1 -- 172.21.15.6:0/2014975064 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668015020 con 0x7f56740726f0 2024-05-04T01:02:46.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.461+0000 7f565bfff640 1 -- 172.21.15.6:0/2014975064 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5668011830 con 0x7f56740726f0 2024-05-04T01:02:46.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.461+0000 7f565bfff640 1 -- 172.21.15.6:0/2014975064 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668011c20 con 0x7f56740726f0 2024-05-04T01:02:46.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.461+0000 7f5679a1d640 1 -- 172.21.15.6:0/2014975064 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56741ef130 con 0x7f56740726f0 2024-05-04T01:02:46.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.461+0000 7f5679a1d640 1 -- 172.21.15.6:0/2014975064 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f567414a070 con 0x7f56740726f0 2024-05-04T01:02:46.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.461+0000 7f5679a1d640 1 -- 172.21.15.6:0/2014975064 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f567406a390 con 0x7f56740726f0 2024-05-04T01:02:46.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.813+0000 7f565bfff640 1 -- 172.21.15.6:0/2014975064 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5668018020 con 0x7f56740726f0 2024-05-04T01:02:46.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.813+0000 7f565bfff640 1 --2- 172.21.15.6:0/2014975064 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f566006f480 0x7f5660071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:46.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.813+0000 7f5672ffd640 1 --2- 172.21.15.6:0/2014975064 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f566006f480 0x7f5660071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:46.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.817+0000 7f5672ffd640 1 --2- 172.21.15.6:0/2014975064 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f566006f480 0x7f5660071990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f56640b2000 tx=0x7f5664008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:46.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.821+0000 7f565bfff640 1 -- 172.21.15.6:0/2014975064 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f5668011dc0 con 0x7f56740726f0 2024-05-04T01:02:46.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:46.833+0000 7f565bfff640 1 -- 172.21.15.6:0/2014975064 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f566801f020 con 0x7f56740726f0 2024-05-04T01:02:47.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.025+0000 7f5679a1d640 1 -- 172.21.15.6:0/2014975064 --> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f5674070ea0 con 0x7f566006f480 2024-05-04T01:02:47.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.025+0000 7f565bfff640 1 -- 172.21.15.6:0/2014975064 <== mgr.4103 v2:172.21.15.163:6800/2152694980 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5674070ea0 con 0x7f566006f480 2024-05-04T01:02:47.029 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 3 to deep-scrub 2024-05-04T01:02:47.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.029+0000 7f5679a1d640 1 -- 172.21.15.6:0/2014975064 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f566006f480 msgr2=0x7f5660071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:47.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.029+0000 7f5679a1d640 1 --2- 172.21.15.6:0/2014975064 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f566006f480 0x7f5660071990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f56640b2000 tx=0x7f5664008040 comp rx=0 tx=0).stop 2024-05-04T01:02:47.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.029+0000 7f5679a1d640 1 -- 172.21.15.6:0/2014975064 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56740726f0 msgr2=0x7f56741eebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:47.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.029+0000 7f5679a1d640 1 --2- 172.21.15.6:0/2014975064 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56740726f0 0x7f56741eebf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f566800b410 tx=0x7f566800b8d0 comp rx=0 tx=0).stop 2024-05-04T01:02:47.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.029+0000 7f5679a1d640 1 -- 172.21.15.6:0/2014975064 shutdown_connections 2024-05-04T01:02:47.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.029+0000 7f5679a1d640 1 --2- 172.21.15.6:0/2014975064 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56740726f0 0x7f56741eebf0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:47.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.029+0000 7f5679a1d640 1 --2- 172.21.15.6:0/2014975064 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f566006f480 0x7f5660071990 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:47.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.029+0000 7f5679a1d640 1 --2- 172.21.15.6:0/2014975064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56740c7120 0x7f5674153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:47.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.029+0000 7f5679a1d640 1 --2- 172.21.15.6:0/2014975064 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f567406f860 0x7f56741f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:47.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.029+0000 7f5679a1d640 1 -- 172.21.15.6:0/2014975064 >> 172.21.15.6:0/2014975064 conn(0x7f567406cf70 msgr2=0x7f56740ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:47.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.029+0000 7f5679a1d640 1 -- 172.21.15.6:0/2014975064 shutdown_connections 2024-05-04T01:02:47.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.029+0000 7f5679a1d640 1 -- 172.21.15.6:0/2014975064 wait complete. 2024-05-04T01:02:47.055 INFO:tasks.ceph:Scrubbing osd.4 2024-05-04T01:02:47.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-04T01:02:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.213+0000 7f52caf44640 1 Processor -- start 2024-05-04T01:02:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.213+0000 7f52caf44640 1 -- start start 2024-05-04T01:02:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.217+0000 7f52caf44640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52c406f4e0 0x7f52c4156150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.217+0000 7f52caf44640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c415ca40 con 0x7f52c406f0d0 2024-05-04T01:02:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.217+0000 7f52caf44640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c415d280 con 0x7f52c4073ce0 2024-05-04T01:02:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.217+0000 7f52caf44640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f52c415ccc0 con 0x7f52c406f4e0 2024-05-04T01:02:47.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.217+0000 7f52c8ce0640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f52c4073ce0 0x7f52c4074860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:49694/0 (socket says 172.21.15.6:49694) 2024-05-04T01:02:47.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.217+0000 7f52c8ce0640 1 -- 172.21.15.6:0/731770229 learned_addr learned my addr 172.21.15.6:0/731770229 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T01:02:47.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.217+0000 7f52c94e1640 1 --2- 172.21.15.6:0/731770229 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52c406f4e0 0x7f52c4156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:47.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.221+0000 7f52c94e1640 1 -- 172.21.15.6:0/731770229 >> v1:172.21.15.163:6789/0 conn(0x7f52c4073ce0 legacy=0x7f52c4074860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:47.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.221+0000 7f52c94e1640 1 -- 172.21.15.6:0/731770229 >> v1:172.21.15.6:6789/0 conn(0x7f52c406f0d0 legacy=0x7f52c415c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:47.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.225+0000 7f52c94e1640 1 -- 172.21.15.6:0/731770229 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c415cfa0 con 0x7f52c406f4e0 2024-05-04T01:02:47.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.229+0000 7f52c94e1640 1 --2- 172.21.15.6:0/731770229 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52c406f4e0 0x7f52c4156150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009dc0 tx=0x7f52bc01c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f357ae9835cbe50 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:47.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.329+0000 7f52c37fe640 1 -- 172.21.15.6:0/731770229 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc0ac070 con 0x7f52c406f4e0 2024-05-04T01:02:47.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.329+0000 7f52c37fe640 1 -- 172.21.15.6:0/731770229 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52bc0a6640 con 0x7f52c406f4e0 2024-05-04T01:02:47.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.329+0000 7f52c37fe640 1 -- 172.21.15.6:0/731770229 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc0a6a10 con 0x7f52c406f4e0 2024-05-04T01:02:47.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.333+0000 7f52caf44640 1 -- 172.21.15.6:0/731770229 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52c406f4e0 msgr2=0x7f52c4156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:47.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.333+0000 7f52caf44640 1 --2- 172.21.15.6:0/731770229 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52c406f4e0 0x7f52c4156150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009dc0 tx=0x7f52bc01c7b0 comp rx=0 tx=0).stop 2024-05-04T01:02:47.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.333+0000 7f52caf44640 1 -- 172.21.15.6:0/731770229 shutdown_connections 2024-05-04T01:02:47.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.333+0000 7f52caf44640 1 --2- 172.21.15.6:0/731770229 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52c406f4e0 0x7f52c4156150 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:47.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.333+0000 7f52caf44640 1 -- 172.21.15.6:0/731770229 >> 172.21.15.6:0/731770229 conn(0x7f52c40ca990 msgr2=0x7f52c40cada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:47.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.333+0000 7f52caf44640 1 -- 172.21.15.6:0/731770229 shutdown_connections 2024-05-04T01:02:47.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.333+0000 7f52caf44640 1 -- 172.21.15.6:0/731770229 wait complete. 2024-05-04T01:02:47.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.337+0000 7f52caf44640 1 Processor -- start 2024-05-04T01:02:47.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.337+0000 7f52caf44640 1 -- start start 2024-05-04T01:02:47.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.337+0000 7f52caf44640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52c406f0d0 0x7f52c4157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:47.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.337+0000 7f52caf44640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52c406f4e0 0x7f52c4148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:47.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.337+0000 7f52caf44640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52c4073ce0 0x7f52c41589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:47.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.337+0000 7f52caf44640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f52c416a400 con 0x7f52c406f0d0 2024-05-04T01:02:47.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.337+0000 7f52caf44640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f52c40740f0 con 0x7f52c4073ce0 2024-05-04T01:02:47.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.337+0000 7f52caf44640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f52c416a580 con 0x7f52c406f4e0 2024-05-04T01:02:47.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.341+0000 7f52c3fff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52c406f4e0 0x7f52c4148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:47.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.341+0000 7f52c3fff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52c406f4e0 0x7f52c4148220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38784/0 (socket says 172.21.15.6:38784) 2024-05-04T01:02:47.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.341+0000 7f52c3fff640 1 -- 172.21.15.6:0/2422784647 learned_addr learned my addr 172.21.15.6:0/2422784647 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:47.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.353+0000 7f52c3fff640 1 -- 172.21.15.6:0/2422784647 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52c4073ce0 msgr2=0x7f52c41589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:47.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.353+0000 7f52c3fff640 1 --2- 172.21.15.6:0/2422784647 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52c4073ce0 0x7f52c41589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:47.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.353+0000 7f52c3fff640 1 -- 172.21.15.6:0/2422784647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52c406f0d0 msgr2=0x7f52c4157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:47.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.353+0000 7f52c3fff640 1 --2- 172.21.15.6:0/2422784647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52c406f0d0 0x7f52c4157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:47.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.353+0000 7f52c3fff640 1 -- 172.21.15.6:0/2422784647 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c4156e40 con 0x7f52c406f4e0 2024-05-04T01:02:47.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.361+0000 7f52c3fff640 1 --2- 172.21.15.6:0/2422784647 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52c406f4e0 0x7f52c4148220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f52b800b3e0 tx=0x7f52b800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:47.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.373+0000 7f52c17fa640 1 -- 172.21.15.6:0/2422784647 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b8015020 con 0x7f52c406f4e0 2024-05-04T01:02:47.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.373+0000 7f52c17fa640 1 -- 172.21.15.6:0/2422784647 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b8011830 con 0x7f52c406f4e0 2024-05-04T01:02:47.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.373+0000 7f52c17fa640 1 -- 172.21.15.6:0/2422784647 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b8011c40 con 0x7f52c406f4e0 2024-05-04T01:02:47.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.373+0000 7f52caf44640 1 -- 172.21.15.6:0/2422784647 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c41583e0 con 0x7f52c406f4e0 2024-05-04T01:02:47.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.373+0000 7f52caf44640 1 -- 172.21.15.6:0/2422784647 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c41570e0 con 0x7f52c406f4e0 2024-05-04T01:02:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.373+0000 7f52caf44640 1 -- 172.21.15.6:0/2422784647 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f52c4069a50 con 0x7f52c406f4e0 2024-05-04T01:02:47.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.413+0000 7f52c17fa640 1 -- 172.21.15.6:0/2422784647 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f52b8018020 con 0x7f52c406f4e0 2024-05-04T01:02:47.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.413+0000 7f52c17fa640 1 --2- 172.21.15.6:0/2422784647 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f52b006f450 0x7f52b0071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:47.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.413+0000 7f52c8ce0640 1 --2- 172.21.15.6:0/2422784647 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f52b006f450 0x7f52b0071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:47.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.413+0000 7f52c8ce0640 1 --2- 172.21.15.6:0/2422784647 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f52b006f450 0x7f52b0071960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f52b4005890 tx=0x7f52b4007a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:47.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.421+0000 7f52c17fa640 1 -- 172.21.15.6:0/2422784647 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f52b8011de0 con 0x7f52c406f4e0 2024-05-04T01:02:47.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.421+0000 7f52c17fa640 1 --2- 172.21.15.6:0/2422784647 >> [v2:172.21.15.163:6816/2508264225,v1:172.21.15.163:6818/2508264225] conn(0x7f52b0077700 0x7f52b0079b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:47.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.421+0000 7f52c17fa640 1 -- 172.21.15.6:0/2422784647 --> [v2:172.21.15.163:6816/2508264225,v1:172.21.15.163:6818/2508264225] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52b800de50 con 0x7f52b0077700 2024-05-04T01:02:47.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.421+0000 7f52c17fa640 1 -- 172.21.15.6:0/2422784647 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f52b80582f0 con 0x7f52c406f4e0 2024-05-04T01:02:47.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.421+0000 7f52c94e1640 1 --2- 172.21.15.6:0/2422784647 >> [v2:172.21.15.163:6816/2508264225,v1:172.21.15.163:6818/2508264225] conn(0x7f52b0077700 0x7f52b0079b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:47.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.421+0000 7f52c94e1640 1 --2- 172.21.15.6:0/2422784647 >> [v2:172.21.15.163:6816/2508264225,v1:172.21.15.163:6818/2508264225] conn(0x7f52b0077700 0x7f52b0079b70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:47.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.425+0000 7f52c17fa640 1 -- 172.21.15.6:0/2422784647 <== osd.4 v2:172.21.15.163:6816/2508264225 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f52b800de50 con 0x7f52b0077700 2024-05-04T01:02:47.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.445+0000 7f52caf44640 1 -- 172.21.15.6:0/2422784647 --> [v2:172.21.15.163:6816/2508264225,v1:172.21.15.163:6818/2508264225] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f52c41533f0 con 0x7f52b0077700 2024-05-04T01:02:47.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.445+0000 7f52c17fa640 1 -- 172.21.15.6:0/2422784647 <== osd.4 v2:172.21.15.163:6816/2508264225 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f52c41533f0 con 0x7f52b0077700 2024-05-04T01:02:47.449 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-04T01:02:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T01:02:47.450 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-04T01:02:47.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.449+0000 7f52caf44640 1 -- 172.21.15.6:0/2422784647 >> [v2:172.21.15.163:6816/2508264225,v1:172.21.15.163:6818/2508264225] conn(0x7f52b0077700 msgr2=0x7f52b0079b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:47.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.449+0000 7f52caf44640 1 --2- 172.21.15.6:0/2422784647 >> [v2:172.21.15.163:6816/2508264225,v1:172.21.15.163:6818/2508264225] conn(0x7f52b0077700 0x7f52b0079b70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:47.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.449+0000 7f52caf44640 1 -- 172.21.15.6:0/2422784647 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f52b006f450 msgr2=0x7f52b0071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:47.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.449+0000 7f52caf44640 1 --2- 172.21.15.6:0/2422784647 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f52b006f450 0x7f52b0071960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f52b4005890 tx=0x7f52b4007a30 comp rx=0 tx=0).stop 2024-05-04T01:02:47.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.449+0000 7f52caf44640 1 -- 172.21.15.6:0/2422784647 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52c406f4e0 msgr2=0x7f52c4148220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:47.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.449+0000 7f52caf44640 1 --2- 172.21.15.6:0/2422784647 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52c406f4e0 0x7f52c4148220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f52b800b3e0 tx=0x7f52b800b8a0 comp rx=0 tx=0).stop 2024-05-04T01:02:47.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.449+0000 7f52c94e1640 1 -- 172.21.15.6:0/2422784647 reap_dead start 2024-05-04T01:02:47.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.449+0000 7f52caf44640 1 -- 172.21.15.6:0/2422784647 shutdown_connections 2024-05-04T01:02:47.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.449+0000 7f52caf44640 1 -- 172.21.15.6:0/2422784647 >> 172.21.15.6:0/2422784647 conn(0x7f52c40ca990 msgr2=0x7f52c4070a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:47.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.449+0000 7f52caf44640 1 -- 172.21.15.6:0/2422784647 shutdown_connections 2024-05-04T01:02:47.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.449+0000 7f52caf44640 1 -- 172.21.15.6:0/2422784647 wait complete. 2024-05-04T01:02:47.480 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-04T01:02:47.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.641+0000 7fd010c53640 1 Processor -- start 2024-05-04T01:02:47.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.641+0000 7fd010c53640 1 -- start start 2024-05-04T01:02:47.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.641+0000 7fd010c53640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd00c0cea80 0x7fd00c0b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:47.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.641+0000 7fd010c53640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd00c164c90 0x7fd00c1670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:47.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.641+0000 7fd010c53640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd00c15ce40 con 0x7fd00c0b4b00 2024-05-04T01:02:47.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.641+0000 7fd010c53640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fd00c0cdd50 con 0x7fd00c164c90 2024-05-04T01:02:47.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.641+0000 7fd010c53640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fd00c0cbad0 con 0x7fd00c0cea80 2024-05-04T01:02:47.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.645+0000 7fd00a59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd00c0b4b00 0x7fd00c0d1790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52074/0 (socket says 172.21.15.6:52074) 2024-05-04T01:02:47.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.645+0000 7fd00a59c640 1 -- 172.21.15.6:0/3403069811 learned_addr learned my addr 172.21.15.6:0/3403069811 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T01:02:47.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.645+0000 7fd00ad9d640 1 --2- 172.21.15.6:0/3403069811 >> v2:172.21.15.163:3300/0 conn(0x7fd00c164c90 0x7fd00c1670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:47.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.645+0000 7fd009d9b640 1 --2- 172.21.15.6:0/3403069811 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd00c0cea80 0x7fd00c0b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:47.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.649+0000 7fd00959a640 1 -- 172.21.15.6:0/3403069811 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 604365422 0 0) 0x7fd00c15ce40 con 0x7fd00c0b4b00 2024-05-04T01:02:47.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.649+0000 7fd00959a640 1 -- 172.21.15.6:0/3403069811 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcff4003530 con 0x7fd00c0b4b00 2024-05-04T01:02:47.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.653+0000 7fd00ad9d640 1 -- 172.21.15.6:0/3403069811 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd00c0cea80 msgr2=0x7fd00c0b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:47.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.653+0000 7fd00ad9d640 1 --2- 172.21.15.6:0/3403069811 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd00c0cea80 0x7fd00c0b3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:47.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.653+0000 7fd00ad9d640 1 -- 172.21.15.6:0/3403069811 >> v1:172.21.15.6:6789/0 conn(0x7fd00c0b4b00 legacy=0x7fd00c0d1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:47.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.653+0000 7fd00ad9d640 1 -- 172.21.15.6:0/3403069811 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00c15d120 con 0x7fd00c164c90 2024-05-04T01:02:47.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.657+0000 7fd00ad9d640 1 --2- 172.21.15.6:0/3403069811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd00c164c90 0x7fd00c1670b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd004009d90 tx=0x7fd00401c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27bbe8a6245ede0a server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:47.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.669+0000 7fd00959a640 1 -- 172.21.15.6:0/3403069811 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0040b2070 con 0x7fd00c164c90 2024-05-04T01:02:47.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.669+0000 7fd00959a640 1 -- 172.21.15.6:0/3403069811 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0040a5710 con 0x7fd00c164c90 2024-05-04T01:02:47.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.669+0000 7fd00959a640 1 -- 172.21.15.6:0/3403069811 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0040a5ae0 con 0x7fd00c164c90 2024-05-04T01:02:47.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.669+0000 7fd010c53640 1 -- 172.21.15.6:0/3403069811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd00c164c90 msgr2=0x7fd00c1670b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:47.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.669+0000 7fd010c53640 1 --2- 172.21.15.6:0/3403069811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd00c164c90 0x7fd00c1670b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd004009d90 tx=0x7fd00401c850 comp rx=0 tx=0).stop 2024-05-04T01:02:47.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.669+0000 7fd010c53640 1 -- 172.21.15.6:0/3403069811 shutdown_connections 2024-05-04T01:02:47.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.669+0000 7fd010c53640 1 --2- 172.21.15.6:0/3403069811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd00c164c90 0x7fd00c1670b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:47.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.669+0000 7fd010c53640 1 --2- 172.21.15.6:0/3403069811 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd00c0cea80 0x7fd00c0b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:47.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.669+0000 7fd010c53640 1 -- 172.21.15.6:0/3403069811 >> 172.21.15.6:0/3403069811 conn(0x7fd00c06da40 msgr2=0x7fd00c06de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:47.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.669+0000 7fd010c53640 1 -- 172.21.15.6:0/3403069811 shutdown_connections 2024-05-04T01:02:47.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.669+0000 7fd010c53640 1 -- 172.21.15.6:0/3403069811 wait complete. 2024-05-04T01:02:47.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.673+0000 7fd010c53640 1 Processor -- start 2024-05-04T01:02:47.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.673+0000 7fd010c53640 1 -- start start 2024-05-04T01:02:47.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.673+0000 7fd010c53640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd00c0b4b00 0x7fd00c156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:47.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.673+0000 7fd010c53640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd00c0cea80 0x7fd00c157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:47.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.673+0000 7fd010c53640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd00c164c90 0x7fd00c153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:47.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.673+0000 7fd010c53640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd00c0cee90 con 0x7fd00c164c90 2024-05-04T01:02:47.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.673+0000 7fd010c53640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd00c0cd440 con 0x7fd00c0cea80 2024-05-04T01:02:47.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.673+0000 7fd010c53640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fd00c0b4750 con 0x7fd00c0b4b00 2024-05-04T01:02:47.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.677+0000 7fd00ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd00c164c90 0x7fd00c153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:47.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.677+0000 7fd00ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd00c164c90 0x7fd00c153db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50960/0 (socket says 172.21.15.6:50960) 2024-05-04T01:02:47.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.677+0000 7fd00ad9d640 1 -- 172.21.15.6:0/1510987921 learned_addr learned my addr 172.21.15.6:0/1510987921 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:47.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.677+0000 7fd00a59c640 1 --2- 172.21.15.6:0/1510987921 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd00c0b4b00 0x7fd00c156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:47.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.677+0000 7fd009d9b640 1 --2- 172.21.15.6:0/1510987921 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd00c0cea80 0x7fd00c157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:47.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.681+0000 7fd00ad9d640 1 -- 172.21.15.6:0/1510987921 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd00c0b4b00 msgr2=0x7fd00c156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:47.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.681+0000 7fd00ad9d640 1 --2- 172.21.15.6:0/1510987921 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd00c0b4b00 0x7fd00c156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:47.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.681+0000 7fd00ad9d640 1 -- 172.21.15.6:0/1510987921 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd00c0cea80 msgr2=0x7fd00c157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:47.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.681+0000 7fd00ad9d640 1 --2- 172.21.15.6:0/1510987921 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd00c0cea80 0x7fd00c157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:47.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.681+0000 7fd00ad9d640 1 -- 172.21.15.6:0/1510987921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00c158460 con 0x7fd00c164c90 2024-05-04T01:02:47.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.681+0000 7fd00ad9d640 1 --2- 172.21.15.6:0/1510987921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd00c164c90 0x7fd00c153db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd00401a480 tx=0x7fd0040195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:47.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.689+0000 7fcffaffd640 1 -- 172.21.15.6:0/1510987921 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0040bb020 con 0x7fd00c164c90 2024-05-04T01:02:47.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.689+0000 7fcffaffd640 1 -- 172.21.15.6:0/1510987921 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0040ad440 con 0x7fd00c164c90 2024-05-04T01:02:47.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.689+0000 7fcffaffd640 1 -- 172.21.15.6:0/1510987921 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0040b2040 con 0x7fd00c164c90 2024-05-04T01:02:47.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.689+0000 7fd010c53640 1 -- 172.21.15.6:0/1510987921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd00c165d40 con 0x7fd00c164c90 2024-05-04T01:02:47.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.689+0000 7fd010c53640 1 -- 172.21.15.6:0/1510987921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd00c1662c0 con 0x7fd00c164c90 2024-05-04T01:02:47.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:47.689+0000 7fd010c53640 1 -- 172.21.15.6:0/1510987921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd00c06a390 con 0x7fd00c164c90 2024-05-04T01:02:48.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.017+0000 7fcffaffd640 1 -- 172.21.15.6:0/1510987921 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd0040be020 con 0x7fd00c164c90 2024-05-04T01:02:48.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.017+0000 7fcffaffd640 1 --2- 172.21.15.6:0/1510987921 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fcfec06f450 0x7fcfec071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:48.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.021+0000 7fd00a59c640 1 --2- 172.21.15.6:0/1510987921 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fcfec06f450 0x7fcfec071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:48.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.021+0000 7fd00a59c640 1 --2- 172.21.15.6:0/1510987921 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fcfec06f450 0x7fcfec071960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcffc007a70 tx=0x7fcffc0079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:48.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.117+0000 7fcffaffd640 1 -- 172.21.15.6:0/1510987921 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7fd0040f2d50 con 0x7fd00c164c90 2024-05-04T01:02:48.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.117+0000 7fcffaffd640 1 -- 172.21.15.6:0/1510987921 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd004016560 con 0x7fd00c164c90 2024-05-04T01:02:48.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.321+0000 7fd010c53640 1 -- 172.21.15.6:0/1510987921 --> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fd00c0cd6c0 con 0x7fcfec06f450 2024-05-04T01:02:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.321+0000 7fcffaffd640 1 -- 172.21.15.6:0/1510987921 <== mgr.4103 v2:172.21.15.163:6800/2152694980 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd00c0cd6c0 con 0x7fcfec06f450 2024-05-04T01:02:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 4 to deep-scrub 2024-05-04T01:02:48.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.325+0000 7fd010c53640 1 -- 172.21.15.6:0/1510987921 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fcfec06f450 msgr2=0x7fcfec071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:48.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.325+0000 7fd010c53640 1 --2- 172.21.15.6:0/1510987921 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fcfec06f450 0x7fcfec071960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcffc007a70 tx=0x7fcffc0079c0 comp rx=0 tx=0).stop 2024-05-04T01:02:48.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.325+0000 7fd010c53640 1 -- 172.21.15.6:0/1510987921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd00c164c90 msgr2=0x7fd00c153db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:48.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.325+0000 7fd010c53640 1 --2- 172.21.15.6:0/1510987921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd00c164c90 0x7fd00c153db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd00401a480 tx=0x7fd0040195f0 comp rx=0 tx=0).stop 2024-05-04T01:02:48.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.325+0000 7fd010c53640 1 -- 172.21.15.6:0/1510987921 shutdown_connections 2024-05-04T01:02:48.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.325+0000 7fd010c53640 1 --2- 172.21.15.6:0/1510987921 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd00c0cea80 0x7fd00c157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:48.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.325+0000 7fd010c53640 1 --2- 172.21.15.6:0/1510987921 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fcfec06f450 0x7fcfec071960 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:48.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.325+0000 7fd010c53640 1 --2- 172.21.15.6:0/1510987921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd00c164c90 0x7fd00c153db0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:48.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.325+0000 7fd010c53640 1 --2- 172.21.15.6:0/1510987921 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd00c0b4b00 0x7fd00c156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:48.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.325+0000 7fd010c53640 1 -- 172.21.15.6:0/1510987921 >> 172.21.15.6:0/1510987921 conn(0x7fd00c06da40 msgr2=0x7fd00c0c9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:48.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.325+0000 7fd010c53640 1 -- 172.21.15.6:0/1510987921 shutdown_connections 2024-05-04T01:02:48.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.325+0000 7fd010c53640 1 -- 172.21.15.6:0/1510987921 wait complete. 2024-05-04T01:02:48.351 INFO:tasks.ceph:Scrubbing osd.5 2024-05-04T01:02:48.351 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-04T01:02:48.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.517+0000 7f52b31d6640 1 Processor -- start 2024-05-04T01:02:48.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.517+0000 7f52b31d6640 1 -- start start 2024-05-04T01:02:48.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.517+0000 7f52b31d6640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52ac0c7090 0x7f52ac06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:48.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.517+0000 7f52b31d6640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f52ac0c74a0 0x7f52ac06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.517+0000 7f52b31d6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52ac074900 con 0x7f52ac0c5210 2024-05-04T01:02:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.517+0000 7f52b31d6640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f52ac0c6c00 con 0x7f52ac0c74a0 2024-05-04T01:02:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.517+0000 7f52b31d6640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f52ac0c9020 con 0x7f52ac0c7090 2024-05-04T01:02:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.521+0000 7f52b1773640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f52ac0c74a0 0x7f52ac06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:48.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.521+0000 7f52b1773640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f52ac0c74a0 0x7f52ac06d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:46860/0 (socket says 172.21.15.6:46860) 2024-05-04T01:02:48.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.521+0000 7f52b1773640 1 -- 172.21.15.6:0/3268248561 learned_addr learned my addr 172.21.15.6:0/3268248561 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:48.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.521+0000 7f52abfff640 1 --2- 172.21.15.6:0/3268248561 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52ac0c7090 0x7f52ac06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:48.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.525+0000 7f52b1773640 1 -- 172.21.15.6:0/3268248561 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52ac0c7090 msgr2=0x7f52ac06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:48.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.525+0000 7f52b1773640 1 --2- 172.21.15.6:0/3268248561 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52ac0c7090 0x7f52ac06d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:48.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.525+0000 7f52b1773640 1 -- 172.21.15.6:0/3268248561 >> v1:172.21.15.6:6789/0 conn(0x7f52ac0c5210 legacy=0x7f52ac1531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:48.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.525+0000 7f52b1773640 1 -- 172.21.15.6:0/3268248561 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ac0c9300 con 0x7f52ac0c74a0 2024-05-04T01:02:48.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.533+0000 7f52b1773640 1 --2- 172.21.15.6:0/3268248561 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52ac0c74a0 0x7f52ac06d7e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009e50 tx=0x7f52a401f210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17d1e25fc982e9d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:48.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.549+0000 7f52ab7fe640 1 -- 172.21.15.6:0/3268248561 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a40b4070 con 0x7f52ac0c74a0 2024-05-04T01:02:48.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.549+0000 7f52ab7fe640 1 -- 172.21.15.6:0/3268248561 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a40af400 con 0x7f52ac0c74a0 2024-05-04T01:02:48.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.549+0000 7f52ab7fe640 1 -- 172.21.15.6:0/3268248561 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a40af7d0 con 0x7f52ac0c74a0 2024-05-04T01:02:48.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.549+0000 7f52b31d6640 1 -- 172.21.15.6:0/3268248561 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52ac0c74a0 msgr2=0x7f52ac06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:48.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.549+0000 7f52b31d6640 1 --2- 172.21.15.6:0/3268248561 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52ac0c74a0 0x7f52ac06d7e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009e50 tx=0x7f52a401f210 comp rx=0 tx=0).stop 2024-05-04T01:02:48.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.549+0000 7f52b31d6640 1 -- 172.21.15.6:0/3268248561 shutdown_connections 2024-05-04T01:02:48.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.549+0000 7f52b31d6640 1 --2- 172.21.15.6:0/3268248561 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52ac0c74a0 0x7f52ac06d7e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:48.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.549+0000 7f52b31d6640 1 --2- 172.21.15.6:0/3268248561 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52ac0c7090 0x7f52ac06d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:48.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.549+0000 7f52b31d6640 1 -- 172.21.15.6:0/3268248561 >> 172.21.15.6:0/3268248561 conn(0x7f52ac06c780 msgr2=0x7f52ac06cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:48.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.549+0000 7f52b31d6640 1 -- 172.21.15.6:0/3268248561 shutdown_connections 2024-05-04T01:02:48.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.549+0000 7f52b31d6640 1 -- 172.21.15.6:0/3268248561 wait complete. 2024-05-04T01:02:48.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.553+0000 7f52b31d6640 1 Processor -- start 2024-05-04T01:02:48.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.553+0000 7f52b31d6640 1 -- start start 2024-05-04T01:02:48.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.557+0000 7f52b31d6640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52ac0c5210 0x7f52ac1e3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:48.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.557+0000 7f52b31d6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52ac0c7090 0x7f52ac1f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:48.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.557+0000 7f52b31d6640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52ac0c74a0 0x7f52ac144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:48.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.557+0000 7f52b31d6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f52ac0c9960 con 0x7f52ac0c7090 2024-05-04T01:02:48.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.557+0000 7f52b31d6640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f52ac0c97e0 con 0x7f52ac0c74a0 2024-05-04T01:02:48.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.557+0000 7f52b31d6640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f52ac070f70 con 0x7f52ac0c5210 2024-05-04T01:02:48.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.557+0000 7f52abfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52ac0c7090 0x7f52ac1f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:48.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.557+0000 7f52abfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52ac0c7090 0x7f52ac1f3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50970/0 (socket says 172.21.15.6:50970) 2024-05-04T01:02:48.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.557+0000 7f52abfff640 1 -- 172.21.15.6:0/1842913669 learned_addr learned my addr 172.21.15.6:0/1842913669 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:48.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.557+0000 7f52b0f72640 1 --2- 172.21.15.6:0/1842913669 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52ac0c5210 0x7f52ac1e3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:48.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.561+0000 7f52abfff640 1 -- 172.21.15.6:0/1842913669 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52ac0c5210 msgr2=0x7f52ac1e3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:48.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.561+0000 7f52abfff640 1 --2- 172.21.15.6:0/1842913669 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52ac0c5210 0x7f52ac1e3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:48.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.561+0000 7f52abfff640 1 -- 172.21.15.6:0/1842913669 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52ac0c74a0 msgr2=0x7f52ac144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:48.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.561+0000 7f52abfff640 1 --2- 172.21.15.6:0/1842913669 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52ac0c74a0 0x7f52ac144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:48.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.561+0000 7f52abfff640 1 -- 172.21.15.6:0/1842913669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ac072a50 con 0x7f52ac0c7090 2024-05-04T01:02:48.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.565+0000 7f52abfff640 1 --2- 172.21.15.6:0/1842913669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52ac0c7090 0x7f52ac1f3e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f529c00e870 tx=0x7f529c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:48.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.569+0000 7f52a97fa640 1 -- 172.21.15.6:0/1842913669 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c017070 con 0x7f52ac0c7090 2024-05-04T01:02:48.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.569+0000 7f52a97fa640 1 -- 172.21.15.6:0/1842913669 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f529c00c8c0 con 0x7f52ac0c7090 2024-05-04T01:02:48.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.569+0000 7f52a97fa640 1 -- 172.21.15.6:0/1842913669 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c00cc70 con 0x7f52ac0c7090 2024-05-04T01:02:48.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.569+0000 7f52b31d6640 1 -- 172.21.15.6:0/1842913669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52ac1e3ed0 con 0x7f52ac0c7090 2024-05-04T01:02:48.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.569+0000 7f52b31d6640 1 -- 172.21.15.6:0/1842913669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52ac151b60 con 0x7f52ac0c7090 2024-05-04T01:02:48.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.573+0000 7f52b31d6640 1 -- 172.21.15.6:0/1842913669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f52ac06a400 con 0x7f52ac0c7090 2024-05-04T01:02:48.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.601+0000 7f52a97fa640 1 -- 172.21.15.6:0/1842913669 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f529c01a070 con 0x7f52ac0c7090 2024-05-04T01:02:48.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.601+0000 7f52a97fa640 1 --2- 172.21.15.6:0/1842913669 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f529806f400 0x7f5298071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:48.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.605+0000 7f52b0f72640 1 --2- 172.21.15.6:0/1842913669 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f529806f400 0x7f5298071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:48.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.605+0000 7f52b0f72640 1 --2- 172.21.15.6:0/1842913669 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f529806f400 0x7f5298071910 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f52a000b810 tx=0x7f52a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:48.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.605+0000 7f52a97fa640 1 -- 172.21.15.6:0/1842913669 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f529c08d9b0 con 0x7f52ac0c7090 2024-05-04T01:02:48.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.605+0000 7f52a97fa640 1 --2- 172.21.15.6:0/1842913669 >> [v2:172.21.15.163:6812/167619435,v1:172.21.15.163:6815/167619435] conn(0x7f52980776b0 0x7f5298079b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:48.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.605+0000 7f52a97fa640 1 -- 172.21.15.6:0/1842913669 --> [v2:172.21.15.163:6812/167619435,v1:172.21.15.163:6815/167619435] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f529807a1f0 con 0x7f52980776b0 2024-05-04T01:02:48.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.605+0000 7f52a97fa640 1 -- 172.21.15.6:0/1842913669 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f529c058350 con 0x7f52ac0c7090 2024-05-04T01:02:48.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.605+0000 7f52b1773640 1 --2- 172.21.15.6:0/1842913669 >> [v2:172.21.15.163:6812/167619435,v1:172.21.15.163:6815/167619435] conn(0x7f52980776b0 0x7f5298079b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:48.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.609+0000 7f52b1773640 1 --2- 172.21.15.6:0/1842913669 >> [v2:172.21.15.163:6812/167619435,v1:172.21.15.163:6815/167619435] conn(0x7f52980776b0 0x7f5298079b20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:48.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.609+0000 7f52a97fa640 1 -- 172.21.15.6:0/1842913669 <== osd.5 v2:172.21.15.163:6812/167619435 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f529807a1f0 con 0x7f52980776b0 2024-05-04T01:02:48.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.629+0000 7f52b31d6640 1 -- 172.21.15.6:0/1842913669 --> [v2:172.21.15.163:6812/167619435,v1:172.21.15.163:6815/167619435] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f52ac156a30 con 0x7f52980776b0 2024-05-04T01:02:48.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.629+0000 7f52a97fa640 1 -- 172.21.15.6:0/1842913669 <== osd.5 v2:172.21.15.163:6812/167619435 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f52ac156a30 con 0x7f52980776b0 2024-05-04T01:02:48.633 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-04T01:02:48.634 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T01:02:48.634 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-04T01:02:48.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.629+0000 7f52b31d6640 1 -- 172.21.15.6:0/1842913669 >> [v2:172.21.15.163:6812/167619435,v1:172.21.15.163:6815/167619435] conn(0x7f52980776b0 msgr2=0x7f5298079b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:48.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.633+0000 7f52b31d6640 1 --2- 172.21.15.6:0/1842913669 >> [v2:172.21.15.163:6812/167619435,v1:172.21.15.163:6815/167619435] conn(0x7f52980776b0 0x7f5298079b20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:48.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.633+0000 7f52b31d6640 1 -- 172.21.15.6:0/1842913669 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f529806f400 msgr2=0x7f5298071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:48.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.633+0000 7f52b31d6640 1 --2- 172.21.15.6:0/1842913669 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f529806f400 0x7f5298071910 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f52a000b810 tx=0x7f52a0008040 comp rx=0 tx=0).stop 2024-05-04T01:02:48.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.633+0000 7f52b31d6640 1 -- 172.21.15.6:0/1842913669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52ac0c7090 msgr2=0x7f52ac1f3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.633+0000 7f52b31d6640 1 --2- 172.21.15.6:0/1842913669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52ac0c7090 0x7f52ac1f3e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f529c00e870 tx=0x7f529c00ec70 comp rx=0 tx=0).stop 2024-05-04T01:02:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.633+0000 7f52b1773640 1 -- 172.21.15.6:0/1842913669 reap_dead start 2024-05-04T01:02:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.633+0000 7f52b31d6640 1 -- 172.21.15.6:0/1842913669 shutdown_connections 2024-05-04T01:02:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.633+0000 7f52b31d6640 1 -- 172.21.15.6:0/1842913669 >> 172.21.15.6:0/1842913669 conn(0x7f52ac06c780 msgr2=0x7f52ac14a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.633+0000 7f52b31d6640 1 -- 172.21.15.6:0/1842913669 shutdown_connections 2024-05-04T01:02:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.633+0000 7f52b31d6640 1 -- 172.21.15.6:0/1842913669 wait complete. 2024-05-04T01:02:48.667 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-04T01:02:48.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.829+0000 7f6403832640 1 Processor -- start 2024-05-04T01:02:48.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.829+0000 7f6403832640 1 -- start start 2024-05-04T01:02:48.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.829+0000 7f6403832640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f63fc06c8a0 0x7f63fc15ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:48.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.829+0000 7f6403832640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63fc15d1f0 con 0x7f63fc06d670 2024-05-04T01:02:48.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.829+0000 7f6403832640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63fc06cda0 con 0x7f63fc0c91d0 2024-05-04T01:02:48.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.829+0000 7f6403832640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f63fc15f820 con 0x7f63fc06c8a0 2024-05-04T01:02:48.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.833+0000 7f6400dcd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f63fc06d670 0x7f63fc1561a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52094/0 (socket says 172.21.15.6:52094) 2024-05-04T01:02:48.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.833+0000 7f6400dcd640 1 -- 172.21.15.6:0/2830544066 learned_addr learned my addr 172.21.15.6:0/2830544066 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T01:02:48.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.833+0000 7f64015ce640 1 --2- 172.21.15.6:0/2830544066 >> v2:172.21.15.163:3300/0 conn(0x7f63fc06c8a0 0x7f63fc15ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:48.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.833+0000 7f63f3fff640 1 -- 172.21.15.6:0/2830544066 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2882841255 0 0) 0x7f63ec001120 con 0x7f63fc06d670 2024-05-04T01:02:48.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.833+0000 7f63f3fff640 1 -- 172.21.15.6:0/2830544066 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63e8003530 con 0x7f63fc06d670 2024-05-04T01:02:48.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.841+0000 7f63f3fff640 1 -- 172.21.15.6:0/2830544066 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1326916364 0 0) 0x7f63e8003530 con 0x7f63fc06d670 2024-05-04T01:02:48.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.841+0000 7f63f3fff640 1 -- 172.21.15.6:0/2830544066 >> v2:172.21.15.163:3300/0 conn(0x7f63fc06c8a0 msgr2=0x7f63fc15ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:48.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.841+0000 7f63f3fff640 1 --2- 172.21.15.6:0/2830544066 >> v2:172.21.15.163:3300/0 conn(0x7f63fc06c8a0 0x7f63fc15ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:48.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.841+0000 7f63f3fff640 1 -- 172.21.15.6:0/2830544066 >> v1:172.21.15.163:6789/0 conn(0x7f63fc0c91d0 legacy=0x7f63fc0631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:48.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.841+0000 7f63f3fff640 1 -- 172.21.15.6:0/2830544066 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc06d080 con 0x7f63fc06d670 2024-05-04T01:02:48.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.841+0000 7f63f3fff640 1 -- 172.21.15.6:0/2830544066 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 557976392 0 0) 0x7f63ec0018d0 con 0x7f63fc06d670 2024-05-04T01:02:48.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.841+0000 7f63f3fff640 1 -- 172.21.15.6:0/2830544066 >> v1:172.21.15.6:6789/0 conn(0x7f63fc06d670 legacy=0x7f63fc1561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:48.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.841+0000 7f63f3fff640 1 --2- 172.21.15.6:0/2830544066 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f63e8003ab0 0x7f63e8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:48.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.841+0000 7f63f3fff640 1 --2- 172.21.15.6:0/2830544066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63e8004810 0x7f63e8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:48.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.841+0000 7f63f3fff640 1 --2- 172.21.15.6:0/2830544066 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63e80053b0 0x7f63e800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:48.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.841+0000 7f63f3fff640 1 -- 172.21.15.6:0/2830544066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc15f820 con 0x7f63e8004810 2024-05-04T01:02:48.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.841+0000 7f63f3fff640 1 -- 172.21.15.6:0/2830544066 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f63e800c300 con 0x7f63e80053b0 2024-05-04T01:02:48.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.841+0000 7f63f3fff640 1 -- 172.21.15.6:0/2830544066 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f63e800c500 con 0x7f63e8003ab0 2024-05-04T01:02:48.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.841+0000 7f64015ce640 1 --2- 172.21.15.6:0/2830544066 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f63e8003ab0 0x7f63e8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:48.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.845+0000 7f6400dcd640 1 --2- 172.21.15.6:0/2830544066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63e8004810 0x7f63e8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:48.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.849+0000 7f64015ce640 1 -- 172.21.15.6:0/2830544066 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63e80053b0 msgr2=0x7f63e800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:48.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.849+0000 7f64015ce640 1 --2- 172.21.15.6:0/2830544066 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63e80053b0 0x7f63e800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:48.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.849+0000 7f64015ce640 1 -- 172.21.15.6:0/2830544066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63e8004810 msgr2=0x7f63e8004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:48.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.849+0000 7f64015ce640 1 --2- 172.21.15.6:0/2830544066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63e8004810 0x7f63e8004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:48.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.849+0000 7f64015ce640 1 -- 172.21.15.6:0/2830544066 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e8003530 con 0x7f63e8003ab0 2024-05-04T01:02:48.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.849+0000 7f6401dcf640 1 -- 172.21.15.6:0/2830544066 reap_dead start 2024-05-04T01:02:48.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.857+0000 7f64015ce640 1 --2- 172.21.15.6:0/2830544066 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f63e8003ab0 0x7f63e8003f40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f63f800ba30 tx=0x7f63f801c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2bf67c0bd6ed765 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:48.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.873+0000 7f63f3fff640 1 -- 172.21.15.6:0/2830544066 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f80ae070 con 0x7f63e8003ab0 2024-05-04T01:02:48.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.873+0000 7f63f3fff640 1 -- 172.21.15.6:0/2830544066 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f80a9680 con 0x7f63e8003ab0 2024-05-04T01:02:48.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.873+0000 7f63f3fff640 1 -- 172.21.15.6:0/2830544066 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f800b600 con 0x7f63e8003ab0 2024-05-04T01:02:48.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.877+0000 7f6403832640 1 -- 172.21.15.6:0/2830544066 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f63e8003ab0 msgr2=0x7f63e8003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:48.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.877+0000 7f6403832640 1 --2- 172.21.15.6:0/2830544066 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f63e8003ab0 0x7f63e8003f40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f63f800ba30 tx=0x7f63f801c6a0 comp rx=0 tx=0).stop 2024-05-04T01:02:48.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.877+0000 7f6403832640 1 -- 172.21.15.6:0/2830544066 shutdown_connections 2024-05-04T01:02:48.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.877+0000 7f6403832640 1 --2- 172.21.15.6:0/2830544066 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f63e8003ab0 0x7f63e8003f40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:48.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.877+0000 7f6403832640 1 -- 172.21.15.6:0/2830544066 >> 172.21.15.6:0/2830544066 conn(0x7f63fc0ce410 msgr2=0x7f63fc0ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:48.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.877+0000 7f6403832640 1 -- 172.21.15.6:0/2830544066 shutdown_connections 2024-05-04T01:02:48.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.877+0000 7f6403832640 1 -- 172.21.15.6:0/2830544066 wait complete. 2024-05-04T01:02:48.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.877+0000 7f6403832640 1 Processor -- start 2024-05-04T01:02:48.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.877+0000 7f6403832640 1 -- start start 2024-05-04T01:02:48.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.881+0000 7f6403832640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63e8003ab0 0x7f63fc1e73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:48.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.881+0000 7f6403832640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f63fc154120 0x7f63fc1f37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:48.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.881+0000 7f6403832640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63fc1e7d50 0x7f63fc1554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:48.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.881+0000 7f6403832640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc15fd50 con 0x7f63e8003ab0 2024-05-04T01:02:48.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.881+0000 7f6403832640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc1600c0 con 0x7f63fc1e7d50 2024-05-04T01:02:48.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.881+0000 7f6403832640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f63fc0c95e0 con 0x7f63fc154120 2024-05-04T01:02:48.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.881+0000 7f64015ce640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63e8003ab0 0x7f63fc1e73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:48.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.881+0000 7f64015ce640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63e8003ab0 0x7f63fc1e73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50982/0 (socket says 172.21.15.6:50982) 2024-05-04T01:02:48.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.881+0000 7f64015ce640 1 -- 172.21.15.6:0/1381024321 learned_addr learned my addr 172.21.15.6:0/1381024321 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:48.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.881+0000 7f6401dcf640 1 --2- 172.21.15.6:0/1381024321 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63fc1e7d50 0x7f63fc1554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:48.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.881+0000 7f6400dcd640 1 --2- 172.21.15.6:0/1381024321 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f63fc154120 0x7f63fc1f37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:48.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.885+0000 7f64015ce640 1 -- 172.21.15.6:0/1381024321 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f63fc154120 msgr2=0x7f63fc1f37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:48.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.885+0000 7f64015ce640 1 --2- 172.21.15.6:0/1381024321 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f63fc154120 0x7f63fc1f37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:48.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.885+0000 7f64015ce640 1 -- 172.21.15.6:0/1381024321 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63fc1e7d50 msgr2=0x7f63fc1554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:48.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.885+0000 7f64015ce640 1 --2- 172.21.15.6:0/1381024321 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63fc1e7d50 0x7f63fc1554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:48.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.885+0000 7f64015ce640 1 -- 172.21.15.6:0/1381024321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc1f3d10 con 0x7f63e8003ab0 2024-05-04T01:02:48.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.889+0000 7f64015ce640 1 --2- 172.21.15.6:0/1381024321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63e8003ab0 0x7f63fc1e73f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f63f801cb80 tx=0x7f63e8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:48.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.893+0000 7f63f1ffb640 1 -- 172.21.15.6:0/1381024321 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f80ae040 con 0x7f63e8003ab0 2024-05-04T01:02:48.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.893+0000 7f63f1ffb640 1 -- 172.21.15.6:0/1381024321 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f80a9d80 con 0x7f63e8003ab0 2024-05-04T01:02:48.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.893+0000 7f6403832640 1 -- 172.21.15.6:0/1381024321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63fc1539d0 con 0x7f63e8003ab0 2024-05-04T01:02:48.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.893+0000 7f63f1ffb640 1 -- 172.21.15.6:0/1381024321 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f80b3650 con 0x7f63e8003ab0 2024-05-04T01:02:48.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.893+0000 7f6403832640 1 -- 172.21.15.6:0/1381024321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63fc1f2fd0 con 0x7f63e8003ab0 2024-05-04T01:02:48.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:48.893+0000 7f6403832640 1 -- 172.21.15.6:0/1381024321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63fc0703d0 con 0x7f63e8003ab0 2024-05-04T01:02:49.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.217+0000 7f63f1ffb640 1 -- 172.21.15.6:0/1381024321 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f63f80b1070 con 0x7f63e8003ab0 2024-05-04T01:02:49.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.217+0000 7f63f1ffb640 1 --2- 172.21.15.6:0/1381024321 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f63e006f480 0x7f63e0071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.217+0000 7f6400dcd640 1 --2- 172.21.15.6:0/1381024321 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f63e006f480 0x7f63e0071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:49.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.217+0000 7f6400dcd640 1 --2- 172.21.15.6:0/1381024321 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f63e006f480 0x7f63e0071990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f63fc075260 tx=0x7f63ec007a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:49.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.257+0000 7f63f1ffb640 1 -- 172.21.15.6:0/1381024321 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f63f80f3340 con 0x7f63e8003ab0 2024-05-04T01:02:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.261+0000 7f63f1ffb640 1 -- 172.21.15.6:0/1381024321 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f63f80163b0 con 0x7f63e8003ab0 2024-05-04T01:02:49.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.453+0000 7f6403832640 1 -- 172.21.15.6:0/1381024321 --> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f63fc153ef0 con 0x7f63e006f480 2024-05-04T01:02:49.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.453+0000 7f63f1ffb640 1 -- 172.21.15.6:0/1381024321 <== mgr.4103 v2:172.21.15.163:6800/2152694980 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f63fc153ef0 con 0x7f63e006f480 2024-05-04T01:02:49.455 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 5 to deep-scrub 2024-05-04T01:02:49.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.453+0000 7f6403832640 1 -- 172.21.15.6:0/1381024321 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f63e006f480 msgr2=0x7f63e0071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:49.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.453+0000 7f6403832640 1 --2- 172.21.15.6:0/1381024321 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f63e006f480 0x7f63e0071990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f63fc075260 tx=0x7f63ec007a30 comp rx=0 tx=0).stop 2024-05-04T01:02:49.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.453+0000 7f6403832640 1 -- 172.21.15.6:0/1381024321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63e8003ab0 msgr2=0x7f63fc1e73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:49.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.453+0000 7f6403832640 1 --2- 172.21.15.6:0/1381024321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63e8003ab0 0x7f63fc1e73f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f63f801cb80 tx=0x7f63e8005840 comp rx=0 tx=0).stop 2024-05-04T01:02:49.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.453+0000 7f6403832640 1 -- 172.21.15.6:0/1381024321 shutdown_connections 2024-05-04T01:02:49.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.453+0000 7f6403832640 1 --2- 172.21.15.6:0/1381024321 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63fc1e7d50 0x7f63fc1554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:49.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.453+0000 7f6403832640 1 --2- 172.21.15.6:0/1381024321 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f63e006f480 0x7f63e0071990 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:49.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.453+0000 7f6403832640 1 --2- 172.21.15.6:0/1381024321 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f63fc154120 0x7f63fc1f37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:49.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.453+0000 7f6403832640 1 --2- 172.21.15.6:0/1381024321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63e8003ab0 0x7f63fc1e73f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:49.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.453+0000 7f6403832640 1 -- 172.21.15.6:0/1381024321 >> 172.21.15.6:0/1381024321 conn(0x7f63fc0ce410 msgr2=0x7f63fc0cb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:49.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.457+0000 7f6403832640 1 -- 172.21.15.6:0/1381024321 shutdown_connections 2024-05-04T01:02:49.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.457+0000 7f6403832640 1 -- 172.21.15.6:0/1381024321 wait complete. 2024-05-04T01:02:49.481 INFO:tasks.ceph:Scrubbing osd.6 2024-05-04T01:02:49.481 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-04T01:02:49.552 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:32:54.313 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T01:02:49.574 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:32:54.335 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T01:02:49.610 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:32:54.318 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T01:02:49.611 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:32:54.321 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T01:02:49.616 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:32:54.327 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T01:02:49.637 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:32:54.348 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T01:02:49.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.637+0000 7f890b321640 1 Processor -- start 2024-05-04T01:02:49.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.637+0000 7f890b321640 1 -- start start 2024-05-04T01:02:49.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.637+0000 7f890b321640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8904154210 0x7f890415a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:49.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.637+0000 7f890b321640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89040cc080 0x7f89041647d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:49.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.637+0000 7f890b321640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89040c8680 con 0x7f89040cbc70 2024-05-04T01:02:49.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.637+0000 7f890b321640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8904154620 con 0x7f89040cc080 2024-05-04T01:02:49.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.637+0000 7f890b321640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f890415a3d0 con 0x7f8904154210 2024-05-04T01:02:49.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.721+0000 7f89098be640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89040cc080 0x7f89041647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:49.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.733+0000 7f89098be640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89040cc080 0x7f89041647d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50998/0 (socket says 172.21.15.6:50998) 2024-05-04T01:02:49.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.733+0000 7f89098be640 1 -- 172.21.15.6:0/1467347320 learned_addr learned my addr 172.21.15.6:0/1467347320 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:49.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.769+0000 7f89098be640 1 -- 172.21.15.6:0/1467347320 >> v2:172.21.15.163:3300/0 conn(0x7f8904154210 msgr2=0x7f890415a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:49.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.769+0000 7f89098be640 1 --2- 172.21.15.6:0/1467347320 >> v2:172.21.15.163:3300/0 conn(0x7f8904154210 0x7f890415a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:49.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.769+0000 7f89098be640 1 -- 172.21.15.6:0/1467347320 >> v1:172.21.15.163:6789/0 conn(0x7f89040cbc70 legacy=0x7f89040c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:49.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:49.769+0000 7f89098be640 1 -- 172.21.15.6:0/1467347320 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89040c8960 con 0x7f89040cc080 2024-05-04T01:02:49.777 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:32:54.538 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T01:02:49.809 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:32:54.519 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T01:02:49.820 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:32:54.530 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T01:02:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.105+0000 7f89098be640 1 --2- 172.21.15.6:0/1467347320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89040cc080 0x7f89041647d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f890406bb80 tx=0x7f88fc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7716e67726ebb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:50.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.377+0000 7f88fbfff640 1 -- 172.21.15.6:0/1467347320 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc0a5670 con 0x7f89040cc080 2024-05-04T01:02:50.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.377+0000 7f88fbfff640 1 -- 172.21.15.6:0/1467347320 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88fc0a5810 con 0x7f89040cc080 2024-05-04T01:02:50.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.377+0000 7f88fbfff640 1 -- 172.21.15.6:0/1467347320 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc0a5be0 con 0x7f89040cc080 2024-05-04T01:02:50.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.377+0000 7f890b321640 1 -- 172.21.15.6:0/1467347320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89040cc080 msgr2=0x7f89041647d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:50.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.377+0000 7f890b321640 1 --2- 172.21.15.6:0/1467347320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89040cc080 0x7f89041647d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f890406bb80 tx=0x7f88fc01c9f0 comp rx=0 tx=0).stop 2024-05-04T01:02:50.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.377+0000 7f890b321640 1 -- 172.21.15.6:0/1467347320 shutdown_connections 2024-05-04T01:02:50.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.377+0000 7f890b321640 1 --2- 172.21.15.6:0/1467347320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89040cc080 0x7f89041647d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:50.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.377+0000 7f890b321640 1 --2- 172.21.15.6:0/1467347320 >> v2:172.21.15.163:3300/0 conn(0x7f8904154210 0x7f890415a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:50.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.381+0000 7f890b321640 1 -- 172.21.15.6:0/1467347320 >> 172.21.15.6:0/1467347320 conn(0x7f890406c780 msgr2=0x7f890406cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:50.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.381+0000 7f890b321640 1 -- 172.21.15.6:0/1467347320 shutdown_connections 2024-05-04T01:02:50.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.381+0000 7f890b321640 1 -- 172.21.15.6:0/1467347320 wait complete. 2024-05-04T01:02:50.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.385+0000 7f890b321640 1 Processor -- start 2024-05-04T01:02:50.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.385+0000 7f890b321640 1 -- start start 2024-05-04T01:02:50.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.385+0000 7f890b321640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89040cbc70 0x7f89040cd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:50.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.385+0000 7f890b321640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89040cc080 0x7f89040cde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:50.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.385+0000 7f890b321640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8904154210 0x7f8904152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:50.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.385+0000 7f890b321640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f89040c7970 con 0x7f8904154210 2024-05-04T01:02:50.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.385+0000 7f890b321640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f890415ada0 con 0x7f89040cc080 2024-05-04T01:02:50.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.385+0000 7f890b321640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f89040c7af0 con 0x7f89040cbc70 2024-05-04T01:02:50.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.393+0000 7f89090bd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89040cbc70 0x7f89040cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:50.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.397+0000 7f89090bd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89040cbc70 0x7f89040cd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38844/0 (socket says 172.21.15.6:38844) 2024-05-04T01:02:50.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.397+0000 7f89090bd640 1 -- 172.21.15.6:0/4127772837 learned_addr learned my addr 172.21.15.6:0/4127772837 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:50.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.401+0000 7f89098be640 1 --2- 172.21.15.6:0/4127772837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8904154210 0x7f8904152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:50.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.413+0000 7f89090bd640 1 -- 172.21.15.6:0/4127772837 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89040cc080 msgr2=0x7f89040cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:50.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.413+0000 7f89090bd640 1 --2- 172.21.15.6:0/4127772837 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89040cc080 0x7f89040cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:50.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.413+0000 7f89090bd640 1 -- 172.21.15.6:0/4127772837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8904154210 msgr2=0x7f8904152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:50.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.413+0000 7f89090bd640 1 --2- 172.21.15.6:0/4127772837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8904154210 0x7f8904152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:50.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.413+0000 7f89090bd640 1 -- 172.21.15.6:0/4127772837 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89040ce3b0 con 0x7f89040cbc70 2024-05-04T01:02:50.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.449+0000 7f89090bd640 1 --2- 172.21.15.6:0/4127772837 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89040cbc70 0x7f89040cd350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f890000b470 tx=0x7f890000b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:50.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.489+0000 7f88f9ffb640 1 -- 172.21.15.6:0/4127772837 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900015020 con 0x7f89040cbc70 2024-05-04T01:02:50.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.489+0000 7f88f9ffb640 1 -- 172.21.15.6:0/4127772837 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8900011890 con 0x7f89040cbc70 2024-05-04T01:02:50.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.489+0000 7f890b321640 1 -- 172.21.15.6:0/4127772837 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8904162910 con 0x7f89040cbc70 2024-05-04T01:02:50.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.489+0000 7f88f9ffb640 1 -- 172.21.15.6:0/4127772837 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900011c80 con 0x7f89040cbc70 2024-05-04T01:02:50.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.489+0000 7f890b321640 1 -- 172.21.15.6:0/4127772837 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f89041649f0 con 0x7f89040cbc70 2024-05-04T01:02:50.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.493+0000 7f890b321640 1 -- 172.21.15.6:0/4127772837 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8904069a50 con 0x7f89040cbc70 2024-05-04T01:02:50.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.549+0000 7f88f9ffb640 1 -- 172.21.15.6:0/4127772837 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8900018020 con 0x7f89040cbc70 2024-05-04T01:02:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.553+0000 7f88f9ffb640 1 --2- 172.21.15.6:0/4127772837 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f88e806f480 0x7f88e8071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:50.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.553+0000 7f89088bc640 1 --2- 172.21.15.6:0/4127772837 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f88e806f480 0x7f88e8071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:50.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.553+0000 7f89088bc640 1 --2- 172.21.15.6:0/4127772837 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f88e806f480 0x7f88e8071990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f89040b3f30 tx=0x7f88f4006bb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.561+0000 7f88f9ffb640 1 -- 172.21.15.6:0/4127772837 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f8900058490 con 0x7f89040cbc70 2024-05-04T01:02:50.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.561+0000 7f88f9ffb640 1 --2- 172.21.15.6:0/4127772837 >> [v2:172.21.15.163:6810/1460767610,v1:172.21.15.163:6811/1460767610] conn(0x7f88e80776d0 0x7f88e8079b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:50.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.561+0000 7f88f9ffb640 1 -- 172.21.15.6:0/4127772837 --> [v2:172.21.15.163:6810/1460767610,v1:172.21.15.163:6811/1460767610] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88e807a210 con 0x7f88e80776d0 2024-05-04T01:02:50.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.561+0000 7f89098be640 1 --2- 172.21.15.6:0/4127772837 >> [v2:172.21.15.163:6810/1460767610,v1:172.21.15.163:6811/1460767610] conn(0x7f88e80776d0 0x7f88e8079b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:50.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.561+0000 7f89098be640 1 --2- 172.21.15.6:0/4127772837 >> [v2:172.21.15.163:6810/1460767610,v1:172.21.15.163:6811/1460767610] conn(0x7f88e80776d0 0x7f88e8079b40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.565+0000 7f88f9ffb640 1 -- 172.21.15.6:0/4127772837 <== osd.6 v2:172.21.15.163:6810/1460767610 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f88e807a210 con 0x7f88e80776d0 2024-05-04T01:02:50.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.581+0000 7f890b321640 1 -- 172.21.15.6:0/4127772837 --> [v2:172.21.15.163:6810/1460767610,v1:172.21.15.163:6811/1460767610] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f89040746d0 con 0x7f88e80776d0 2024-05-04T01:02:50.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.585+0000 7f88f9ffb640 1 -- 172.21.15.6:0/4127772837 <== osd.6 v2:172.21.15.163:6810/1460767610 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f89040746d0 con 0x7f88e80776d0 2024-05-04T01:02:50.587 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-04T01:02:50.587 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T01:02:50.587 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-04T01:02:50.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.585+0000 7f890b321640 1 -- 172.21.15.6:0/4127772837 >> [v2:172.21.15.163:6810/1460767610,v1:172.21.15.163:6811/1460767610] conn(0x7f88e80776d0 msgr2=0x7f88e8079b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:50.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.585+0000 7f890b321640 1 --2- 172.21.15.6:0/4127772837 >> [v2:172.21.15.163:6810/1460767610,v1:172.21.15.163:6811/1460767610] conn(0x7f88e80776d0 0x7f88e8079b40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:50.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.585+0000 7f890b321640 1 -- 172.21.15.6:0/4127772837 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f88e806f480 msgr2=0x7f88e8071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:50.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.585+0000 7f890b321640 1 --2- 172.21.15.6:0/4127772837 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f88e806f480 0x7f88e8071990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f89040b3f30 tx=0x7f88f4006bb0 comp rx=0 tx=0).stop 2024-05-04T01:02:50.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.585+0000 7f890b321640 1 -- 172.21.15.6:0/4127772837 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89040cbc70 msgr2=0x7f89040cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:50.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.585+0000 7f890b321640 1 --2- 172.21.15.6:0/4127772837 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89040cbc70 0x7f89040cd350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f890000b470 tx=0x7f890000b930 comp rx=0 tx=0).stop 2024-05-04T01:02:50.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.585+0000 7f89098be640 1 -- 172.21.15.6:0/4127772837 reap_dead start 2024-05-04T01:02:50.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.585+0000 7f890b321640 1 -- 172.21.15.6:0/4127772837 shutdown_connections 2024-05-04T01:02:50.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.585+0000 7f890b321640 1 -- 172.21.15.6:0/4127772837 >> 172.21.15.6:0/4127772837 conn(0x7f890406c780 msgr2=0x7f8904073070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:50.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.585+0000 7f890b321640 1 -- 172.21.15.6:0/4127772837 shutdown_connections 2024-05-04T01:02:50.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.585+0000 7f890b321640 1 -- 172.21.15.6:0/4127772837 wait complete. 2024-05-04T01:02:50.619 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-04T01:02:50.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.781+0000 7f78aa291640 1 Processor -- start 2024-05-04T01:02:50.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.781+0000 7f78aa291640 1 -- start start 2024-05-04T01:02:50.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.781+0000 7f78aa291640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78a40b2fb0 0x7f78a4156320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:50.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.781+0000 7f78aa291640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a40cc850 con 0x7f78a40caf00 2024-05-04T01:02:50.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.781+0000 7f78aa291640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a4156860 con 0x7f78a40c8e50 2024-05-04T01:02:50.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.781+0000 7f78aa291640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f78a406d560 con 0x7f78a40b2fb0 2024-05-04T01:02:50.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.785+0000 7f78a3fff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78a40b2fb0 0x7f78a4156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:50.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.785+0000 7f78a882e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f78a40caf00 0x7f78a41669e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52110/0 (socket says 172.21.15.6:52110) 2024-05-04T01:02:50.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.785+0000 7f78a882e640 1 -- 172.21.15.6:0/688227559 learned_addr learned my addr 172.21.15.6:0/688227559 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T01:02:50.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.789+0000 7f78a2ffd640 1 -- 172.21.15.6:0/688227559 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3386199656 0 0) 0x7f78a40cc850 con 0x7f78a40caf00 2024-05-04T01:02:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.789+0000 7f78a2ffd640 1 -- 172.21.15.6:0/688227559 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f788c003530 con 0x7f78a40caf00 2024-05-04T01:02:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.789+0000 7f78a3fff640 1 -- 172.21.15.6:0/688227559 >> v1:172.21.15.163:6789/0 conn(0x7f78a40c8e50 legacy=0x7f78a40ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.789+0000 7f78a3fff640 1 -- 172.21.15.6:0/688227559 >> v1:172.21.15.6:6789/0 conn(0x7f78a40caf00 legacy=0x7f78a41669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:50.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.789+0000 7f78a3fff640 1 -- 172.21.15.6:0/688227559 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a40cdbe0 con 0x7f78a40b2fb0 2024-05-04T01:02:50.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.793+0000 7f78a3fff640 1 --2- 172.21.15.6:0/688227559 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78a40b2fb0 0x7f78a4156320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f78940097f0 tx=0x7f789401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2f56e97f28cd6c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.801+0000 7f78a2ffd640 1 -- 172.21.15.6:0/688227559 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78940b0070 con 0x7f78a40b2fb0 2024-05-04T01:02:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.801+0000 7f78a2ffd640 1 -- 172.21.15.6:0/688227559 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78940ab600 con 0x7f78a40b2fb0 2024-05-04T01:02:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.801+0000 7f78a2ffd640 1 -- 172.21.15.6:0/688227559 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78940ab9d0 con 0x7f78a40b2fb0 2024-05-04T01:02:50.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.805+0000 7f78aa291640 1 -- 172.21.15.6:0/688227559 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78a40b2fb0 msgr2=0x7f78a4156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:50.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.805+0000 7f78aa291640 1 --2- 172.21.15.6:0/688227559 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78a40b2fb0 0x7f78a4156320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f78940097f0 tx=0x7f789401c450 comp rx=0 tx=0).stop 2024-05-04T01:02:50.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.805+0000 7f78aa291640 1 -- 172.21.15.6:0/688227559 shutdown_connections 2024-05-04T01:02:50.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.805+0000 7f78aa291640 1 --2- 172.21.15.6:0/688227559 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78a40b2fb0 0x7f78a4156320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:50.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.805+0000 7f78aa291640 1 -- 172.21.15.6:0/688227559 >> 172.21.15.6:0/688227559 conn(0x7f78a406f1a0 msgr2=0x7f78a406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:50.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.805+0000 7f78aa291640 1 -- 172.21.15.6:0/688227559 shutdown_connections 2024-05-04T01:02:50.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.805+0000 7f78aa291640 1 -- 172.21.15.6:0/688227559 wait complete. 2024-05-04T01:02:50.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.805+0000 7f78aa291640 1 Processor -- start 2024-05-04T01:02:50.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.805+0000 7f78aa291640 1 -- start start 2024-05-04T01:02:50.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.809+0000 7f78aa291640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78a40b2fb0 0x7f78a414b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:50.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.809+0000 7f78aa291640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78a40c8e50 0x7f78a415a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:50.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.809+0000 7f78aa291640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78a4149250 0x7f78a4140720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:50.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.809+0000 7f78aa291640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f78a40b33c0 con 0x7f78a4149250 2024-05-04T01:02:50.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.809+0000 7f78aa291640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f78a40c8930 con 0x7f78a40b2fb0 2024-05-04T01:02:50.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.809+0000 7f78aa291640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f78a40cc210 con 0x7f78a40c8e50 2024-05-04T01:02:50.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.809+0000 7f78a37fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78a40c8e50 0x7f78a415a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:50.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.809+0000 7f78a37fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78a40c8e50 0x7f78a415a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:38850/0 (socket says 172.21.15.6:38850) 2024-05-04T01:02:50.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.809+0000 7f78a37fe640 1 -- 172.21.15.6:0/2565985858 learned_addr learned my addr 172.21.15.6:0/2565985858 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:50.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.813+0000 7f78a3fff640 1 --2- 172.21.15.6:0/2565985858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78a40b2fb0 0x7f78a414b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:50.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.817+0000 7f78a37fe640 1 -- 172.21.15.6:0/2565985858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78a40b2fb0 msgr2=0x7f78a414b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:50.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.817+0000 7f78a37fe640 1 --2- 172.21.15.6:0/2565985858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78a40b2fb0 0x7f78a414b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:50.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.817+0000 7f78a37fe640 1 -- 172.21.15.6:0/2565985858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78a4149250 msgr2=0x7f78a4140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:50.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.817+0000 7f78a37fe640 1 --2- 172.21.15.6:0/2565985858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78a4149250 0x7f78a4140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:50.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.817+0000 7f78a37fe640 1 -- 172.21.15.6:0/2565985858 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a414a9a0 con 0x7f78a40c8e50 2024-05-04T01:02:50.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.825+0000 7f78a37fe640 1 --2- 172.21.15.6:0/2565985858 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78a40c8e50 0x7f78a415a650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f789800b410 tx=0x7f789800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:50.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.833+0000 7f78a0ff9640 1 -- 172.21.15.6:0/2565985858 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898015020 con 0x7f78a40c8e50 2024-05-04T01:02:50.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.833+0000 7f78a0ff9640 1 -- 172.21.15.6:0/2565985858 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7898011830 con 0x7f78a40c8e50 2024-05-04T01:02:50.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.833+0000 7f78a0ff9640 1 -- 172.21.15.6:0/2565985858 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898011c20 con 0x7f78a40c8e50 2024-05-04T01:02:50.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.833+0000 7f78aa291640 1 -- 172.21.15.6:0/2565985858 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a414a6c0 con 0x7f78a40c8e50 2024-05-04T01:02:50.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.833+0000 7f78aa291640 1 -- 172.21.15.6:0/2565985858 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a4145800 con 0x7f78a40c8e50 2024-05-04T01:02:50.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:50.833+0000 7f78aa291640 1 -- 172.21.15.6:0/2565985858 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a406d710 con 0x7f78a40c8e50 2024-05-04T01:02:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.181+0000 7f78a0ff9640 1 -- 172.21.15.6:0/2565985858 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7898018020 con 0x7f78a40c8e50 2024-05-04T01:02:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.185+0000 7f78a0ff9640 1 --2- 172.21.15.6:0/2565985858 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f789006f430 0x7f7890071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.185+0000 7f78a3fff640 1 --2- 172.21.15.6:0/2565985858 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f789006f430 0x7f7890071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:51.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.185+0000 7f78a3fff640 1 --2- 172.21.15.6:0/2565985858 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f789006f430 0x7f7890071940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f78940ad000 tx=0x7f78940a4f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:51.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.189+0000 7f78a0ff9640 1 -- 172.21.15.6:0/2565985858 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f7898011dc0 con 0x7f78a40c8e50 2024-05-04T01:02:51.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.213+0000 7f78a0ff9640 1 -- 172.21.15.6:0/2565985858 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f789801f070 con 0x7f78a40c8e50 2024-05-04T01:02:51.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.397+0000 7f78aa291640 1 -- 172.21.15.6:0/2565985858 --> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f78a414a450 con 0x7f789006f430 2024-05-04T01:02:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.401+0000 7f78a0ff9640 1 -- 172.21.15.6:0/2565985858 <== mgr.4103 v2:172.21.15.163:6800/2152694980 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f78a414a450 con 0x7f789006f430 2024-05-04T01:02:51.403 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 6 to deep-scrub 2024-05-04T01:02:51.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.401+0000 7f78aa291640 1 -- 172.21.15.6:0/2565985858 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f789006f430 msgr2=0x7f7890071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:51.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.401+0000 7f78aa291640 1 --2- 172.21.15.6:0/2565985858 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f789006f430 0x7f7890071940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f78940ad000 tx=0x7f78940a4f90 comp rx=0 tx=0).stop 2024-05-04T01:02:51.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.401+0000 7f78aa291640 1 -- 172.21.15.6:0/2565985858 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78a40c8e50 msgr2=0x7f78a415a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:51.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.401+0000 7f78aa291640 1 --2- 172.21.15.6:0/2565985858 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78a40c8e50 0x7f78a415a650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f789800b410 tx=0x7f789800b8d0 comp rx=0 tx=0).stop 2024-05-04T01:02:51.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.401+0000 7f78aa291640 1 -- 172.21.15.6:0/2565985858 shutdown_connections 2024-05-04T01:02:51.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.401+0000 7f78aa291640 1 --2- 172.21.15.6:0/2565985858 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f789006f430 0x7f7890071940 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:51.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.401+0000 7f78aa291640 1 --2- 172.21.15.6:0/2565985858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78a4149250 0x7f78a4140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:51.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.401+0000 7f78aa291640 1 --2- 172.21.15.6:0/2565985858 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78a40c8e50 0x7f78a415a650 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:51.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.401+0000 7f78aa291640 1 --2- 172.21.15.6:0/2565985858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78a40b2fb0 0x7f78a414b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:51.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.401+0000 7f78aa291640 1 -- 172.21.15.6:0/2565985858 >> 172.21.15.6:0/2565985858 conn(0x7f78a406f1a0 msgr2=0x7f78a4155580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:51.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.401+0000 7f78aa291640 1 -- 172.21.15.6:0/2565985858 shutdown_connections 2024-05-04T01:02:51.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.401+0000 7f78aa291640 1 -- 172.21.15.6:0/2565985858 wait complete. 2024-05-04T01:02:51.427 INFO:tasks.ceph:Scrubbing osd.7 2024-05-04T01:02:51.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-04T01:02:51.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.585+0000 7f865aeaa640 1 Processor -- start 2024-05-04T01:02:51.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.585+0000 7f865aeaa640 1 -- start start 2024-05-04T01:02:51.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.589+0000 7f865aeaa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f86540c7090 0x7f865406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:51.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.589+0000 7f865aeaa640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f86540c74a0 0x7f865406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:51.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.589+0000 7f865aeaa640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8654074900 con 0x7f86540c5210 2024-05-04T01:02:51.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.589+0000 7f865aeaa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f86540c6c00 con 0x7f86540c7090 2024-05-04T01:02:51.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.589+0000 7f865aeaa640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f86540c9020 con 0x7f86540c74a0 2024-05-04T01:02:51.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.589+0000 7f8653fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f86540c7090 0x7f865406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:51.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.589+0000 7f8653fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f86540c7090 0x7f865406d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51026/0 (socket says 172.21.15.6:51026) 2024-05-04T01:02:51.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.589+0000 7f8653fff640 1 -- 172.21.15.6:0/3252917245 learned_addr learned my addr 172.21.15.6:0/3252917245 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:51.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.589+0000 7f8659447640 1 --2- 172.21.15.6:0/3252917245 >> v2:172.21.15.163:3300/0 conn(0x7f86540c74a0 0x7f865406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:51.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.593+0000 7f8653fff640 1 -- 172.21.15.6:0/3252917245 >> v2:172.21.15.163:3300/0 conn(0x7f86540c74a0 msgr2=0x7f865406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:51.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.593+0000 7f8653fff640 1 --2- 172.21.15.6:0/3252917245 >> v2:172.21.15.163:3300/0 conn(0x7f86540c74a0 0x7f865406d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:51.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.593+0000 7f8653fff640 1 -- 172.21.15.6:0/3252917245 >> v1:172.21.15.163:6789/0 conn(0x7f86540c5210 legacy=0x7f86541531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:51.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.593+0000 7f8653fff640 1 -- 172.21.15.6:0/3252917245 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86540c9300 con 0x7f86540c7090 2024-05-04T01:02:51.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.601+0000 7f8653fff640 1 --2- 172.21.15.6:0/3252917245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86540c7090 0x7f865406d2a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f86540cae60 tx=0x7f86400213e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ac7f603f0d9771 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:51.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.609+0000 7f86537fe640 1 -- 172.21.15.6:0/3252917245 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86400b6070 con 0x7f86540c7090 2024-05-04T01:02:51.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.609+0000 7f86537fe640 1 -- 172.21.15.6:0/3252917245 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86400b1600 con 0x7f86540c7090 2024-05-04T01:02:51.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.609+0000 7f86537fe640 1 -- 172.21.15.6:0/3252917245 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86400b19d0 con 0x7f86540c7090 2024-05-04T01:02:51.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.609+0000 7f865aeaa640 1 -- 172.21.15.6:0/3252917245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86540c7090 msgr2=0x7f865406d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:51.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.609+0000 7f865aeaa640 1 --2- 172.21.15.6:0/3252917245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86540c7090 0x7f865406d2a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f86540cae60 tx=0x7f86400213e0 comp rx=0 tx=0).stop 2024-05-04T01:02:51.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.609+0000 7f865aeaa640 1 -- 172.21.15.6:0/3252917245 shutdown_connections 2024-05-04T01:02:51.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.609+0000 7f865aeaa640 1 --2- 172.21.15.6:0/3252917245 >> v2:172.21.15.163:3300/0 conn(0x7f86540c74a0 0x7f865406d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:51.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.609+0000 7f865aeaa640 1 --2- 172.21.15.6:0/3252917245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86540c7090 0x7f865406d2a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:51.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.609+0000 7f865aeaa640 1 -- 172.21.15.6:0/3252917245 >> 172.21.15.6:0/3252917245 conn(0x7f865406c780 msgr2=0x7f865406cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:51.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.609+0000 7f865aeaa640 1 -- 172.21.15.6:0/3252917245 shutdown_connections 2024-05-04T01:02:51.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.609+0000 7f865aeaa640 1 -- 172.21.15.6:0/3252917245 wait complete. 2024-05-04T01:02:51.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.609+0000 7f865aeaa640 1 Processor -- start 2024-05-04T01:02:51.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.609+0000 7f865aeaa640 1 -- start start 2024-05-04T01:02:51.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.613+0000 7f865aeaa640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86540c5210 0x7f86541ee460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:51.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.613+0000 7f865aeaa640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86540c7090 0x7f86541526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:51.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.613+0000 7f865aeaa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86540c74a0 0x7f86541540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:51.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.613+0000 7f865aeaa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f86540c9960 con 0x7f86540c74a0 2024-05-04T01:02:51.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.613+0000 7f865aeaa640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f86540c97e0 con 0x7f86540c5210 2024-05-04T01:02:51.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.613+0000 7f865aeaa640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f8654070f70 con 0x7f86540c7090 2024-05-04T01:02:51.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.613+0000 7f8659447640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86540c74a0 0x7f86541540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:51.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.613+0000 7f8658c46640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86540c5210 0x7f86541ee460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:51.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.613+0000 7f8653fff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86540c7090 0x7f86541526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:51.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.613+0000 7f8658c46640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86540c5210 0x7f86541ee460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.6:46940/0 (socket says 172.21.15.6:46940) 2024-05-04T01:02:51.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.613+0000 7f8658c46640 1 -- 172.21.15.6:0/1726519192 learned_addr learned my addr 172.21.15.6:0/1726519192 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.625+0000 7f8653fff640 1 -- 172.21.15.6:0/1726519192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86540c5210 msgr2=0x7f86541ee460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.625+0000 7f8653fff640 1 --2- 172.21.15.6:0/1726519192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86540c5210 0x7f86541ee460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.625+0000 7f8653fff640 1 -- 172.21.15.6:0/1726519192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86540c74a0 msgr2=0x7f86541540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.625+0000 7f8653fff640 1 --2- 172.21.15.6:0/1726519192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86540c74a0 0x7f86541540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:51.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.625+0000 7f8653fff640 1 -- 172.21.15.6:0/1726519192 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8654151650 con 0x7f86540c7090 2024-05-04T01:02:51.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.625+0000 7f8659447640 1 --2- 172.21.15.6:0/1726519192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86540c74a0 0x7f86541540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T01:02:51.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.641+0000 7f8653fff640 1 --2- 172.21.15.6:0/1726519192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86540c7090 0x7f86541526f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f86400b1000 tx=0x7f864001e180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:51.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.657+0000 7f86517fa640 1 -- 172.21.15.6:0/1726519192 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86400b6040 con 0x7f86540c7090 2024-05-04T01:02:51.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.657+0000 7f86517fa640 1 -- 172.21.15.6:0/1726519192 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86400c3070 con 0x7f86540c7090 2024-05-04T01:02:51.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.657+0000 7f865aeaa640 1 -- 172.21.15.6:0/1726519192 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8654151930 con 0x7f86540c7090 2024-05-04T01:02:51.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.657+0000 7f86517fa640 1 -- 172.21.15.6:0/1726519192 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86400bc690 con 0x7f86540c7090 2024-05-04T01:02:51.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.657+0000 7f865aeaa640 1 -- 172.21.15.6:0/1726519192 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8654151ef0 con 0x7f86540c7090 2024-05-04T01:02:51.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.657+0000 7f865aeaa640 1 -- 172.21.15.6:0/1726519192 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f865406a400 con 0x7f86540c7090 2024-05-04T01:02:51.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.745+0000 7f86517fa640 1 -- 172.21.15.6:0/1726519192 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f86400bc830 con 0x7f86540c7090 2024-05-04T01:02:51.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.745+0000 7f86517fa640 1 --2- 172.21.15.6:0/1726519192 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f863806f450 0x7f8638071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:51.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.745+0000 7f8658c46640 1 --2- 172.21.15.6:0/1726519192 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f863806f450 0x7f8638071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:51.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.745+0000 7f8658c46640 1 --2- 172.21.15.6:0/1726519192 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f863806f450 0x7f8638071960 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8648001870 tx=0x7f8648009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:51.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.749+0000 7f86517fa640 1 -- 172.21.15.6:0/1726519192 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f86400f93b0 con 0x7f86540c7090 2024-05-04T01:02:51.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.749+0000 7f86517fa640 1 --2- 172.21.15.6:0/1726519192 >> [v2:172.21.15.163:6802/239650691,v1:172.21.15.163:6803/239650691] conn(0x7f8638077700 0x7f8638079b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:51.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.749+0000 7f86517fa640 1 -- 172.21.15.6:0/1726519192 --> [v2:172.21.15.163:6802/239650691,v1:172.21.15.163:6803/239650691] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86400b1600 con 0x7f8638077700 2024-05-04T01:02:51.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.749+0000 7f8659447640 1 --2- 172.21.15.6:0/1726519192 >> [v2:172.21.15.163:6802/239650691,v1:172.21.15.163:6803/239650691] conn(0x7f8638077700 0x7f8638079b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.753+0000 7f8659447640 1 --2- 172.21.15.6:0/1726519192 >> [v2:172.21.15.163:6802/239650691,v1:172.21.15.163:6803/239650691] conn(0x7f8638077700 0x7f8638079b70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.753+0000 7f86517fa640 1 -- 172.21.15.6:0/1726519192 <== osd.7 v2:172.21.15.163:6802/239650691 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f86400b1600 con 0x7f8638077700 2024-05-04T01:02:51.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.769+0000 7f865aeaa640 1 -- 172.21.15.6:0/1726519192 --> [v2:172.21.15.163:6802/239650691,v1:172.21.15.163:6803/239650691] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f86541513e0 con 0x7f8638077700 2024-05-04T01:02:51.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.769+0000 7f86517fa640 1 -- 172.21.15.6:0/1726519192 <== osd.7 v2:172.21.15.163:6802/239650691 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f86541513e0 con 0x7f8638077700 2024-05-04T01:02:51.771 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-04T01:02:51.772 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T01:02:51.772 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-04T01:02:51.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.769+0000 7f865aeaa640 1 -- 172.21.15.6:0/1726519192 >> [v2:172.21.15.163:6802/239650691,v1:172.21.15.163:6803/239650691] conn(0x7f8638077700 msgr2=0x7f8638079b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:51.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.769+0000 7f865aeaa640 1 --2- 172.21.15.6:0/1726519192 >> [v2:172.21.15.163:6802/239650691,v1:172.21.15.163:6803/239650691] conn(0x7f8638077700 0x7f8638079b70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:51.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.769+0000 7f865aeaa640 1 -- 172.21.15.6:0/1726519192 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f863806f450 msgr2=0x7f8638071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:51.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.769+0000 7f865aeaa640 1 --2- 172.21.15.6:0/1726519192 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f863806f450 0x7f8638071960 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8648001870 tx=0x7f8648009040 comp rx=0 tx=0).stop 2024-05-04T01:02:51.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.769+0000 7f865aeaa640 1 -- 172.21.15.6:0/1726519192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86540c7090 msgr2=0x7f86541526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:51.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.769+0000 7f865aeaa640 1 --2- 172.21.15.6:0/1726519192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86540c7090 0x7f86541526f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f86400b1000 tx=0x7f864001e180 comp rx=0 tx=0).stop 2024-05-04T01:02:51.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.769+0000 7f8659447640 1 -- 172.21.15.6:0/1726519192 reap_dead start 2024-05-04T01:02:51.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.769+0000 7f865aeaa640 1 -- 172.21.15.6:0/1726519192 shutdown_connections 2024-05-04T01:02:51.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.769+0000 7f865aeaa640 1 -- 172.21.15.6:0/1726519192 >> 172.21.15.6:0/1726519192 conn(0x7f865406c780 msgr2=0x7f865414b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:51.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.769+0000 7f865aeaa640 1 -- 172.21.15.6:0/1726519192 shutdown_connections 2024-05-04T01:02:51.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.769+0000 7f865aeaa640 1 -- 172.21.15.6:0/1726519192 wait complete. 2024-05-04T01:02:51.799 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-04T01:02:51.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.965+0000 7f8b23f34640 1 Processor -- start 2024-05-04T01:02:51.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.965+0000 7f8b23f34640 1 -- start start 2024-05-04T01:02:51.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.969+0000 7f8b23f34640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b1c152d60 0x7f8b1c1591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:51.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.969+0000 7f8b23f34640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8b1c0cdb30 0x7f8b1c0cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:51.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.969+0000 7f8b23f34640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b1c074870 con 0x7f8b1c15be00 2024-05-04T01:02:51.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.969+0000 7f8b23f34640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8b1c0c9720 con 0x7f8b1c152d60 2024-05-04T01:02:51.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.969+0000 7f8b23f34640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f8b1c074b10 con 0x7f8b1c0cdb30 2024-05-04T01:02:51.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.969+0000 7f8b224d1640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f8b1c15be00 0x7f8b1c15c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:49722/0 (socket says 172.21.15.6:49722) 2024-05-04T01:02:51.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.969+0000 7f8b224d1640 1 -- 172.21.15.6:0/2686774565 learned_addr learned my addr 172.21.15.6:0/2686774565 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T01:02:51.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.969+0000 7f8b214cf640 1 --2- 172.21.15.6:0/2686774565 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8b1c0cdb30 0x7f8b1c0cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:51.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.977+0000 7f8b20cce640 1 -- 172.21.15.6:0/2686774565 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 567886762 0 0) 0x7f8b1c074870 con 0x7f8b1c15be00 2024-05-04T01:02:51.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.977+0000 7f8b20cce640 1 -- 172.21.15.6:0/2686774565 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b08003530 con 0x7f8b1c15be00 2024-05-04T01:02:51.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.977+0000 7f8b214cf640 1 -- 172.21.15.6:0/2686774565 >> v2:172.21.15.6:3300/0 conn(0x7f8b1c152d60 msgr2=0x7f8b1c1591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:51.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.977+0000 7f8b214cf640 1 --2- 172.21.15.6:0/2686774565 >> v2:172.21.15.6:3300/0 conn(0x7f8b1c152d60 0x7f8b1c1591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:51.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.977+0000 7f8b214cf640 1 -- 172.21.15.6:0/2686774565 >> v1:172.21.15.163:6789/0 conn(0x7f8b1c15be00 legacy=0x7f8b1c15c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:51.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.977+0000 7f8b214cf640 1 -- 172.21.15.6:0/2686774565 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1c074df0 con 0x7f8b1c0cdb30 2024-05-04T01:02:51.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.985+0000 7f8b214cf640 1 --2- 172.21.15.6:0/2686774565 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8b1c0cdb30 0x7f8b1c0cdf40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0097c0 tx=0x7f8b0c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=945fa6c0d5fd5a87 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:51.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.993+0000 7f8b20cce640 1 -- 172.21.15.6:0/2686774565 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0b5070 con 0x7f8b1c0cdb30 2024-05-04T01:02:51.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.997+0000 7f8b20cce640 1 -- 172.21.15.6:0/2686774565 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b0c0a8990 con 0x7f8b1c0cdb30 2024-05-04T01:02:51.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.997+0000 7f8b20cce640 1 -- 172.21.15.6:0/2686774565 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0a8d60 con 0x7f8b1c0cdb30 2024-05-04T01:02:52.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.997+0000 7f8b23f34640 1 -- 172.21.15.6:0/2686774565 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8b1c0cdb30 msgr2=0x7f8b1c0cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:52.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.997+0000 7f8b23f34640 1 --2- 172.21.15.6:0/2686774565 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8b1c0cdb30 0x7f8b1c0cdf40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0097c0 tx=0x7f8b0c01ec90 comp rx=0 tx=0).stop 2024-05-04T01:02:52.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.997+0000 7f8b23f34640 1 -- 172.21.15.6:0/2686774565 shutdown_connections 2024-05-04T01:02:52.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.997+0000 7f8b23f34640 1 --2- 172.21.15.6:0/2686774565 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8b1c0cdb30 0x7f8b1c0cdf40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:52.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.997+0000 7f8b23f34640 1 --2- 172.21.15.6:0/2686774565 >> v2:172.21.15.6:3300/0 conn(0x7f8b1c152d60 0x7f8b1c1591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:52.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.997+0000 7f8b23f34640 1 -- 172.21.15.6:0/2686774565 >> 172.21.15.6:0/2686774565 conn(0x7f8b1c070f30 msgr2=0x7f8b1c071340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:52.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.997+0000 7f8b23f34640 1 -- 172.21.15.6:0/2686774565 shutdown_connections 2024-05-04T01:02:52.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.997+0000 7f8b23f34640 1 -- 172.21.15.6:0/2686774565 wait complete. 2024-05-04T01:02:52.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.997+0000 7f8b23f34640 1 Processor -- start 2024-05-04T01:02:52.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:51.997+0000 7f8b23f34640 1 -- start start 2024-05-04T01:02:52.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.001+0000 7f8b23f34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0cdb30 0x7f8b1c141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:52.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.001+0000 7f8b23f34640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8b1c152d60 0x7f8b1c13e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:52.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.001+0000 7f8b23f34640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b1c15be00 0x7f8b1c13ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:52.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.001+0000 7f8b23f34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c0c99e0 con 0x7f8b1c0cdb30 2024-05-04T01:02:52.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.001+0000 7f8b23f34640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c158c80 con 0x7f8b1c15be00 2024-05-04T01:02:52.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.001+0000 7f8b23f34640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f8b1c0cac50 con 0x7f8b1c152d60 2024-05-04T01:02:52.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.001+0000 7f8b21cd0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0cdb30 0x7f8b1c141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:52.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.001+0000 7f8b21cd0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0cdb30 0x7f8b1c141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51050/0 (socket says 172.21.15.6:51050) 2024-05-04T01:02:52.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.001+0000 7f8b21cd0640 1 -- 172.21.15.6:0/3260235397 learned_addr learned my addr 172.21.15.6:0/3260235397 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:52.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.001+0000 7f8b224d1640 1 --2- 172.21.15.6:0/3260235397 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b1c15be00 0x7f8b1c13ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:52.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.001+0000 7f8b214cf640 1 --2- 172.21.15.6:0/3260235397 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8b1c152d60 0x7f8b1c13e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:52.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.005+0000 7f8b21cd0640 1 -- 172.21.15.6:0/3260235397 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8b1c152d60 msgr2=0x7f8b1c13e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:52.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.005+0000 7f8b21cd0640 1 --2- 172.21.15.6:0/3260235397 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8b1c152d60 0x7f8b1c13e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:52.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.005+0000 7f8b21cd0640 1 -- 172.21.15.6:0/3260235397 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b1c15be00 msgr2=0x7f8b1c13ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:52.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.005+0000 7f8b21cd0640 1 --2- 172.21.15.6:0/3260235397 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b1c15be00 0x7f8b1c13ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:52.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.005+0000 7f8b21cd0640 1 -- 172.21.15.6:0/3260235397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1c1424e0 con 0x7f8b1c0cdb30 2024-05-04T01:02:52.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.009+0000 7f8b21cd0640 1 --2- 172.21.15.6:0/3260235397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0cdb30 0x7f8b1c141fa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800b440 tx=0x7f8b1800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:52.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.013+0000 7f8b127fc640 1 -- 172.21.15.6:0/3260235397 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b18015020 con 0x7f8b1c0cdb30 2024-05-04T01:02:52.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.013+0000 7f8b127fc640 1 -- 172.21.15.6:0/3260235397 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b180118b0 con 0x7f8b1c0cdb30 2024-05-04T01:02:52.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.013+0000 7f8b127fc640 1 -- 172.21.15.6:0/3260235397 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b18011ca0 con 0x7f8b1c0cdb30 2024-05-04T01:02:52.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.013+0000 7f8b23f34640 1 -- 172.21.15.6:0/3260235397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b1c1405e0 con 0x7f8b1c0cdb30 2024-05-04T01:02:52.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.013+0000 7f8b23f34640 1 -- 172.21.15.6:0/3260235397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b1c140ba0 con 0x7f8b1c0cdb30 2024-05-04T01:02:52.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.017+0000 7f8b23f34640 1 -- 172.21.15.6:0/3260235397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b1c069a50 con 0x7f8b1c0cdb30 2024-05-04T01:02:52.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.045+0000 7f8b127fc640 1 -- 172.21.15.6:0/3260235397 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8b18018020 con 0x7f8b1c0cdb30 2024-05-04T01:02:52.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.045+0000 7f8b127fc640 1 --2- 172.21.15.6:0/3260235397 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8b0006f450 0x7f8b00071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:52.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.045+0000 7f8b214cf640 1 --2- 172.21.15.6:0/3260235397 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8b0006f450 0x7f8b00071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:52.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.045+0000 7f8b214cf640 1 --2- 172.21.15.6:0/3260235397 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8b0006f450 0x7f8b00071960 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0b2000 tx=0x7f8b0c0aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.401+0000 7f8b127fc640 1 -- 172.21.15.6:0/3260235397 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f8b180583d0 con 0x7f8b1c0cdb30 2024-05-04T01:02:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.401+0000 7f8b127fc640 1 -- 172.21.15.6:0/3260235397 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8b1801f020 con 0x7f8b1c0cdb30 2024-05-04T01:02:52.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.605+0000 7f8b23f34640 1 -- 172.21.15.6:0/3260235397 --> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f8b1c145880 con 0x7f8b0006f450 2024-05-04T01:02:52.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.609+0000 7f8b127fc640 1 -- 172.21.15.6:0/3260235397 <== mgr.4103 v2:172.21.15.163:6800/2152694980 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8b0c0a8a30 con 0x7f8b0006f450 2024-05-04T01:02:52.610 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 7 to deep-scrub 2024-05-04T01:02:52.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.609+0000 7f8b23f34640 1 -- 172.21.15.6:0/3260235397 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8b0006f450 msgr2=0x7f8b00071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:52.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.609+0000 7f8b23f34640 1 --2- 172.21.15.6:0/3260235397 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8b0006f450 0x7f8b00071960 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0b2000 tx=0x7f8b0c0aa070 comp rx=0 tx=0).stop 2024-05-04T01:02:52.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.609+0000 7f8b23f34640 1 -- 172.21.15.6:0/3260235397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0cdb30 msgr2=0x7f8b1c141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:52.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.609+0000 7f8b23f34640 1 --2- 172.21.15.6:0/3260235397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0cdb30 0x7f8b1c141fa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800b440 tx=0x7f8b1800b900 comp rx=0 tx=0).stop 2024-05-04T01:02:52.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.609+0000 7f8b23f34640 1 -- 172.21.15.6:0/3260235397 shutdown_connections 2024-05-04T01:02:52.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.609+0000 7f8b23f34640 1 --2- 172.21.15.6:0/3260235397 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b1c15be00 0x7f8b1c13ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:52.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.609+0000 7f8b23f34640 1 --2- 172.21.15.6:0/3260235397 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f8b0006f450 0x7f8b00071960 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.609+0000 7f8b23f34640 1 --2- 172.21.15.6:0/3260235397 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8b1c152d60 0x7f8b1c13e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.609+0000 7f8b23f34640 1 --2- 172.21.15.6:0/3260235397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0cdb30 0x7f8b1c141fa0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.609+0000 7f8b23f34640 1 -- 172.21.15.6:0/3260235397 >> 172.21.15.6:0/3260235397 conn(0x7f8b1c070f30 msgr2=0x7f8b1c0c72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.609+0000 7f8b23f34640 1 -- 172.21.15.6:0/3260235397 shutdown_connections 2024-05-04T01:02:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.609+0000 7f8b23f34640 1 -- 172.21.15.6:0/3260235397 wait complete. 2024-05-04T01:02:52.636 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T01:02:52.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.801+0000 7f2889211640 1 Processor -- start 2024-05-04T01:02:52.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.801+0000 7f2889211640 1 -- start start 2024-05-04T01:02:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.801+0000 7f2889211640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2884156470 0x7f28840cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.801+0000 7f2889211640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f28840cd3a0 0x7f2884166a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.801+0000 7f2889211640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2884160620 con 0x7f28840ccf90 2024-05-04T01:02:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.801+0000 7f2889211640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f288415c310 con 0x7f2884156470 2024-05-04T01:02:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.801+0000 7f2889211640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f288415faa0 con 0x7f28840cd3a0 2024-05-04T01:02:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.801+0000 7f2882d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2884156470 0x7f28840cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.801+0000 7f288259c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f28840ccf90 0x7f288415c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52124/0 (socket says 172.21.15.6:52124) 2024-05-04T01:02:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.801+0000 7f288259c640 1 -- 172.21.15.6:0/257260024 learned_addr learned my addr 172.21.15.6:0/257260024 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T01:02:52.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.805+0000 7f2882d9d640 1 -- 172.21.15.6:0/257260024 >> v2:172.21.15.163:3300/0 conn(0x7f28840cd3a0 msgr2=0x7f2884166a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:02:52.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.805+0000 7f2882d9d640 1 --2- 172.21.15.6:0/257260024 >> v2:172.21.15.163:3300/0 conn(0x7f28840cd3a0 0x7f2884166a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:52.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.805+0000 7f2882d9d640 1 -- 172.21.15.6:0/257260024 >> v1:172.21.15.6:6789/0 conn(0x7f28840ccf90 legacy=0x7f288415c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:52.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.805+0000 7f2882d9d640 1 -- 172.21.15.6:0/257260024 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f288415fd80 con 0x7f2884156470 2024-05-04T01:02:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.809+0000 7f2882d9d640 1 --2- 172.21.15.6:0/257260024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2884156470 0x7f28840cc230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f288415c490 tx=0x7f286c01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd24fad3d92377d server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:52.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.817+0000 7f2881d9b640 1 -- 172.21.15.6:0/257260024 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c0b5070 con 0x7f2884156470 2024-05-04T01:02:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.817+0000 7f2881d9b640 1 -- 172.21.15.6:0/257260024 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f286c0a8950 con 0x7f2884156470 2024-05-04T01:02:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.817+0000 7f2881d9b640 1 -- 172.21.15.6:0/257260024 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c0a8d20 con 0x7f2884156470 2024-05-04T01:02:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.817+0000 7f2889211640 1 -- 172.21.15.6:0/257260024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2884156470 msgr2=0x7f28840cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.817+0000 7f2889211640 1 --2- 172.21.15.6:0/257260024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2884156470 0x7f28840cc230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f288415c490 tx=0x7f286c01ec50 comp rx=0 tx=0).stop 2024-05-04T01:02:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.821+0000 7f2889211640 1 -- 172.21.15.6:0/257260024 shutdown_connections 2024-05-04T01:02:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.821+0000 7f2889211640 1 --2- 172.21.15.6:0/257260024 >> v2:172.21.15.163:3300/0 conn(0x7f28840cd3a0 0x7f2884166a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.821+0000 7f2889211640 1 --2- 172.21.15.6:0/257260024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2884156470 0x7f28840cc230 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.821+0000 7f2889211640 1 -- 172.21.15.6:0/257260024 >> 172.21.15.6:0/257260024 conn(0x7f28840d1600 msgr2=0x7f28840d1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.821+0000 7f2889211640 1 -- 172.21.15.6:0/257260024 shutdown_connections 2024-05-04T01:02:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.821+0000 7f2889211640 1 -- 172.21.15.6:0/257260024 wait complete. 2024-05-04T01:02:52.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.821+0000 7f2889211640 1 Processor -- start 2024-05-04T01:02:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.821+0000 7f2889211640 1 -- start start 2024-05-04T01:02:52.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.821+0000 7f2889211640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28840ccf90 0x7f28841f5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:52.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.821+0000 7f2889211640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28840cd3a0 0x7f28841548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:52.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.821+0000 7f2889211640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28841e5ef0 0x7f2884150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:52.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.821+0000 7f2889211640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f28840cc770 con 0x7f28840cd3a0 2024-05-04T01:02:52.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.821+0000 7f2889211640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2884160340 con 0x7f28840ccf90 2024-05-04T01:02:52.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.821+0000 7f2889211640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f28840cd7b0 con 0x7f28841e5ef0 2024-05-04T01:02:52.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.821+0000 7f288259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28840cd3a0 0x7f28841548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:52.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.825+0000 7f288259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28840cd3a0 0x7f28841548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51068/0 (socket says 172.21.15.6:51068) 2024-05-04T01:02:52.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.825+0000 7f288259c640 1 -- 172.21.15.6:0/3889546734 learned_addr learned my addr 172.21.15.6:0/3889546734 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:02:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.829+0000 7f288259c640 1 -- 172.21.15.6:0/3889546734 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28841e5ef0 msgr2=0x7f2884150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.829+0000 7f288259c640 1 --2- 172.21.15.6:0/3889546734 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28841e5ef0 0x7f2884150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.829+0000 7f288259c640 1 -- 172.21.15.6:0/3889546734 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28840ccf90 msgr2=0x7f28841f5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:52.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.829+0000 7f288259c640 1 --2- 172.21.15.6:0/3889546734 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28840ccf90 0x7f28841f5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:52.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.829+0000 7f288259c640 1 -- 172.21.15.6:0/3889546734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28841e63c0 con 0x7f28840cd3a0 2024-05-04T01:02:52.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.829+0000 7f288259c640 1 --2- 172.21.15.6:0/3889546734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28840cd3a0 0x7f28841548f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f287400c460 tx=0x7f287400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.833+0000 7f287b7fe640 1 -- 172.21.15.6:0/3889546734 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2874017070 con 0x7f28840cd3a0 2024-05-04T01:02:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.833+0000 7f287b7fe640 1 -- 172.21.15.6:0/3889546734 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2874005d10 con 0x7f28840cd3a0 2024-05-04T01:02:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.833+0000 7f2889211640 1 -- 172.21.15.6:0/3889546734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28841e69d0 con 0x7f28840cd3a0 2024-05-04T01:02:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.833+0000 7f287b7fe640 1 -- 172.21.15.6:0/3889546734 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28740072b0 con 0x7f28840cd3a0 2024-05-04T01:02:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.833+0000 7f2889211640 1 -- 172.21.15.6:0/3889546734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28840c8cf0 con 0x7f28840cd3a0 2024-05-04T01:02:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:52.833+0000 7f2889211640 1 -- 172.21.15.6:0/3889546734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2884069a50 con 0x7f28840cd3a0 2024-05-04T01:02:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.153+0000 7f287b7fe640 1 -- 172.21.15.6:0/3889546734 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f287401a070 con 0x7f28840cd3a0 2024-05-04T01:02:53.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.153+0000 7f287b7fe640 1 --2- 172.21.15.6:0/3889546734 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f286406f430 0x7f2864071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:02:53.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.157+0000 7f2882d9d640 1 --2- 172.21.15.6:0/3889546734 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f286406f430 0x7f2864071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:02:53.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.157+0000 7f2882d9d640 1 --2- 172.21.15.6:0/3889546734 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f286406f430 0x7f2864071940 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f286c0b2000 tx=0x7f286c004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:02:53.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.197+0000 7f287b7fe640 1 -- 172.21.15.6:0/3889546734 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f2874057430 con 0x7f28840cd3a0 2024-05-04T01:02:53.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.213+0000 7f287b7fe640 1 -- 172.21.15.6:0/3889546734 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2874021020 con 0x7f28840cd3a0 2024-05-04T01:02:53.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.405+0000 7f2889211640 1 -- 172.21.15.6:0/3889546734 --> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f28840ccd70 con 0x7f286406f430 2024-05-04T01:02:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.425+0000 7f287b7fe640 1 -- 172.21.15.6:0/3889546734 <== mgr.4103 v2:172.21.15.163:6800/2152694980 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250942 (secure 0 0 0) 0x7f286c0fc450 con 0x7f286406f430 2024-05-04T01:02:53.432 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T01:02:53.433 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-04T01:02:53.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.429+0000 7f2889211640 1 -- 172.21.15.6:0/3889546734 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f286406f430 msgr2=0x7f2864071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:53.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.429+0000 7f2889211640 1 --2- 172.21.15.6:0/3889546734 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f286406f430 0x7f2864071940 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f286c0b2000 tx=0x7f286c004740 comp rx=0 tx=0).stop 2024-05-04T01:02:53.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.429+0000 7f2889211640 1 -- 172.21.15.6:0/3889546734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28840cd3a0 msgr2=0x7f28841548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:02:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.429+0000 7f2889211640 1 --2- 172.21.15.6:0/3889546734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28840cd3a0 0x7f28841548f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f287400c460 tx=0x7f287400c920 comp rx=0 tx=0).stop 2024-05-04T01:02:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.429+0000 7f2889211640 1 -- 172.21.15.6:0/3889546734 shutdown_connections 2024-05-04T01:02:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.429+0000 7f2889211640 1 --2- 172.21.15.6:0/3889546734 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f286406f430 0x7f2864071940 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.429+0000 7f2889211640 1 --2- 172.21.15.6:0/3889546734 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28841e5ef0 0x7f2884150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.429+0000 7f2889211640 1 --2- 172.21.15.6:0/3889546734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28840cd3a0 0x7f28841548f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.429+0000 7f2889211640 1 --2- 172.21.15.6:0/3889546734 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28840ccf90 0x7f28841f5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:02:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.429+0000 7f2889211640 1 -- 172.21.15.6:0/3889546734 >> 172.21.15.6:0/3889546734 conn(0x7f28840d1600 msgr2=0x7f28840b5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:02:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.429+0000 7f2889211640 1 -- 172.21.15.6:0/3889546734 shutdown_connections 2024-05-04T01:02:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:02:53.429+0000 7f2889211640 1 -- 172.21.15.6:0/3889546734 wait complete. 2024-05-04T01:02:53.462 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":994,"stamp":"2024-05-04T01:02:52.391500+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22768727,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":531,"num_read_kb":545,"num_write":8989,"num_write_kb":276827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8075,"ondisk_log_size":8075,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317136,"kb_used_data":46928,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754657584,"statfs":{"total":773094113280,"available":772769366016,"internally_reserved":0,"allocated":48054272,"data_stored":46430222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004699"},"pg_stats":[{"pgid":"3.3f","version":"28'39","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:37.343099+0000","last_change":"2024-05-04T00:31:21.410516+0000","last_active":"2024-05-04T01:02:37.343099+0000","last_peered":"2024-05-04T01:02:37.343099+0000","last_clean":"2024-05-04T01:02:37.343099+0000","last_became_active":"2024-05-04T00:31:21.409386+0000","last_became_peered":"2024-05-04T00:31:21.409386+0000","last_unstale":"2024-05-04T01:02:37.343099+0000","last_undegraded":"2024-05-04T01:02:37.343099+0000","last_fullsized":"2024-05-04T01:02:37.343099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":2475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'39","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:35.404144+0000","last_change":"2024-05-04T00:31:21.397440+0000","last_active":"2024-05-04T01:02:35.404144+0000","last_peered":"2024-05-04T01:02:35.404144+0000","last_clean":"2024-05-04T01:02:35.404144+0000","last_became_active":"2024-05-04T00:31:21.396255+0000","last_became_peered":"2024-05-04T00:31:21.396255+0000","last_unstale":"2024-05-04T01:02:35.404144+0000","last_undegraded":"2024-05-04T01:02:35.404144+0000","last_fullsized":"2024-05-04T01:02:35.404144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":1259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'53","reported_seq":90,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:35.404112+0000","last_change":"2024-05-04T00:31:21.442932+0000","last_active":"2024-05-04T01:02:35.404112+0000","last_peered":"2024-05-04T01:02:35.404112+0000","last_clean":"2024-05-04T01:02:35.404112+0000","last_became_active":"2024-05-04T00:31:21.442507+0000","last_became_peered":"2024-05-04T00:31:21.442507+0000","last_unstale":"2024-05-04T01:02:35.404112+0000","last_undegraded":"2024-05-04T01:02:35.404112+0000","last_fullsized":"2024-05-04T01:02:35.404112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":2592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"28'34","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.688283+0000","last_change":"2024-05-04T00:31:21.442087+0000","last_active":"2024-05-04T01:02:31.688283+0000","last_peered":"2024-05-04T01:02:31.688283+0000","last_clean":"2024-05-04T01:02:31.688283+0000","last_became_active":"2024-05-04T00:31:21.440935+0000","last_became_peered":"2024-05-04T00:31:21.440935+0000","last_unstale":"2024-05-04T01:02:31.688283+0000","last_undegraded":"2024-05-04T01:02:31.688283+0000","last_fullsized":"2024-05-04T01:02:31.688283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":1417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'35","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.838472+0000","last_change":"2024-05-04T00:31:21.408892+0000","last_active":"2024-05-04T01:02:31.838472+0000","last_peered":"2024-05-04T01:02:31.838472+0000","last_clean":"2024-05-04T01:02:31.838472+0000","last_became_active":"2024-05-04T00:31:21.402554+0000","last_became_peered":"2024-05-04T00:31:21.402554+0000","last_unstale":"2024-05-04T01:02:31.838472+0000","last_undegraded":"2024-05-04T01:02:31.838472+0000","last_fullsized":"2024-05-04T01:02:31.838472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":2934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'51","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.688171+0000","last_change":"2024-05-04T00:31:21.442773+0000","last_active":"2024-05-04T01:02:31.688171+0000","last_peered":"2024-05-04T01:02:31.688171+0000","last_clean":"2024-05-04T01:02:31.688171+0000","last_became_active":"2024-05-04T00:31:21.441082+0000","last_became_peered":"2024-05-04T00:31:21.441082+0000","last_unstale":"2024-05-04T01:02:31.688171+0000","last_undegraded":"2024-05-04T01:02:31.688171+0000","last_fullsized":"2024-05-04T01:02:31.688171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":4527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"28'38","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.835027+0000","last_change":"2024-05-04T00:31:21.441617+0000","last_active":"2024-05-04T01:02:31.835027+0000","last_peered":"2024-05-04T01:02:31.835027+0000","last_clean":"2024-05-04T01:02:31.835027+0000","last_became_active":"2024-05-04T00:31:21.440766+0000","last_became_peered":"2024-05-04T00:31:21.440766+0000","last_unstale":"2024-05-04T01:02:31.835027+0000","last_undegraded":"2024-05-04T01:02:31.835027+0000","last_fullsized":"2024-05-04T01:02:31.835027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":2716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"28'27","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.477635+0000","last_change":"2024-05-04T00:31:21.408515+0000","last_active":"2024-05-04T01:02:31.477635+0000","last_peered":"2024-05-04T01:02:31.477635+0000","last_clean":"2024-05-04T01:02:31.477635+0000","last_became_active":"2024-05-04T00:31:21.407785+0000","last_became_peered":"2024-05-04T00:31:21.407785+0000","last_unstale":"2024-05-04T01:02:31.477635+0000","last_undegraded":"2024-05-04T01:02:31.477635+0000","last_fullsized":"2024-05-04T01:02:31.477635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"28'58","reported_seq":92,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.367813+0000","last_change":"2024-05-04T00:31:21.400836+0000","last_active":"2024-05-04T01:02:31.367813+0000","last_peered":"2024-05-04T01:02:31.367813+0000","last_clean":"2024-05-04T01:02:31.367813+0000","last_became_active":"2024-05-04T00:31:21.400001+0000","last_became_peered":"2024-05-04T00:31:21.400001+0000","last_unstale":"2024-05-04T01:02:31.367813+0000","last_undegraded":"2024-05-04T01:02:31.367813+0000","last_fullsized":"2024-05-04T01:02:31.367813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":3953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"28'49","reported_seq":92,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:49.375546+0000","last_change":"2024-05-04T01:02:49.375682+0000","last_active":"2024-05-04T01:02:49.375546+0000","last_peered":"2024-05-04T01:02:49.375546+0000","last_clean":"2024-05-04T01:02:49.375546+0000","last_became_active":"2024-05-04T00:31:21.389347+0000","last_became_peered":"2024-05-04T00:31:21.389347+0000","last_unstale":"2024-05-04T01:02:49.375546+0000","last_undegraded":"2024-05-04T01:02:49.375546+0000","last_fullsized":"2024-05-04T01:02:49.375546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'49","last_scrub_stamp":"2024-05-04T01:02:49.375195+0000","last_deep_scrub":"28'49","last_deep_scrub_stamp":"2024-05-04T01:02:49.375195+0000","last_clean_scrub_stamp":"2024-05-04T01:02:49.375195+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:35:18.637804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":5065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'36","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:51.304686+0000","last_change":"2024-05-04T01:02:51.304742+0000","last_active":"2024-05-04T01:02:51.304686+0000","last_peered":"2024-05-04T01:02:51.304686+0000","last_clean":"2024-05-04T01:02:51.304686+0000","last_became_active":"2024-05-04T00:31:21.385949+0000","last_became_peered":"2024-05-04T00:31:21.385949+0000","last_unstale":"2024-05-04T01:02:51.304686+0000","last_undegraded":"2024-05-04T01:02:51.304686+0000","last_fullsized":"2024-05-04T01:02:51.304686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2024-05-04T01:02:51.304523+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2024-05-04T01:02:51.304523+0000","last_clean_scrub_stamp":"2024-05-04T01:02:51.304523+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:14:14.099938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"28'26","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:43.338820+0000","last_change":"2024-05-04T00:31:21.407987+0000","last_active":"2024-05-04T01:02:43.338820+0000","last_peered":"2024-05-04T01:02:43.338820+0000","last_clean":"2024-05-04T01:02:43.338820+0000","last_became_active":"2024-05-04T00:31:21.404557+0000","last_became_peered":"2024-05-04T00:31:21.404557+0000","last_unstale":"2024-05-04T01:02:43.338820+0000","last_undegraded":"2024-05-04T01:02:43.338820+0000","last_fullsized":"2024-05-04T01:02:43.338820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'80","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.431610+0000","last_change":"2024-05-04T00:31:21.389251+0000","last_active":"2024-05-04T01:02:31.431610+0000","last_peered":"2024-05-04T01:02:31.431610+0000","last_clean":"2024-05-04T01:02:31.431610+0000","last_became_active":"2024-05-04T00:31:21.387958+0000","last_became_peered":"2024-05-04T00:31:21.387958+0000","last_unstale":"2024-05-04T01:02:31.431610+0000","last_undegraded":"2024-05-04T01:02:31.431610+0000","last_fullsized":"2024-05-04T01:02:31.431610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:31.926158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":3559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"28'48","reported_seq":82,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.420705+0000","last_change":"2024-05-04T00:31:21.402284+0000","last_active":"2024-05-04T01:02:31.420705+0000","last_peered":"2024-05-04T01:02:31.420705+0000","last_clean":"2024-05-04T01:02:31.420705+0000","last_became_active":"2024-05-04T00:31:21.401495+0000","last_became_peered":"2024-05-04T00:31:21.401495+0000","last_unstale":"2024-05-04T01:02:31.420705+0000","last_undegraded":"2024-05-04T01:02:31.420705+0000","last_fullsized":"2024-05-04T01:02:31.420705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:09.622538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":5060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"28'52","reported_seq":87,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.456272+0000","last_change":"2024-05-04T00:31:21.410958+0000","last_active":"2024-05-04T01:02:31.456272+0000","last_peered":"2024-05-04T01:02:31.456272+0000","last_clean":"2024-05-04T01:02:31.456272+0000","last_became_active":"2024-05-04T00:31:21.410489+0000","last_became_peered":"2024-05-04T00:31:21.410489+0000","last_unstale":"2024-05-04T01:02:31.456272+0000","last_undegraded":"2024-05-04T01:02:31.456272+0000","last_fullsized":"2024-05-04T01:02:31.456272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'49","reported_seq":92,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:50.110973+0000","last_change":"2024-05-04T01:02:50.111006+0000","last_active":"2024-05-04T01:02:50.110973+0000","last_peered":"2024-05-04T01:02:50.110973+0000","last_clean":"2024-05-04T01:02:50.110973+0000","last_became_active":"2024-05-04T00:31:21.186141+0000","last_became_peered":"2024-05-04T00:31:21.186141+0000","last_unstale":"2024-05-04T01:02:50.110973+0000","last_undegraded":"2024-05-04T01:02:50.110973+0000","last_fullsized":"2024-05-04T01:02:50.110973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'49","last_scrub_stamp":"2024-05-04T01:02:50.110865+0000","last_deep_scrub":"28'49","last_deep_scrub_stamp":"2024-05-04T01:02:50.110865+0000","last_clean_scrub_stamp":"2024-05-04T01:02:50.110865+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:21:55.356249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":5921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"28'39","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.687095+0000","last_change":"2024-05-04T00:31:21.406402+0000","last_active":"2024-05-04T01:02:31.687095+0000","last_peered":"2024-05-04T01:02:31.687095+0000","last_clean":"2024-05-04T01:02:31.687095+0000","last_became_active":"2024-05-04T00:31:21.389108+0000","last_became_peered":"2024-05-04T00:31:21.389108+0000","last_unstale":"2024-05-04T01:02:31.687095+0000","last_undegraded":"2024-05-04T01:02:31.687095+0000","last_fullsized":"2024-05-04T01:02:31.687095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'50","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.449234+0000","last_change":"2024-05-04T00:31:21.418601+0000","last_active":"2024-05-04T01:02:31.449234+0000","last_peered":"2024-05-04T01:02:31.449234+0000","last_clean":"2024-05-04T01:02:31.449234+0000","last_became_active":"2024-05-04T00:31:21.417914+0000","last_became_peered":"2024-05-04T00:31:21.417914+0000","last_unstale":"2024-05-04T01:02:31.449234+0000","last_undegraded":"2024-05-04T01:02:31.449234+0000","last_fullsized":"2024-05-04T01:02:31.449234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:23:35.270037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":3403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"28'50","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.698376+0000","last_change":"2024-05-04T00:31:21.441868+0000","last_active":"2024-05-04T01:02:31.698376+0000","last_peered":"2024-05-04T01:02:31.698376+0000","last_clean":"2024-05-04T01:02:31.698376+0000","last_became_active":"2024-05-04T00:31:21.440945+0000","last_became_peered":"2024-05-04T00:31:21.440945+0000","last_unstale":"2024-05-04T01:02:31.698376+0000","last_undegraded":"2024-05-04T01:02:31.698376+0000","last_fullsized":"2024-05-04T01:02:31.698376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":6197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"28'63","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:50.342761+0000","last_change":"2024-05-04T01:02:50.342761+0000","last_active":"2024-05-04T01:02:50.342761+0000","last_peered":"2024-05-04T01:02:50.342761+0000","last_clean":"2024-05-04T01:02:50.342761+0000","last_became_active":"2024-05-04T00:31:21.394461+0000","last_became_peered":"2024-05-04T00:31:21.394461+0000","last_unstale":"2024-05-04T01:02:50.342761+0000","last_undegraded":"2024-05-04T01:02:50.342761+0000","last_fullsized":"2024-05-04T01:02:50.342761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'63","last_scrub_stamp":"2024-05-04T01:02:50.342563+0000","last_deep_scrub":"28'63","last_deep_scrub_stamp":"2024-05-04T01:02:50.342563+0000","last_clean_scrub_stamp":"2024-05-04T01:02:50.342563+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:44:57.201352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"28'59","reported_seq":93,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.540103+0000","last_change":"2024-05-04T00:31:21.446878+0000","last_active":"2024-05-04T01:02:31.540103+0000","last_peered":"2024-05-04T01:02:31.540103+0000","last_clean":"2024-05-04T01:02:31.540103+0000","last_became_active":"2024-05-04T00:31:21.446250+0000","last_became_peered":"2024-05-04T00:31:21.446250+0000","last_unstale":"2024-05-04T01:02:31.540103+0000","last_undegraded":"2024-05-04T01:02:31.540103+0000","last_fullsized":"2024-05-04T01:02:31.540103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:12:42.617159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":5743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"28'39","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.371853+0000","last_change":"2024-05-04T00:31:21.414182+0000","last_active":"2024-05-04T01:02:31.371853+0000","last_peered":"2024-05-04T01:02:31.371853+0000","last_clean":"2024-05-04T01:02:31.371853+0000","last_became_active":"2024-05-04T00:31:21.413073+0000","last_became_peered":"2024-05-04T00:31:21.413073+0000","last_unstale":"2024-05-04T01:02:31.371853+0000","last_undegraded":"2024-05-04T01:02:31.371853+0000","last_fullsized":"2024-05-04T01:02:31.371853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"28'57","reported_seq":93,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:49.459786+0000","last_change":"2024-05-04T00:31:21.403827+0000","last_active":"2024-05-04T01:02:49.459786+0000","last_peered":"2024-05-04T01:02:49.459786+0000","last_clean":"2024-05-04T01:02:49.459786+0000","last_became_active":"2024-05-04T00:31:21.402985+0000","last_became_peered":"2024-05-04T00:31:21.402985+0000","last_unstale":"2024-05-04T01:02:49.459786+0000","last_undegraded":"2024-05-04T01:02:49.459786+0000","last_fullsized":"2024-05-04T01:02:49.459786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":5055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'40","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.696379+0000","last_change":"2024-05-04T00:31:21.393270+0000","last_active":"2024-05-04T01:02:31.696379+0000","last_peered":"2024-05-04T01:02:31.696379+0000","last_clean":"2024-05-04T01:02:31.696379+0000","last_became_active":"2024-05-04T00:31:21.392368+0000","last_became_peered":"2024-05-04T00:31:21.392368+0000","last_unstale":"2024-05-04T01:02:31.696379+0000","last_undegraded":"2024-05-04T01:02:31.696379+0000","last_fullsized":"2024-05-04T01:02:31.696379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":4444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"28'33","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.446045+0000","last_change":"2024-05-04T00:31:21.416800+0000","last_active":"2024-05-04T01:02:31.446045+0000","last_peered":"2024-05-04T01:02:31.446045+0000","last_clean":"2024-05-04T01:02:31.446045+0000","last_became_active":"2024-05-04T00:31:21.415540+0000","last_became_peered":"2024-05-04T00:31:21.415540+0000","last_unstale":"2024-05-04T01:02:31.446045+0000","last_undegraded":"2024-05-04T01:02:31.446045+0000","last_fullsized":"2024-05-04T01:02:31.446045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"28'72","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.701501+0000","last_change":"2024-05-04T00:31:21.188504+0000","last_active":"2024-05-04T01:02:31.701501+0000","last_peered":"2024-05-04T01:02:31.701501+0000","last_clean":"2024-05-04T01:02:31.701501+0000","last_became_active":"2024-05-04T00:31:21.187877+0000","last_became_peered":"2024-05-04T00:31:21.187877+0000","last_unstale":"2024-05-04T01:02:31.701501+0000","last_undegraded":"2024-05-04T01:02:31.701501+0000","last_fullsized":"2024-05-04T01:02:31.701501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":3181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"28'39","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.408156+0000","last_change":"2024-05-04T00:31:21.393500+0000","last_active":"2024-05-04T01:02:31.408156+0000","last_peered":"2024-05-04T01:02:31.408156+0000","last_clean":"2024-05-04T01:02:31.408156+0000","last_became_active":"2024-05-04T00:31:21.392579+0000","last_became_peered":"2024-05-04T00:31:21.392579+0000","last_unstale":"2024-05-04T01:02:31.408156+0000","last_undegraded":"2024-05-04T01:02:31.408156+0000","last_fullsized":"2024-05-04T01:02:31.408156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:23:16.804136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":2828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"28'30","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.428999+0000","last_change":"2024-05-04T00:31:21.395778+0000","last_active":"2024-05-04T01:02:31.428999+0000","last_peered":"2024-05-04T01:02:31.428999+0000","last_clean":"2024-05-04T01:02:31.428999+0000","last_became_active":"2024-05-04T00:31:21.394966+0000","last_became_peered":"2024-05-04T00:31:21.394966+0000","last_unstale":"2024-05-04T01:02:31.428999+0000","last_undegraded":"2024-05-04T01:02:31.428999+0000","last_fullsized":"2024-05-04T01:02:31.428999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:53:28.166224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"28'34","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:45.405949+0000","last_change":"2024-05-04T00:31:21.405250+0000","last_active":"2024-05-04T01:02:45.405949+0000","last_peered":"2024-05-04T01:02:45.405949+0000","last_clean":"2024-05-04T01:02:45.405949+0000","last_became_active":"2024-05-04T00:31:21.403779+0000","last_became_peered":"2024-05-04T00:31:21.403779+0000","last_unstale":"2024-05-04T01:02:45.405949+0000","last_undegraded":"2024-05-04T01:02:45.405949+0000","last_fullsized":"2024-05-04T01:02:45.405949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":2736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"28'56","reported_seq":93,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:35.518465+0000","last_change":"2024-05-04T00:31:21.399896+0000","last_active":"2024-05-04T01:02:35.518465+0000","last_peered":"2024-05-04T01:02:35.518465+0000","last_clean":"2024-05-04T01:02:35.518465+0000","last_became_active":"2024-05-04T00:31:21.398994+0000","last_became_peered":"2024-05-04T00:31:21.398994+0000","last_unstale":"2024-05-04T01:02:35.518465+0000","last_undegraded":"2024-05-04T01:02:35.518465+0000","last_fullsized":"2024-05-04T01:02:35.518465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":5289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"28'49","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.449650+0000","last_change":"2024-05-04T00:31:21.416130+0000","last_active":"2024-05-04T01:02:31.449650+0000","last_peered":"2024-05-04T01:02:31.449650+0000","last_clean":"2024-05-04T01:02:31.449650+0000","last_became_active":"2024-05-04T00:31:21.415395+0000","last_became_peered":"2024-05-04T00:31:21.415395+0000","last_unstale":"2024-05-04T01:02:31.449650+0000","last_undegraded":"2024-05-04T01:02:31.449650+0000","last_fullsized":"2024-05-04T01:02:31.449650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:33:22.819977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":6794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'61","reported_seq":98,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:37.441599+0000","last_change":"2024-05-04T00:31:21.342105+0000","last_active":"2024-05-04T01:02:37.441599+0000","last_peered":"2024-05-04T01:02:37.441599+0000","last_clean":"2024-05-04T01:02:37.441599+0000","last_became_active":"2024-05-04T00:31:21.341333+0000","last_became_peered":"2024-05-04T00:31:21.341333+0000","last_unstale":"2024-05-04T01:02:37.441599+0000","last_undegraded":"2024-05-04T01:02:37.441599+0000","last_fullsized":"2024-05-04T01:02:37.441599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":5609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"28'25","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.371167+0000","last_change":"2024-05-04T00:31:21.405647+0000","last_active":"2024-05-04T01:02:31.371167+0000","last_peered":"2024-05-04T01:02:31.371167+0000","last_clean":"2024-05-04T01:02:31.371167+0000","last_became_active":"2024-05-04T00:31:21.403998+0000","last_became_peered":"2024-05-04T00:31:21.403998+0000","last_unstale":"2024-05-04T01:02:31.371167+0000","last_undegraded":"2024-05-04T01:02:31.371167+0000","last_fullsized":"2024-05-04T01:02:31.371167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"28'497","reported_seq":543,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:50.405280+0000","last_change":"2024-05-04T01:02:50.405314+0000","last_active":"2024-05-04T01:02:50.405280+0000","last_peered":"2024-05-04T01:02:50.405280+0000","last_clean":"2024-05-04T01:02:50.405280+0000","last_became_active":"2024-05-04T00:31:19.181107+0000","last_became_peered":"2024-05-04T00:31:19.181107+0000","last_unstale":"2024-05-04T01:02:50.405280+0000","last_undegraded":"2024-05-04T01:02:50.405280+0000","last_fullsized":"2024-05-04T01:02:50.405280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'497","last_scrub_stamp":"2024-05-04T01:02:50.405183+0000","last_deep_scrub":"28'497","last_deep_scrub_stamp":"2024-05-04T01:02:50.405183+0000","last_clean_scrub_stamp":"2024-05-04T01:02:50.405183+0000","objects_scrubbed":3,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:20:47.779066+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"28'45","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.542677+0000","last_change":"2024-05-04T00:31:21.446209+0000","last_active":"2024-05-04T01:02:31.542677+0000","last_peered":"2024-05-04T01:02:31.542677+0000","last_clean":"2024-05-04T01:02:31.542677+0000","last_became_active":"2024-05-04T00:31:21.445793+0000","last_became_peered":"2024-05-04T00:31:21.445793+0000","last_unstale":"2024-05-04T01:02:31.542677+0000","last_undegraded":"2024-05-04T01:02:31.542677+0000","last_fullsized":"2024-05-04T01:02:31.542677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:54:48.084884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"28'359","reported_seq":397,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:28.312107+0000","last_change":"2024-05-04T00:31:19.185102+0000","last_active":"2024-05-04T01:02:28.312107+0000","last_peered":"2024-05-04T01:02:28.312107+0000","last_clean":"2024-05-04T01:02:28.312107+0000","last_became_active":"2024-05-04T00:31:19.183394+0000","last_became_peered":"2024-05-04T00:31:19.183394+0000","last_unstale":"2024-05-04T01:02:28.312107+0000","last_undegraded":"2024-05-04T01:02:28.312107+0000","last_fullsized":"2024-05-04T01:02:28.312107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":4278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T00:58:02.556311+0000","last_change":"2024-05-04T00:31:19.158945+0000","last_active":"2024-05-04T00:58:02.556311+0000","last_peered":"2024-05-04T00:58:02.556311+0000","last_clean":"2024-05-04T00:58:02.556311+0000","last_became_active":"2024-05-04T00:31:19.158152+0000","last_became_peered":"2024-05-04T00:31:19.158152+0000","last_unstale":"2024-05-04T00:58:02.556311+0000","last_undegraded":"2024-05-04T00:58:02.556311+0000","last_fullsized":"2024-05-04T00:58:02.556311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:52.040804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'48","reported_seq":83,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:45.405868+0000","last_change":"2024-05-04T00:31:21.397183+0000","last_active":"2024-05-04T01:02:45.405868+0000","last_peered":"2024-05-04T01:02:45.405868+0000","last_clean":"2024-05-04T01:02:45.405868+0000","last_became_active":"2024-05-04T00:31:21.393014+0000","last_became_peered":"2024-05-04T00:31:21.393014+0000","last_unstale":"2024-05-04T01:02:45.405868+0000","last_undegraded":"2024-05-04T01:02:45.405868+0000","last_fullsized":"2024-05-04T01:02:45.405868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":2972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"28'7","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:45.520540+0000","last_change":"2024-05-04T00:31:19.186007+0000","last_active":"2024-05-04T01:02:45.520540+0000","last_peered":"2024-05-04T01:02:45.520540+0000","last_clean":"2024-05-04T01:02:45.520540+0000","last_became_active":"2024-05-04T00:31:19.184526+0000","last_became_peered":"2024-05-04T00:31:19.184526+0000","last_unstale":"2024-05-04T01:02:45.520540+0000","last_undegraded":"2024-05-04T01:02:45.520540+0000","last_fullsized":"2024-05-04T01:02:45.520540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"28'43","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.553685+0000","last_change":"2024-05-04T00:31:21.447258+0000","last_active":"2024-05-04T01:02:31.553685+0000","last_peered":"2024-05-04T01:02:31.553685+0000","last_clean":"2024-05-04T01:02:31.553685+0000","last_became_active":"2024-05-04T00:31:21.446842+0000","last_became_peered":"2024-05-04T00:31:21.446842+0000","last_unstale":"2024-05-04T01:02:31.553685+0000","last_undegraded":"2024-05-04T01:02:31.553685+0000","last_fullsized":"2024-05-04T01:02:31.553685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:10:57.675700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"28'11","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:46.219596+0000","last_change":"2024-05-04T01:02:46.219596+0000","last_active":"2024-05-04T01:02:46.219596+0000","last_peered":"2024-05-04T01:02:46.219596+0000","last_clean":"2024-05-04T01:02:46.219596+0000","last_became_active":"2024-05-04T00:31:19.189517+0000","last_became_peered":"2024-05-04T00:31:19.189517+0000","last_unstale":"2024-05-04T01:02:46.219596+0000","last_undegraded":"2024-05-04T01:02:46.219596+0000","last_fullsized":"2024-05-04T01:02:46.219596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-05-04T01:02:46.219390+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-05-04T01:02:46.219390+0000","last_clean_scrub_stamp":"2024-05-04T01:02:46.219390+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:00:22.152354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"28'52","reported_seq":95,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:47.401240+0000","last_change":"2024-05-04T01:02:47.401240+0000","last_active":"2024-05-04T01:02:47.401240+0000","last_peered":"2024-05-04T01:02:47.401240+0000","last_clean":"2024-05-04T01:02:47.401240+0000","last_became_active":"2024-05-04T00:31:21.183698+0000","last_became_peered":"2024-05-04T00:31:21.183698+0000","last_unstale":"2024-05-04T01:02:47.401240+0000","last_undegraded":"2024-05-04T01:02:47.401240+0000","last_fullsized":"2024-05-04T01:02:47.401240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'52","last_scrub_stamp":"2024-05-04T01:02:47.401095+0000","last_deep_scrub":"28'52","last_deep_scrub_stamp":"2024-05-04T01:02:47.401095+0000","last_clean_scrub_stamp":"2024-05-04T01:02:47.401095+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:51:44.309632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":3598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"28'6","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:45.374683+0000","last_change":"2024-05-04T01:02:45.374683+0000","last_active":"2024-05-04T01:02:45.374683+0000","last_peered":"2024-05-04T01:02:45.374683+0000","last_clean":"2024-05-04T01:02:45.374683+0000","last_became_active":"2024-05-04T00:31:19.185633+0000","last_became_peered":"2024-05-04T00:31:19.185633+0000","last_unstale":"2024-05-04T01:02:45.374683+0000","last_undegraded":"2024-05-04T01:02:45.374683+0000","last_fullsized":"2024-05-04T01:02:45.374683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-04T01:02:45.374371+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-04T01:02:45.374371+0000","last_clean_scrub_stamp":"2024-05-04T01:02:45.374371+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:51:59.656090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"28'45","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:45.406026+0000","last_change":"2024-05-04T00:31:21.410329+0000","last_active":"2024-05-04T01:02:45.406026+0000","last_peered":"2024-05-04T01:02:45.406026+0000","last_clean":"2024-05-04T01:02:45.406026+0000","last_became_active":"2024-05-04T00:31:21.409655+0000","last_became_peered":"2024-05-04T00:31:21.409655+0000","last_unstale":"2024-05-04T01:02:45.406026+0000","last_undegraded":"2024-05-04T01:02:45.406026+0000","last_fullsized":"2024-05-04T01:02:45.406026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":5409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"28'348","reported_seq":386,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.967405+0000","last_change":"2024-05-04T00:31:19.178130+0000","last_active":"2024-05-04T01:02:31.967405+0000","last_peered":"2024-05-04T01:02:31.967405+0000","last_clean":"2024-05-04T01:02:31.967405+0000","last_became_active":"2024-05-04T00:31:19.177283+0000","last_became_peered":"2024-05-04T00:31:19.177283+0000","last_unstale":"2024-05-04T01:02:31.967405+0000","last_undegraded":"2024-05-04T01:02:31.967405+0000","last_fullsized":"2024-05-04T01:02:31.967405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:42:41.790988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"28'47","reported_seq":90,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:48.037356+0000","last_change":"2024-05-04T01:02:48.037540+0000","last_active":"2024-05-04T01:02:48.037356+0000","last_peered":"2024-05-04T01:02:48.037356+0000","last_clean":"2024-05-04T01:02:48.037356+0000","last_became_active":"2024-05-04T00:31:21.186167+0000","last_became_peered":"2024-05-04T00:31:21.186167+0000","last_unstale":"2024-05-04T01:02:48.037356+0000","last_undegraded":"2024-05-04T01:02:48.037356+0000","last_fullsized":"2024-05-04T01:02:48.037356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'47","last_scrub_stamp":"2024-05-04T01:02:48.037006+0000","last_deep_scrub":"28'47","last_deep_scrub_stamp":"2024-05-04T01:02:48.037006+0000","last_clean_scrub_stamp":"2024-05-04T01:02:48.037006+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:15:37.175801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"28'816","reported_seq":863,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:46.458801+0000","last_change":"2024-05-04T01:02:46.458836+0000","last_active":"2024-05-04T01:02:46.458801+0000","last_peered":"2024-05-04T01:02:46.458801+0000","last_clean":"2024-05-04T01:02:46.458801+0000","last_became_active":"2024-05-04T00:31:19.250003+0000","last_became_peered":"2024-05-04T00:31:19.250003+0000","last_unstale":"2024-05-04T01:02:46.458801+0000","last_undegraded":"2024-05-04T01:02:46.458801+0000","last_fullsized":"2024-05-04T01:02:46.458801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'816","last_scrub_stamp":"2024-05-04T01:02:46.458694+0000","last_deep_scrub":"28'816","last_deep_scrub_stamp":"2024-05-04T01:02:46.458694+0000","last_clean_scrub_stamp":"2024-05-04T01:02:46.458694+0000","objects_scrubbed":5,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:51:53.860931+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":4562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"28'32","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:52.333781+0000","last_change":"2024-05-04T01:02:52.333851+0000","last_active":"2024-05-04T01:02:52.333781+0000","last_peered":"2024-05-04T01:02:52.333781+0000","last_clean":"2024-05-04T01:02:52.333781+0000","last_became_active":"2024-05-04T00:31:21.397220+0000","last_became_peered":"2024-05-04T00:31:21.397220+0000","last_unstale":"2024-05-04T01:02:52.333781+0000","last_undegraded":"2024-05-04T01:02:52.333781+0000","last_fullsized":"2024-05-04T01:02:52.333781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'32","last_scrub_stamp":"2024-05-04T01:02:52.333572+0000","last_deep_scrub":"28'32","last_deep_scrub_stamp":"2024-05-04T01:02:52.333572+0000","last_clean_scrub_stamp":"2024-05-04T01:02:52.333572+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:00:49.981014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:40.484170+0000","last_change":"2024-05-04T00:31:19.183674+0000","last_active":"2024-05-04T01:01:40.484170+0000","last_peered":"2024-05-04T01:01:40.484170+0000","last_clean":"2024-05-04T01:01:40.484170+0000","last_became_active":"2024-05-04T00:31:19.183331+0000","last_became_peered":"2024-05-04T00:31:19.183331+0000","last_unstale":"2024-05-04T01:01:40.484170+0000","last_undegraded":"2024-05-04T01:01:40.484170+0000","last_fullsized":"2024-05-04T01:01:40.484170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:13:52.447627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"28'47","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.421027+0000","last_change":"2024-05-04T00:31:21.342578+0000","last_active":"2024-05-04T01:02:31.421027+0000","last_peered":"2024-05-04T01:02:31.421027+0000","last_clean":"2024-05-04T01:02:31.421027+0000","last_became_active":"2024-05-04T00:31:21.342064+0000","last_became_peered":"2024-05-04T00:31:21.342064+0000","last_unstale":"2024-05-04T01:02:31.421027+0000","last_undegraded":"2024-05-04T01:02:31.421027+0000","last_fullsized":"2024-05-04T01:02:31.421027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:35.377002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"28'10","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:30.330896+0000","last_change":"2024-05-04T00:31:19.184166+0000","last_active":"2024-05-04T01:02:30.330896+0000","last_peered":"2024-05-04T01:02:30.330896+0000","last_clean":"2024-05-04T01:02:30.330896+0000","last_became_active":"2024-05-04T00:31:19.181304+0000","last_became_peered":"2024-05-04T00:31:19.181304+0000","last_unstale":"2024-05-04T01:02:30.330896+0000","last_undegraded":"2024-05-04T01:02:30.330896+0000","last_fullsized":"2024-05-04T01:02:30.330896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'62","reported_seq":97,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.696159+0000","last_change":"2024-05-04T00:31:21.390252+0000","last_active":"2024-05-04T01:02:31.696159+0000","last_peered":"2024-05-04T01:02:31.696159+0000","last_clean":"2024-05-04T01:02:31.696159+0000","last_became_active":"2024-05-04T00:31:21.389360+0000","last_became_peered":"2024-05-04T00:31:21.389360+0000","last_unstale":"2024-05-04T01:02:31.696159+0000","last_undegraded":"2024-05-04T01:02:31.696159+0000","last_fullsized":"2024-05-04T01:02:31.696159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":7948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"28'7","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:44.389141+0000","last_change":"2024-05-04T01:02:44.389194+0000","last_active":"2024-05-04T01:02:44.389141+0000","last_peered":"2024-05-04T01:02:44.389141+0000","last_clean":"2024-05-04T01:02:44.389141+0000","last_became_active":"2024-05-04T00:31:19.175779+0000","last_became_peered":"2024-05-04T00:31:19.175779+0000","last_unstale":"2024-05-04T01:02:44.389141+0000","last_undegraded":"2024-05-04T01:02:44.389141+0000","last_fullsized":"2024-05-04T01:02:44.389141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-04T01:02:44.389001+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-04T01:02:44.389001+0000","last_clean_scrub_stamp":"2024-05-04T01:02:44.389001+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:27:00.757872+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'46","reported_seq":89,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:47.208969+0000","last_change":"2024-05-04T01:02:47.208995+0000","last_active":"2024-05-04T01:02:47.208969+0000","last_peered":"2024-05-04T01:02:47.208969+0000","last_clean":"2024-05-04T01:02:47.208969+0000","last_became_active":"2024-05-04T00:31:21.394863+0000","last_became_peered":"2024-05-04T00:31:21.394863+0000","last_unstale":"2024-05-04T01:02:47.208969+0000","last_undegraded":"2024-05-04T01:02:47.208969+0000","last_fullsized":"2024-05-04T01:02:47.208969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'46","last_scrub_stamp":"2024-05-04T01:02:47.208882+0000","last_deep_scrub":"28'46","last_deep_scrub_stamp":"2024-05-04T01:02:47.208882+0000","last_clean_scrub_stamp":"2024-05-04T01:02:47.208882+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:45:38.760763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":4347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"28'17","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:01:42.389948+0000","last_change":"2024-05-04T00:31:19.177402+0000","last_active":"2024-05-04T01:01:42.389948+0000","last_peered":"2024-05-04T01:01:42.389948+0000","last_clean":"2024-05-04T01:01:42.389948+0000","last_became_active":"2024-05-04T00:31:19.176805+0000","last_became_peered":"2024-05-04T00:31:19.176805+0000","last_unstale":"2024-05-04T01:01:42.389948+0000","last_undegraded":"2024-05-04T01:01:42.389948+0000","last_fullsized":"2024-05-04T01:01:42.389948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:31.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'47","reported_seq":90,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:49.081827+0000","last_change":"2024-05-04T01:02:49.081895+0000","last_active":"2024-05-04T01:02:49.081827+0000","last_peered":"2024-05-04T01:02:49.081827+0000","last_clean":"2024-05-04T01:02:49.081827+0000","last_became_active":"2024-05-04T00:31:21.187554+0000","last_became_peered":"2024-05-04T00:31:21.187554+0000","last_unstale":"2024-05-04T01:02:49.081827+0000","last_undegraded":"2024-05-04T01:02:49.081827+0000","last_fullsized":"2024-05-04T01:02:49.081827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'47","last_scrub_stamp":"2024-05-04T01:02:49.081608+0000","last_deep_scrub":"28'47","last_deep_scrub_stamp":"2024-05-04T01:02:49.081608+0000","last_clean_scrub_stamp":"2024-05-04T01:02:49.081608+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:17:28.418502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":6499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"28'8","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:43.399513+0000","last_change":"2024-05-04T01:02:43.399587+0000","last_active":"2024-05-04T01:02:43.399513+0000","last_peered":"2024-05-04T01:02:43.399513+0000","last_clean":"2024-05-04T01:02:43.399513+0000","last_became_active":"2024-05-04T00:31:19.175715+0000","last_became_peered":"2024-05-04T00:31:19.175715+0000","last_unstale":"2024-05-04T01:02:43.399513+0000","last_undegraded":"2024-05-04T01:02:43.399513+0000","last_fullsized":"2024-05-04T01:02:43.399513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-04T01:02:43.399377+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-04T01:02:43.399377+0000","last_clean_scrub_stamp":"2024-05-04T01:02:43.399377+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:20:40.773259+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"28'30","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.701599+0000","last_change":"2024-05-04T00:31:21.407554+0000","last_active":"2024-05-04T01:02:31.701599+0000","last_peered":"2024-05-04T01:02:31.701599+0000","last_clean":"2024-05-04T01:02:31.701599+0000","last_became_active":"2024-05-04T00:31:21.403004+0000","last_became_peered":"2024-05-04T00:31:21.403004+0000","last_unstale":"2024-05-04T01:02:31.701599+0000","last_undegraded":"2024-05-04T01:02:31.701599+0000","last_fullsized":"2024-05-04T01:02:31.701599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:23.316664+0000","last_change":"2024-05-04T00:31:19.187116+0000","last_active":"2024-05-04T01:02:23.316664+0000","last_peered":"2024-05-04T01:02:23.316664+0000","last_clean":"2024-05-04T01:02:23.316664+0000","last_became_active":"2024-05-04T00:31:19.186540+0000","last_became_peered":"2024-05-04T00:31:19.186540+0000","last_unstale":"2024-05-04T01:02:23.316664+0000","last_undegraded":"2024-05-04T01:02:23.316664+0000","last_fullsized":"2024-05-04T01:02:23.316664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:08.420067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"28'41","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.841668+0000","last_change":"2024-05-04T00:31:21.407986+0000","last_active":"2024-05-04T01:02:31.841668+0000","last_peered":"2024-05-04T01:02:31.841668+0000","last_clean":"2024-05-04T01:02:31.841668+0000","last_became_active":"2024-05-04T00:31:21.404350+0000","last_became_peered":"2024-05-04T00:31:21.404350+0000","last_unstale":"2024-05-04T01:02:31.841668+0000","last_undegraded":"2024-05-04T01:02:31.841668+0000","last_fullsized":"2024-05-04T01:02:31.841668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'2","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:49.459385+0000","last_change":"2024-05-04T00:31:19.190045+0000","last_active":"2024-05-04T01:02:49.459385+0000","last_peered":"2024-05-04T01:02:49.459385+0000","last_clean":"2024-05-04T01:02:49.459385+0000","last_became_active":"2024-05-04T00:31:19.189166+0000","last_became_peered":"2024-05-04T00:31:19.189166+0000","last_unstale":"2024-05-04T01:02:49.459385+0000","last_undegraded":"2024-05-04T01:02:49.459385+0000","last_fullsized":"2024-05-04T01:02:49.459385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"28'36","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:43.338640+0000","last_change":"2024-05-04T00:31:21.402171+0000","last_active":"2024-05-04T01:02:43.338640+0000","last_peered":"2024-05-04T01:02:43.338640+0000","last_clean":"2024-05-04T01:02:43.338640+0000","last_became_active":"2024-05-04T00:31:21.401467+0000","last_became_peered":"2024-05-04T00:31:21.401467+0000","last_unstale":"2024-05-04T01:02:43.338640+0000","last_undegraded":"2024-05-04T01:02:43.338640+0000","last_fullsized":"2024-05-04T01:02:43.338640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:03.938611+0000","last_change":"2024-05-04T00:31:19.155210+0000","last_active":"2024-05-04T01:02:03.938611+0000","last_peered":"2024-05-04T01:02:03.938611+0000","last_clean":"2024-05-04T01:02:03.938611+0000","last_became_active":"2024-05-04T00:31:19.154504+0000","last_became_peered":"2024-05-04T00:31:19.154504+0000","last_unstale":"2024-05-04T01:02:03.938611+0000","last_undegraded":"2024-05-04T01:02:03.938611+0000","last_fullsized":"2024-05-04T01:02:03.938611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:47:23.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'47","reported_seq":83,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:47.030726+0000","last_change":"2024-05-04T00:31:21.406273+0000","last_active":"2024-05-04T01:02:47.030726+0000","last_peered":"2024-05-04T01:02:47.030726+0000","last_clean":"2024-05-04T01:02:47.030726+0000","last_became_active":"2024-05-04T00:31:21.405283+0000","last_became_peered":"2024-05-04T00:31:21.405283+0000","last_unstale":"2024-05-04T01:02:47.030726+0000","last_undegraded":"2024-05-04T01:02:47.030726+0000","last_fullsized":"2024-05-04T01:02:47.030726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'74","reported_seq":147,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:45.231275+0000","last_change":"2024-05-04T01:02:45.231375+0000","last_active":"2024-05-04T01:02:45.231275+0000","last_peered":"2024-05-04T01:02:45.231275+0000","last_clean":"2024-05-04T01:02:45.231275+0000","last_became_active":"2024-05-04T00:30:40.838353+0000","last_became_peered":"2024-05-04T00:30:40.838353+0000","last_unstale":"2024-05-04T01:02:45.231275+0000","last_undegraded":"2024-05-04T01:02:45.231275+0000","last_fullsized":"2024-05-04T01:02:45.231275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2024-05-04T01:02:45.231117+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2024-05-04T01:02:45.231117+0000","last_clean_scrub_stamp":"2024-05-04T01:02:45.231117+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:22:34.140682+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"28'7","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:35.518617+0000","last_change":"2024-05-04T00:31:19.248691+0000","last_active":"2024-05-04T01:02:35.518617+0000","last_peered":"2024-05-04T01:02:35.518617+0000","last_clean":"2024-05-04T01:02:35.518617+0000","last_became_active":"2024-05-04T00:31:19.247815+0000","last_became_peered":"2024-05-04T00:31:19.247815+0000","last_unstale":"2024-05-04T01:02:35.518617+0000","last_undegraded":"2024-05-04T01:02:35.518617+0000","last_fullsized":"2024-05-04T01:02:35.518617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"28'34","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.533474+0000","last_change":"2024-05-04T00:31:21.446500+0000","last_active":"2024-05-04T01:02:31.533474+0000","last_peered":"2024-05-04T01:02:31.533474+0000","last_clean":"2024-05-04T01:02:31.533474+0000","last_became_active":"2024-05-04T00:31:21.446100+0000","last_became_peered":"2024-05-04T00:31:21.446100+0000","last_unstale":"2024-05-04T01:02:31.533474+0000","last_undegraded":"2024-05-04T01:02:31.533474+0000","last_fullsized":"2024-05-04T01:02:31.533474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:06.542614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"28'10","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:29.340473+0000","last_change":"2024-05-04T00:31:19.184044+0000","last_active":"2024-05-04T01:02:29.340473+0000","last_peered":"2024-05-04T01:02:29.340473+0000","last_clean":"2024-05-04T01:02:29.340473+0000","last_became_active":"2024-05-04T00:31:19.181956+0000","last_became_peered":"2024-05-04T00:31:19.181956+0000","last_unstale":"2024-05-04T01:02:29.340473+0000","last_undegraded":"2024-05-04T01:02:29.340473+0000","last_fullsized":"2024-05-04T01:02:29.340473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"28'23","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.425515+0000","last_change":"2024-05-04T00:31:21.343953+0000","last_active":"2024-05-04T01:02:31.425515+0000","last_peered":"2024-05-04T01:02:31.425515+0000","last_clean":"2024-05-04T01:02:31.425515+0000","last_became_active":"2024-05-04T00:31:21.343499+0000","last_became_peered":"2024-05-04T00:31:21.343499+0000","last_unstale":"2024-05-04T01:02:31.425515+0000","last_undegraded":"2024-05-04T01:02:31.425515+0000","last_fullsized":"2024-05-04T01:02:31.425515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:57:33.938895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"28'477","reported_seq":982,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.802778+0000","last_change":"2024-05-04T00:31:19.184947+0000","last_active":"2024-05-04T01:02:31.802778+0000","last_peered":"2024-05-04T01:02:31.802778+0000","last_clean":"2024-05-04T01:02:31.802778+0000","last_became_active":"2024-05-04T00:31:19.184606+0000","last_became_peered":"2024-05-04T00:31:19.184606+0000","last_unstale":"2024-05-04T01:02:31.802778+0000","last_undegraded":"2024-05-04T01:02:31.802778+0000","last_fullsized":"2024-05-04T01:02:31.802778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:07:49.638230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109877,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":465,"num_read_kb":490,"num_write":474,"num_write_kb":495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"28'42","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.461279+0000","last_change":"2024-05-04T00:31:21.402799+0000","last_active":"2024-05-04T01:02:31.461279+0000","last_peered":"2024-05-04T01:02:31.461279+0000","last_clean":"2024-05-04T01:02:31.461279+0000","last_became_active":"2024-05-04T00:31:21.401591+0000","last_became_peered":"2024-05-04T00:31:21.401591+0000","last_unstale":"2024-05-04T01:02:31.461279+0000","last_undegraded":"2024-05-04T01:02:31.461279+0000","last_fullsized":"2024-05-04T01:02:31.461279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"28'6","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:35.518550+0000","last_change":"2024-05-04T00:31:19.182214+0000","last_active":"2024-05-04T01:02:35.518550+0000","last_peered":"2024-05-04T01:02:35.518550+0000","last_clean":"2024-05-04T01:02:35.518550+0000","last_became_active":"2024-05-04T00:31:19.180317+0000","last_became_peered":"2024-05-04T00:31:19.180317+0000","last_unstale":"2024-05-04T01:02:35.518550+0000","last_undegraded":"2024-05-04T01:02:35.518550+0000","last_fullsized":"2024-05-04T01:02:35.518550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"28'41","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.432070+0000","last_change":"2024-05-04T00:32:21.647507+0000","last_active":"2024-05-04T01:02:31.432070+0000","last_peered":"2024-05-04T01:02:31.432070+0000","last_clean":"2024-05-04T01:02:31.432070+0000","last_became_active":"2024-05-04T00:32:21.646617+0000","last_became_peered":"2024-05-04T00:32:21.646617+0000","last_unstale":"2024-05-04T01:02:31.432070+0000","last_undegraded":"2024-05-04T01:02:31.432070+0000","last_fullsized":"2024-05-04T01:02:31.432070+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:09:35.958415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"28'2","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:35.404064+0000","last_change":"2024-05-04T00:31:19.183991+0000","last_active":"2024-05-04T01:02:35.404064+0000","last_peered":"2024-05-04T01:02:35.404064+0000","last_clean":"2024-05-04T01:02:35.404064+0000","last_became_active":"2024-05-04T00:31:19.179785+0000","last_became_peered":"2024-05-04T00:31:19.179785+0000","last_unstale":"2024-05-04T01:02:35.404064+0000","last_undegraded":"2024-05-04T01:02:35.404064+0000","last_fullsized":"2024-05-04T01:02:35.404064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"28'35","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:45.695323+0000","last_change":"2024-05-04T00:31:21.342687+0000","last_active":"2024-05-04T01:02:45.695323+0000","last_peered":"2024-05-04T01:02:45.695323+0000","last_clean":"2024-05-04T01:02:45.695323+0000","last_became_active":"2024-05-04T00:31:21.341702+0000","last_became_peered":"2024-05-04T00:31:21.341702+0000","last_unstale":"2024-05-04T01:02:45.695323+0000","last_undegraded":"2024-05-04T01:02:45.695323+0000","last_fullsized":"2024-05-04T01:02:45.695323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":3658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:45.520643+0000","last_change":"2024-05-04T00:31:19.176663+0000","last_active":"2024-05-04T01:02:45.520643+0000","last_peered":"2024-05-04T01:02:45.520643+0000","last_clean":"2024-05-04T01:02:45.520643+0000","last_became_active":"2024-05-04T00:31:19.175616+0000","last_became_peered":"2024-05-04T00:31:19.175616+0000","last_unstale":"2024-05-04T01:02:45.520643+0000","last_undegraded":"2024-05-04T01:02:45.520643+0000","last_fullsized":"2024-05-04T01:02:45.520643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'38","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.419685+0000","last_change":"2024-05-04T00:31:21.403129+0000","last_active":"2024-05-04T01:02:31.419685+0000","last_peered":"2024-05-04T01:02:31.419685+0000","last_clean":"2024-05-04T01:02:31.419685+0000","last_became_active":"2024-05-04T00:31:21.402248+0000","last_became_peered":"2024-05-04T00:31:21.402248+0000","last_unstale":"2024-05-04T01:02:31.419685+0000","last_undegraded":"2024-05-04T01:02:31.419685+0000","last_fullsized":"2024-05-04T01:02:31.419685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:10.771050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":1649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"28'1198","reported_seq":1237,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:30.508455+0000","last_change":"2024-05-04T00:31:19.155903+0000","last_active":"2024-05-04T01:02:30.508455+0000","last_peered":"2024-05-04T01:02:30.508455+0000","last_clean":"2024-05-04T01:02:30.508455+0000","last_became_active":"2024-05-04T00:31:19.154909+0000","last_became_peered":"2024-05-04T00:31:19.154909+0000","last_unstale":"2024-05-04T01:02:30.508455+0000","last_undegraded":"2024-05-04T01:02:30.508455+0000","last_fullsized":"2024-05-04T01:02:30.508455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":1198,"log_dups_size":0,"ondisk_log_size":1198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:53:25.815241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2862,"num_write_kb":974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'37","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.549167+0000","last_change":"2024-05-04T00:31:21.445396+0000","last_active":"2024-05-04T01:02:31.549167+0000","last_peered":"2024-05-04T01:02:31.549167+0000","last_clean":"2024-05-04T01:02:31.549167+0000","last_became_active":"2024-05-04T00:31:21.444934+0000","last_became_peered":"2024-05-04T00:31:21.444934+0000","last_unstale":"2024-05-04T01:02:31.549167+0000","last_undegraded":"2024-05-04T01:02:31.549167+0000","last_fullsized":"2024-05-04T01:02:31.549167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:23:02.407000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'10","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.906233+0000","last_change":"2024-05-04T00:31:19.182946+0000","last_active":"2024-05-04T01:02:31.906233+0000","last_peered":"2024-05-04T01:02:31.906233+0000","last_clean":"2024-05-04T01:02:31.906233+0000","last_became_active":"2024-05-04T00:31:19.182050+0000","last_became_peered":"2024-05-04T00:31:19.182050+0000","last_unstale":"2024-05-04T01:02:31.906233+0000","last_undegraded":"2024-05-04T01:02:31.906233+0000","last_fullsized":"2024-05-04T01:02:31.906233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'45","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.537417+0000","last_change":"2024-05-04T00:31:21.443100+0000","last_active":"2024-05-04T01:02:31.537417+0000","last_peered":"2024-05-04T01:02:31.537417+0000","last_clean":"2024-05-04T01:02:31.537417+0000","last_became_active":"2024-05-04T00:31:21.442602+0000","last_became_peered":"2024-05-04T00:31:21.442602+0000","last_unstale":"2024-05-04T01:02:31.537417+0000","last_undegraded":"2024-05-04T01:02:31.537417+0000","last_fullsized":"2024-05-04T01:02:31.537417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:16:45.807230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":5859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'5","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:48.350029+0000","last_change":"2024-05-04T01:02:48.350114+0000","last_active":"2024-05-04T01:02:48.350029+0000","last_peered":"2024-05-04T01:02:48.350029+0000","last_clean":"2024-05-04T01:02:48.350029+0000","last_became_active":"2024-05-04T00:31:19.247822+0000","last_became_peered":"2024-05-04T00:31:19.247822+0000","last_unstale":"2024-05-04T01:02:48.350029+0000","last_undegraded":"2024-05-04T01:02:48.350029+0000","last_fullsized":"2024-05-04T01:02:48.350029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-04T01:02:48.349881+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-04T01:02:48.349881+0000","last_clean_scrub_stamp":"2024-05-04T01:02:48.349881+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:11:49.104480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"28'37","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.654812+0000","last_change":"2024-05-04T00:31:21.441959+0000","last_active":"2024-05-04T01:02:31.654812+0000","last_peered":"2024-05-04T01:02:31.654812+0000","last_clean":"2024-05-04T01:02:31.654812+0000","last_became_active":"2024-05-04T00:31:21.441015+0000","last_became_peered":"2024-05-04T00:31:21.441015+0000","last_unstale":"2024-05-04T01:02:31.654812+0000","last_undegraded":"2024-05-04T01:02:31.654812+0000","last_fullsized":"2024-05-04T01:02:31.654812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'10","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:23.316808+0000","last_change":"2024-05-04T00:31:19.159146+0000","last_active":"2024-05-04T01:02:23.316808+0000","last_peered":"2024-05-04T01:02:23.316808+0000","last_clean":"2024-05-04T01:02:23.316808+0000","last_became_active":"2024-05-04T00:31:19.158366+0000","last_became_peered":"2024-05-04T00:31:19.158366+0000","last_unstale":"2024-05-04T01:02:23.316808+0000","last_undegraded":"2024-05-04T01:02:23.316808+0000","last_fullsized":"2024-05-04T01:02:23.316808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:32:07.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'51","reported_seq":86,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.533109+0000","last_change":"2024-05-04T00:31:21.441521+0000","last_active":"2024-05-04T01:02:31.533109+0000","last_peered":"2024-05-04T01:02:31.533109+0000","last_clean":"2024-05-04T01:02:31.533109+0000","last_became_active":"2024-05-04T00:31:21.441074+0000","last_became_peered":"2024-05-04T00:31:21.441074+0000","last_unstale":"2024-05-04T01:02:31.533109+0000","last_undegraded":"2024-05-04T01:02:31.533109+0000","last_fullsized":"2024-05-04T01:02:31.533109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:00:31.926158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"28'3","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:02.977229+0000","last_change":"2024-05-04T00:31:19.174493+0000","last_active":"2024-05-04T01:02:02.977229+0000","last_peered":"2024-05-04T01:02:02.977229+0000","last_clean":"2024-05-04T01:02:02.977229+0000","last_became_active":"2024-05-04T00:31:19.174113+0000","last_became_peered":"2024-05-04T00:31:19.174113+0000","last_unstale":"2024-05-04T01:02:02.977229+0000","last_undegraded":"2024-05-04T01:02:02.977229+0000","last_fullsized":"2024-05-04T01:02:02.977229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:00:54.336528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"28'49","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.454655+0000","last_change":"2024-05-04T00:31:21.406782+0000","last_active":"2024-05-04T01:02:31.454655+0000","last_peered":"2024-05-04T01:02:31.454655+0000","last_clean":"2024-05-04T01:02:31.454655+0000","last_became_active":"2024-05-04T00:31:21.406008+0000","last_became_peered":"2024-05-04T00:31:21.406008+0000","last_unstale":"2024-05-04T01:02:31.454655+0000","last_undegraded":"2024-05-04T01:02:31.454655+0000","last_fullsized":"2024-05-04T01:02:31.454655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:24:01.565048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":5340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"28'574","reported_seq":614,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:47.030762+0000","last_change":"2024-05-04T00:31:19.248682+0000","last_active":"2024-05-04T01:02:47.030762+0000","last_peered":"2024-05-04T01:02:47.030762+0000","last_clean":"2024-05-04T01:02:47.030762+0000","last_became_active":"2024-05-04T00:31:19.247736+0000","last_became_peered":"2024-05-04T00:31:19.247736+0000","last_unstale":"2024-05-04T01:02:47.030762+0000","last_undegraded":"2024-05-04T01:02:47.030762+0000","last_fullsized":"2024-05-04T01:02:47.030762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":570,"num_write_kb":4382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"28'46","reported_seq":82,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.695022+0000","last_change":"2024-05-04T00:31:21.401858+0000","last_active":"2024-05-04T01:02:31.695022+0000","last_peered":"2024-05-04T01:02:31.695022+0000","last_clean":"2024-05-04T01:02:31.695022+0000","last_became_active":"2024-05-04T00:31:21.400935+0000","last_became_peered":"2024-05-04T00:31:21.400935+0000","last_unstale":"2024-05-04T01:02:31.695022+0000","last_undegraded":"2024-05-04T01:02:31.695022+0000","last_fullsized":"2024-05-04T01:02:31.695022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"28'52","reported_seq":86,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.697009+0000","last_change":"2024-05-04T00:31:21.392918+0000","last_active":"2024-05-04T01:02:31.697009+0000","last_peered":"2024-05-04T01:02:31.697009+0000","last_clean":"2024-05-04T01:02:31.697009+0000","last_became_active":"2024-05-04T00:31:21.392020+0000","last_became_peered":"2024-05-04T00:31:21.392020+0000","last_unstale":"2024-05-04T01:02:31.697009+0000","last_undegraded":"2024-05-04T01:02:31.697009+0000","last_fullsized":"2024-05-04T01:02:31.697009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":3157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"28'6","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:46.374117+0000","last_change":"2024-05-04T01:02:46.374195+0000","last_active":"2024-05-04T01:02:46.374117+0000","last_peered":"2024-05-04T01:02:46.374117+0000","last_clean":"2024-05-04T01:02:46.374117+0000","last_became_active":"2024-05-04T00:31:19.185156+0000","last_became_peered":"2024-05-04T00:31:19.185156+0000","last_unstale":"2024-05-04T01:02:46.374117+0000","last_undegraded":"2024-05-04T01:02:46.374117+0000","last_fullsized":"2024-05-04T01:02:46.374117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-04T01:02:46.373887+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-04T01:02:46.373887+0000","last_clean_scrub_stamp":"2024-05-04T01:02:46.373887+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:07:01.552297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'39","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.367803+0000","last_change":"2024-05-04T00:31:21.397596+0000","last_active":"2024-05-04T01:02:31.367803+0000","last_peered":"2024-05-04T01:02:31.367803+0000","last_clean":"2024-05-04T01:02:31.367803+0000","last_became_active":"2024-05-04T00:31:21.396023+0000","last_became_peered":"2024-05-04T00:31:21.396023+0000","last_unstale":"2024-05-04T01:02:31.367803+0000","last_undegraded":"2024-05-04T01:02:31.367803+0000","last_fullsized":"2024-05-04T01:02:31.367803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"28'13","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:47.341262+0000","last_change":"2024-05-04T01:02:47.341300+0000","last_active":"2024-05-04T01:02:47.341262+0000","last_peered":"2024-05-04T01:02:47.341262+0000","last_clean":"2024-05-04T01:02:47.341262+0000","last_became_active":"2024-05-04T00:31:19.188359+0000","last_became_peered":"2024-05-04T00:31:19.188359+0000","last_unstale":"2024-05-04T01:02:47.341262+0000","last_undegraded":"2024-05-04T01:02:47.341262+0000","last_fullsized":"2024-05-04T01:02:47.341262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2024-05-04T01:02:47.341169+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2024-05-04T01:02:47.341169+0000","last_clean_scrub_stamp":"2024-05-04T01:02:47.341169+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:20:01.076349+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"28'51","reported_seq":88,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:35.404178+0000","last_change":"2024-05-04T00:31:21.417364+0000","last_active":"2024-05-04T01:02:35.404178+0000","last_peered":"2024-05-04T01:02:35.404178+0000","last_clean":"2024-05-04T01:02:35.404178+0000","last_became_active":"2024-05-04T00:31:21.416267+0000","last_became_peered":"2024-05-04T00:31:21.416267+0000","last_unstale":"2024-05-04T01:02:35.404178+0000","last_undegraded":"2024-05-04T01:02:35.404178+0000","last_fullsized":"2024-05-04T01:02:35.404178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":6244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"28'119","reported_seq":160,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:35.083582+0000","last_change":"2024-05-04T00:31:19.187081+0000","last_active":"2024-05-04T01:02:35.083582+0000","last_peered":"2024-05-04T01:02:35.083582+0000","last_clean":"2024-05-04T01:02:35.083582+0000","last_became_active":"2024-05-04T00:31:19.186483+0000","last_became_peered":"2024-05-04T00:31:19.186483+0000","last_unstale":"2024-05-04T01:02:35.083582+0000","last_undegraded":"2024-05-04T01:02:35.083582+0000","last_fullsized":"2024-05-04T01:02:35.083582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092188,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":1130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"28'29","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:31.461491+0000","last_change":"2024-05-04T00:31:21.414034+0000","last_active":"2024-05-04T01:02:31.461491+0000","last_peered":"2024-05-04T01:02:31.461491+0000","last_clean":"2024-05-04T01:02:31.461491+0000","last_became_active":"2024-05-04T00:31:21.413330+0000","last_became_peered":"2024-05-04T00:31:21.413330+0000","last_unstale":"2024-05-04T01:02:31.461491+0000","last_undegraded":"2024-05-04T01:02:31.461491+0000","last_fullsized":"2024-05-04T01:02:31.461491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:19.876417+0000","last_clean_scrub_stamp":"2024-05-04T00:31:19.876417+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":2406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"28'620","reported_seq":660,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:11.537008+0000","last_change":"2024-05-04T00:31:19.175936+0000","last_active":"2024-05-04T01:02:11.537008+0000","last_peered":"2024-05-04T01:02:11.537008+0000","last_clean":"2024-05-04T01:02:11.537008+0000","last_became_active":"2024-05-04T00:31:19.175356+0000","last_became_peered":"2024-05-04T00:31:19.175356+0000","last_unstale":"2024-05-04T01:02:11.537008+0000","last_undegraded":"2024-05-04T01:02:11.537008+0000","last_fullsized":"2024-05-04T01:02:11.537008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T00:31:17.525434+0000","last_clean_scrub_stamp":"2024-05-04T00:31:17.525434+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:33.026019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":4428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2165,"num_write_kb":250211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2827,"ondisk_log_size":2827,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22178359,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":465,"num_read_kb":490,"num_write":6723,"num_write_kb":24988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44507136,"data_stored":44356718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5174,"ondisk_log_size":5174,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509832,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":4396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":4501504,"data_stored":4307686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509832,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35536,"kb_used_data":8520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336304,"statfs":{"total":96636764160,"available":96600375296,"internally_reserved":0,"allocated":8724480,"data_stored":8502444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509833,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43828,"kb_used_data":8492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328012,"statfs":{"total":96636764160,"available":96591884288,"internally_reserved":0,"allocated":8695808,"data_stored":8500910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509833,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":897024,"data_stored":702124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509833,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43900,"kb_used_data":4404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327940,"statfs":{"total":96636764160,"available":96591810560,"internally_reserved":0,"allocated":4509696,"data_stored":4307216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542536,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1523712,"data_stored":1314479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542536,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41496,"kb_used_data":6160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330344,"statfs":{"total":96636764160,"available":96594272256,"internally_reserved":0,"allocated":6307840,"data_stored":6099629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542536,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52088,"kb_used_data":12592,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319752,"statfs":{"total":96636764160,"available":96583426048,"internally_reserved":0,"allocated":12894208,"data_stored":12695734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4195620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12599296,"data_stored":12584138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8429568,"data_stored":8390848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5419008,"data_stored":5397665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4196090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1228800,"data_stored":1202883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T01:02:53.469 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.469 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.469 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.469 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.469 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.470 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.470 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.470 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.470 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.470 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.470 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.470 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.470 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.470 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.471 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.471 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.471 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.471 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.471 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.471 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.471 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.471 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.472 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.472 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.472 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.472 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.472 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.472 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.472 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.472 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.472 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.472 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.473 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.473 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.473 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.473 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.473 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.473 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.473 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.473 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.473 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.473 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.474 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.474 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.474 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.474 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.474 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.474 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.474 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.474 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.474 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.475 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.475 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.475 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.475 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.475 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.475 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.475 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.475 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.475 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.475 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.475 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.476 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.476 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.476 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.476 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.476 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.476 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.476 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.476 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.476 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.477 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.477 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.477 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.477 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.477 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.477 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-04T00:31:19.876417+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=19, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.477 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-05-04T00:31:17.525434+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=0, tm_min=31, tm_sec=17, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=1, tm_min=2, tm_sec=41, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T01:02:53.477 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-04T01:02:54.324 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:02:54.326 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:03:06.938 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:33:11.699 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T01:03:06.941 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:33:11.703 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T01:03:07.034 INFO:tasks.ceph.mon.a.smithi006.stderr:==00:00:33:11.796 27722== Warning: unimplemented fcntl command: 1036 2024-05-04T01:03:07.072 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:33:11.783 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T01:03:07.075 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:33:11.786 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T01:03:07.080 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:33:11.790 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T01:03:07.088 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:33:11.798 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T01:03:07.130 INFO:tasks.ceph.mon.c.smithi163.stderr:==00:00:33:11.841 27849== Warning: unimplemented fcntl command: 1036 2024-05-04T01:03:07.150 INFO:tasks.ceph.mon.b.smithi163.stderr:==00:00:33:11.860 27848== Warning: unimplemented fcntl command: 1036 2024-05-04T01:03:13.478 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T01:03:13.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.640+0000 7f464035b640 1 Processor -- start 2024-05-04T01:03:13.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.640+0000 7f464035b640 1 -- start start 2024-05-04T01:03:13.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.640+0000 7f464035b640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f46380c7120 0x7f4638152820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.640+0000 7f464035b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f46380726f0 0x7f46380c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.640+0000 7f464035b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46380ca300 0x7f463806f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.640+0000 7f464035b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f4638073010 con 0x7f46380726f0 2024-05-04T01:03:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.640+0000 7f464035b640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f46380c5ec0 con 0x7f46380c7120 2024-05-04T01:03:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.640+0000 7f464035b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f46380c61a0 con 0x7f46380ca300 2024-05-04T01:03:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.644+0000 7f463d8f6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f46380726f0 0x7f46380c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:13.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.644+0000 7f463d8f6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f46380726f0 0x7f46380c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59290/0 (socket says 172.21.15.6:59290) 2024-05-04T01:03:13.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.644+0000 7f463e8f8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46380ca300 0x7f463806f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:13.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.644+0000 7f463d8f6640 1 -- 172.21.15.6:0/1542422939 learned_addr learned my addr 172.21.15.6:0/1542422939 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:03:13.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.644+0000 7f463e0f7640 1 --2- 172.21.15.6:0/1542422939 >> v2:172.21.15.163:3300/0 conn(0x7f46380c7120 0x7f4638152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:13.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.648+0000 7f463d8f6640 1 -- 172.21.15.6:0/1542422939 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46380ca300 msgr2=0x7f463806f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:03:13.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.648+0000 7f463d8f6640 1 --2- 172.21.15.6:0/1542422939 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46380ca300 0x7f463806f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:13.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.648+0000 7f463d8f6640 1 -- 172.21.15.6:0/1542422939 >> v2:172.21.15.163:3300/0 conn(0x7f46380c7120 msgr2=0x7f4638152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:03:13.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.648+0000 7f463d8f6640 1 --2- 172.21.15.6:0/1542422939 >> v2:172.21.15.163:3300/0 conn(0x7f46380c7120 0x7f4638152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:13.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.648+0000 7f463d8f6640 1 -- 172.21.15.6:0/1542422939 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46380c6480 con 0x7f46380726f0 2024-05-04T01:03:13.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.648+0000 7f463d8f6640 1 --2- 172.21.15.6:0/1542422939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46380726f0 0x7f46380c7af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4638070ae0 tx=0x7f463401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864059eebca15fb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:13.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.656+0000 7f463d0f5640 1 -- 172.21.15.6:0/1542422939 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46340b5070 con 0x7f46380726f0 2024-05-04T01:03:13.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.656+0000 7f463d0f5640 1 -- 172.21.15.6:0/1542422939 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46340a89d0 con 0x7f46380726f0 2024-05-04T01:03:13.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.656+0000 7f463d0f5640 1 -- 172.21.15.6:0/1542422939 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46340a8da0 con 0x7f46380726f0 2024-05-04T01:03:13.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.656+0000 7f464035b640 1 -- 172.21.15.6:0/1542422939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46380726f0 msgr2=0x7f46380c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:13.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.656+0000 7f464035b640 1 --2- 172.21.15.6:0/1542422939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46380726f0 0x7f46380c7af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4638070ae0 tx=0x7f463401ed10 comp rx=0 tx=0).stop 2024-05-04T01:03:13.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.656+0000 7f464035b640 1 -- 172.21.15.6:0/1542422939 shutdown_connections 2024-05-04T01:03:13.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.656+0000 7f464035b640 1 --2- 172.21.15.6:0/1542422939 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46380ca300 0x7f463806f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:13.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.656+0000 7f464035b640 1 --2- 172.21.15.6:0/1542422939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46380726f0 0x7f46380c7af0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:13.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.656+0000 7f464035b640 1 --2- 172.21.15.6:0/1542422939 >> v2:172.21.15.163:3300/0 conn(0x7f46380c7120 0x7f4638152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:13.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.656+0000 7f464035b640 1 -- 172.21.15.6:0/1542422939 >> 172.21.15.6:0/1542422939 conn(0x7f463806cf70 msgr2=0x7f46380c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:03:13.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.656+0000 7f464035b640 1 -- 172.21.15.6:0/1542422939 shutdown_connections 2024-05-04T01:03:13.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.656+0000 7f464035b640 1 -- 172.21.15.6:0/1542422939 wait complete. 2024-05-04T01:03:13.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.660+0000 7f464035b640 1 Processor -- start 2024-05-04T01:03:13.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.660+0000 7f464035b640 1 -- start start 2024-05-04T01:03:13.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.660+0000 7f464035b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46380726f0 0x7f46380cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:13.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.660+0000 7f464035b640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f46380c7120 0x7f46381468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:13.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.660+0000 7f464035b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46380ca300 0x7f4638146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:13.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.660+0000 7f464035b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f46380c6760 con 0x7f46380726f0 2024-05-04T01:03:13.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.660+0000 7f464035b640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f46380c8030 con 0x7f46380c7120 2024-05-04T01:03:13.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.660+0000 7f464035b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f4638072b00 con 0x7f46380ca300 2024-05-04T01:03:13.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.660+0000 7f463e0f7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46380726f0 0x7f46380cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:13.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.660+0000 7f463e0f7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46380726f0 0x7f46380cb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59300/0 (socket says 172.21.15.6:59300) 2024-05-04T01:03:13.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.660+0000 7f463e0f7640 1 -- 172.21.15.6:0/586036346 learned_addr learned my addr 172.21.15.6:0/586036346 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:03:13.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.660+0000 7f463e8f8640 1 --2- 172.21.15.6:0/586036346 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46380ca300 0x7f4638146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:13.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.660+0000 7f463d8f6640 1 --2- 172.21.15.6:0/586036346 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f46380c7120 0x7f46381468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:13.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.664+0000 7f463e0f7640 1 -- 172.21.15.6:0/586036346 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46380ca300 msgr2=0x7f4638146e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:13.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.664+0000 7f463e0f7640 1 --2- 172.21.15.6:0/586036346 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46380ca300 0x7f4638146e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:13.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.664+0000 7f463e0f7640 1 -- 172.21.15.6:0/586036346 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f46380c7120 msgr2=0x7f46381468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:13.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.664+0000 7f463e0f7640 1 --2- 172.21.15.6:0/586036346 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f46380c7120 0x7f46381468d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:13.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.664+0000 7f463e0f7640 1 -- 172.21.15.6:0/586036346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463815c610 con 0x7f46380726f0 2024-05-04T01:03:13.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.668+0000 7f463e0f7640 1 --2- 172.21.15.6:0/586036346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46380726f0 0x7f46380cb1b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f462800e8a0 tx=0x7f462800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:13.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.672+0000 7f462effd640 1 -- 172.21.15.6:0/586036346 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4628017070 con 0x7f46380726f0 2024-05-04T01:03:13.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.672+0000 7f462effd640 1 -- 172.21.15.6:0/586036346 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f462800c940 con 0x7f46380726f0 2024-05-04T01:03:13.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.672+0000 7f462effd640 1 -- 172.21.15.6:0/586036346 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462800ccf0 con 0x7f46380726f0 2024-05-04T01:03:13.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.672+0000 7f464035b640 1 -- 172.21.15.6:0/586036346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46380ccd50 con 0x7f46380726f0 2024-05-04T01:03:13.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.672+0000 7f464035b640 1 -- 172.21.15.6:0/586036346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46380cd310 con 0x7f46380726f0 2024-05-04T01:03:13.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.672+0000 7f464035b640 1 -- 172.21.15.6:0/586036346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f463806a390 con 0x7f46380726f0 2024-05-04T01:03:13.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.696+0000 7f462effd640 1 -- 172.21.15.6:0/586036346 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f462801a070 con 0x7f46380726f0 2024-05-04T01:03:13.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.696+0000 7f462effd640 1 --2- 172.21.15.6:0/586036346 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f461c06f480 0x7f461c071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:13.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.696+0000 7f463d8f6640 1 --2- 172.21.15.6:0/586036346 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f461c06f480 0x7f461c071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:13.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.700+0000 7f463d8f6640 1 --2- 172.21.15.6:0/586036346 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f461c06f480 0x7f461c071990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f46340b2000 tx=0x7f46340aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:13.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:13.700+0000 7f462effd640 1 -- 172.21.15.6:0/586036346 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f4628058430 con 0x7f46380726f0 2024-05-04T01:03:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.012+0000 7f462effd640 1 -- 172.21.15.6:0/586036346 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f462805c1a0 con 0x7f46380726f0 2024-05-04T01:03:14.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.216+0000 7f464035b640 1 -- 172.21.15.6:0/586036346 --> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f463815bd80 con 0x7f461c06f480 2024-05-04T01:03:14.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.236+0000 7f462effd640 1 -- 172.21.15.6:0/586036346 <== mgr.4103 v2:172.21.15.163:6800/2152694980 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253089 (secure 0 0 0) 0x7f46340fdcc0 con 0x7f461c06f480 2024-05-04T01:03:14.242 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T01:03:14.243 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-04T01:03:14.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.240+0000 7f464035b640 1 -- 172.21.15.6:0/586036346 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f461c06f480 msgr2=0x7f461c071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:14.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.240+0000 7f464035b640 1 --2- 172.21.15.6:0/586036346 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f461c06f480 0x7f461c071990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f46340b2000 tx=0x7f46340aa070 comp rx=0 tx=0).stop 2024-05-04T01:03:14.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.240+0000 7f464035b640 1 -- 172.21.15.6:0/586036346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46380726f0 msgr2=0x7f46380cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:14.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.240+0000 7f464035b640 1 --2- 172.21.15.6:0/586036346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46380726f0 0x7f46380cb1b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f462800e8a0 tx=0x7f462800eca0 comp rx=0 tx=0).stop 2024-05-04T01:03:14.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.240+0000 7f464035b640 1 -- 172.21.15.6:0/586036346 shutdown_connections 2024-05-04T01:03:14.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.240+0000 7f464035b640 1 --2- 172.21.15.6:0/586036346 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f46380c7120 0x7f46381468d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:14.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.240+0000 7f464035b640 1 --2- 172.21.15.6:0/586036346 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f461c06f480 0x7f461c071990 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:14.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.240+0000 7f464035b640 1 --2- 172.21.15.6:0/586036346 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46380ca300 0x7f4638146e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:14.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.240+0000 7f464035b640 1 --2- 172.21.15.6:0/586036346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46380726f0 0x7f46380cb1b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:14.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.240+0000 7f464035b640 1 -- 172.21.15.6:0/586036346 >> 172.21.15.6:0/586036346 conn(0x7f463806cf70 msgr2=0x7f4638151a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:03:14.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.240+0000 7f464035b640 1 -- 172.21.15.6:0/586036346 shutdown_connections 2024-05-04T01:03:14.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.240+0000 7f464035b640 1 -- 172.21.15.6:0/586036346 wait complete. 2024-05-04T01:03:14.267 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":1004,"stamp":"2024-05-04T01:03:12.399806+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22768727,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":531,"num_read_kb":545,"num_write":8989,"num_write_kb":276827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8118,"ondisk_log_size":8118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317136,"kb_used_data":46928,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754657584,"statfs":{"total":773094113280,"available":772769366016,"internally_reserved":0,"allocated":48054272,"data_stored":46430222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004893"},"pg_stats":[{"pgid":"3.3f","version":"28'39","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:57.282764+0000","last_change":"2024-05-04T01:02:57.282905+0000","last_active":"2024-05-04T01:02:57.282764+0000","last_peered":"2024-05-04T01:02:57.282764+0000","last_clean":"2024-05-04T01:02:57.282764+0000","last_became_active":"2024-05-04T00:31:21.409386+0000","last_became_peered":"2024-05-04T00:31:21.409386+0000","last_unstale":"2024-05-04T01:02:57.282764+0000","last_undegraded":"2024-05-04T01:02:57.282764+0000","last_fullsized":"2024-05-04T01:02:57.282764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'39","last_scrub_stamp":"2024-05-04T01:02:57.282365+0000","last_deep_scrub":"28'39","last_deep_scrub_stamp":"2024-05-04T01:02:57.282365+0000","last_clean_scrub_stamp":"2024-05-04T01:02:57.282365+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:37:12.159486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":2475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'39","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:55.376528+0000","last_change":"2024-05-04T01:02:55.376602+0000","last_active":"2024-05-04T01:02:55.376528+0000","last_peered":"2024-05-04T01:02:55.376528+0000","last_clean":"2024-05-04T01:02:55.376528+0000","last_became_active":"2024-05-04T00:31:21.396255+0000","last_became_peered":"2024-05-04T00:31:21.396255+0000","last_unstale":"2024-05-04T01:02:55.376528+0000","last_undegraded":"2024-05-04T01:02:55.376528+0000","last_fullsized":"2024-05-04T01:02:55.376528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'39","last_scrub_stamp":"2024-05-04T01:02:55.376293+0000","last_deep_scrub":"28'39","last_deep_scrub_stamp":"2024-05-04T01:02:55.376293+0000","last_clean_scrub_stamp":"2024-05-04T01:02:55.376293+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:28:07.636756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":1259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'53","reported_seq":98,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:03:05.287282+0000","last_change":"2024-05-04T01:03:05.287353+0000","last_active":"2024-05-04T01:03:05.287282+0000","last_peered":"2024-05-04T01:03:05.287282+0000","last_clean":"2024-05-04T01:03:05.287282+0000","last_became_active":"2024-05-04T00:31:21.442507+0000","last_became_peered":"2024-05-04T00:31:21.442507+0000","last_unstale":"2024-05-04T01:03:05.287282+0000","last_undegraded":"2024-05-04T01:03:05.287282+0000","last_fullsized":"2024-05-04T01:03:05.287282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'53","last_scrub_stamp":"2024-05-04T01:03:05.287031+0000","last_deep_scrub":"28'53","last_deep_scrub_stamp":"2024-05-04T01:03:05.287031+0000","last_clean_scrub_stamp":"2024-05-04T01:03:05.287031+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:13:34.063449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":2592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"28'34","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:52.346611+0000","last_change":"2024-05-04T01:02:52.346704+0000","last_active":"2024-05-04T01:02:52.346611+0000","last_peered":"2024-05-04T01:02:52.346611+0000","last_clean":"2024-05-04T01:02:52.346611+0000","last_became_active":"2024-05-04T00:31:21.440935+0000","last_became_peered":"2024-05-04T00:31:21.440935+0000","last_unstale":"2024-05-04T01:02:52.346611+0000","last_undegraded":"2024-05-04T01:02:52.346611+0000","last_fullsized":"2024-05-04T01:02:52.346611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'34","last_scrub_stamp":"2024-05-04T01:02:52.346360+0000","last_deep_scrub":"28'34","last_deep_scrub_stamp":"2024-05-04T01:02:52.346360+0000","last_clean_scrub_stamp":"2024-05-04T01:02:52.346360+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:56:16.720908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":1417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'35","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:56.326741+0000","last_change":"2024-05-04T01:02:56.326908+0000","last_active":"2024-05-04T01:02:56.326741+0000","last_peered":"2024-05-04T01:02:56.326741+0000","last_clean":"2024-05-04T01:02:56.326741+0000","last_became_active":"2024-05-04T00:31:21.402554+0000","last_became_peered":"2024-05-04T00:31:21.402554+0000","last_unstale":"2024-05-04T01:02:56.326741+0000","last_undegraded":"2024-05-04T01:02:56.326741+0000","last_fullsized":"2024-05-04T01:02:56.326741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'35","last_scrub_stamp":"2024-05-04T01:02:56.326418+0000","last_deep_scrub":"28'35","last_deep_scrub_stamp":"2024-05-04T01:02:56.326418+0000","last_clean_scrub_stamp":"2024-05-04T01:02:56.326418+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:26:49.948035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":2934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'51","reported_seq":93,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:53.355016+0000","last_change":"2024-05-04T01:02:53.355087+0000","last_active":"2024-05-04T01:02:53.355016+0000","last_peered":"2024-05-04T01:02:53.355016+0000","last_clean":"2024-05-04T01:02:53.355016+0000","last_became_active":"2024-05-04T00:31:21.441082+0000","last_became_peered":"2024-05-04T00:31:21.441082+0000","last_unstale":"2024-05-04T01:02:53.355016+0000","last_undegraded":"2024-05-04T01:02:53.355016+0000","last_fullsized":"2024-05-04T01:02:53.355016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'51","last_scrub_stamp":"2024-05-04T01:02:53.354789+0000","last_deep_scrub":"28'51","last_deep_scrub_stamp":"2024-05-04T01:02:53.354789+0000","last_clean_scrub_stamp":"2024-05-04T01:02:53.354789+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:49:23.401866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":4527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"28'38","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:58.311717+0000","last_change":"2024-05-04T01:02:58.311795+0000","last_active":"2024-05-04T01:02:58.311717+0000","last_peered":"2024-05-04T01:02:58.311717+0000","last_clean":"2024-05-04T01:02:58.311717+0000","last_became_active":"2024-05-04T00:31:21.440766+0000","last_became_peered":"2024-05-04T00:31:21.440766+0000","last_unstale":"2024-05-04T01:02:58.311717+0000","last_undegraded":"2024-05-04T01:02:58.311717+0000","last_fullsized":"2024-05-04T01:02:58.311717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'38","last_scrub_stamp":"2024-05-04T01:02:58.311439+0000","last_deep_scrub":"28'38","last_deep_scrub_stamp":"2024-05-04T01:02:58.311439+0000","last_clean_scrub_stamp":"2024-05-04T01:02:58.311439+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:27:12.998668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":2716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"28'27","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:59.390317+0000","last_change":"2024-05-04T01:02:59.390386+0000","last_active":"2024-05-04T01:02:59.390317+0000","last_peered":"2024-05-04T01:02:59.390317+0000","last_clean":"2024-05-04T01:02:59.390317+0000","last_became_active":"2024-05-04T00:31:21.407785+0000","last_became_peered":"2024-05-04T00:31:21.407785+0000","last_unstale":"2024-05-04T01:02:59.390317+0000","last_undegraded":"2024-05-04T01:02:59.390317+0000","last_fullsized":"2024-05-04T01:02:59.390317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'27","last_scrub_stamp":"2024-05-04T01:02:59.390094+0000","last_deep_scrub":"28'27","last_deep_scrub_stamp":"2024-05-04T01:02:59.390094+0000","last_clean_scrub_stamp":"2024-05-04T01:02:59.390094+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:26:07.378427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"28'58","reported_seq":101,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:49.209281+0000","last_change":"2024-05-04T01:02:49.209281+0000","last_active":"2024-05-04T01:02:49.209281+0000","last_peered":"2024-05-04T01:02:49.209281+0000","last_clean":"2024-05-04T01:02:49.209281+0000","last_became_active":"2024-05-04T00:31:21.400001+0000","last_became_peered":"2024-05-04T00:31:21.400001+0000","last_unstale":"2024-05-04T01:02:49.209281+0000","last_undegraded":"2024-05-04T01:02:49.209281+0000","last_fullsized":"2024-05-04T01:02:49.209281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'58","last_scrub_stamp":"2024-05-04T01:02:49.208987+0000","last_deep_scrub":"28'58","last_deep_scrub_stamp":"2024-05-04T01:02:49.208987+0000","last_clean_scrub_stamp":"2024-05-04T01:02:49.208987+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:11:32.476629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":3953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"28'49","reported_seq":92,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:49.375546+0000","last_change":"2024-05-04T01:02:49.375682+0000","last_active":"2024-05-04T01:02:49.375546+0000","last_peered":"2024-05-04T01:02:49.375546+0000","last_clean":"2024-05-04T01:02:49.375546+0000","last_became_active":"2024-05-04T00:31:21.389347+0000","last_became_peered":"2024-05-04T00:31:21.389347+0000","last_unstale":"2024-05-04T01:02:49.375546+0000","last_undegraded":"2024-05-04T01:02:49.375546+0000","last_fullsized":"2024-05-04T01:02:49.375546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'49","last_scrub_stamp":"2024-05-04T01:02:49.375195+0000","last_deep_scrub":"28'49","last_deep_scrub_stamp":"2024-05-04T01:02:49.375195+0000","last_clean_scrub_stamp":"2024-05-04T01:02:49.375195+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:35:18.637804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":5065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'36","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:51.304686+0000","last_change":"2024-05-04T01:02:51.304742+0000","last_active":"2024-05-04T01:02:51.304686+0000","last_peered":"2024-05-04T01:02:51.304686+0000","last_clean":"2024-05-04T01:02:51.304686+0000","last_became_active":"2024-05-04T00:31:21.385949+0000","last_became_peered":"2024-05-04T00:31:21.385949+0000","last_unstale":"2024-05-04T01:02:51.304686+0000","last_undegraded":"2024-05-04T01:02:51.304686+0000","last_fullsized":"2024-05-04T01:02:51.304686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2024-05-04T01:02:51.304523+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2024-05-04T01:02:51.304523+0000","last_clean_scrub_stamp":"2024-05-04T01:02:51.304523+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:14:14.099938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"28'26","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:54.366877+0000","last_change":"2024-05-04T01:02:54.366959+0000","last_active":"2024-05-04T01:02:54.366877+0000","last_peered":"2024-05-04T01:02:54.366877+0000","last_clean":"2024-05-04T01:02:54.366877+0000","last_became_active":"2024-05-04T00:31:21.404557+0000","last_became_peered":"2024-05-04T00:31:21.404557+0000","last_unstale":"2024-05-04T01:02:54.366877+0000","last_undegraded":"2024-05-04T01:02:54.366877+0000","last_fullsized":"2024-05-04T01:02:54.366877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26","last_scrub_stamp":"2024-05-04T01:02:54.366729+0000","last_deep_scrub":"28'26","last_deep_scrub_stamp":"2024-05-04T01:02:54.366729+0000","last_clean_scrub_stamp":"2024-05-04T01:02:54.366729+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:41:55.956799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'80","reported_seq":123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:56.900766+0000","last_change":"2024-05-04T01:02:56.900837+0000","last_active":"2024-05-04T01:02:56.900766+0000","last_peered":"2024-05-04T01:02:56.900766+0000","last_clean":"2024-05-04T01:02:56.900766+0000","last_became_active":"2024-05-04T00:31:21.387958+0000","last_became_peered":"2024-05-04T00:31:21.387958+0000","last_unstale":"2024-05-04T01:02:56.900766+0000","last_undegraded":"2024-05-04T01:02:56.900766+0000","last_fullsized":"2024-05-04T01:02:56.900766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'80","last_scrub_stamp":"2024-05-04T01:02:56.900537+0000","last_deep_scrub":"28'80","last_deep_scrub_stamp":"2024-05-04T01:02:56.900537+0000","last_clean_scrub_stamp":"2024-05-04T01:02:56.900537+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:44:58.869071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":3559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"28'48","reported_seq":91,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:59.895365+0000","last_change":"2024-05-04T01:02:59.895432+0000","last_active":"2024-05-04T01:02:59.895365+0000","last_peered":"2024-05-04T01:02:59.895365+0000","last_clean":"2024-05-04T01:02:59.895365+0000","last_became_active":"2024-05-04T00:31:21.401495+0000","last_became_peered":"2024-05-04T00:31:21.401495+0000","last_unstale":"2024-05-04T01:02:59.895365+0000","last_undegraded":"2024-05-04T01:02:59.895365+0000","last_fullsized":"2024-05-04T01:02:59.895365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'48","last_scrub_stamp":"2024-05-04T01:02:59.895149+0000","last_deep_scrub":"28'48","last_deep_scrub_stamp":"2024-05-04T01:02:59.895149+0000","last_clean_scrub_stamp":"2024-05-04T01:02:59.895149+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:24:13.748436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":5060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"28'52","reported_seq":95,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:03:01.360228+0000","last_change":"2024-05-04T01:03:01.360413+0000","last_active":"2024-05-04T01:03:01.360228+0000","last_peered":"2024-05-04T01:03:01.360228+0000","last_clean":"2024-05-04T01:03:01.360228+0000","last_became_active":"2024-05-04T00:31:21.410489+0000","last_became_peered":"2024-05-04T00:31:21.410489+0000","last_unstale":"2024-05-04T01:03:01.360228+0000","last_undegraded":"2024-05-04T01:03:01.360228+0000","last_fullsized":"2024-05-04T01:03:01.360228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'52","last_scrub_stamp":"2024-05-04T01:03:01.359960+0000","last_deep_scrub":"28'52","last_deep_scrub_stamp":"2024-05-04T01:03:01.359960+0000","last_clean_scrub_stamp":"2024-05-04T01:03:01.359960+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:05:41.128310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'49","reported_seq":92,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:50.110973+0000","last_change":"2024-05-04T01:02:50.111006+0000","last_active":"2024-05-04T01:02:50.110973+0000","last_peered":"2024-05-04T01:02:50.110973+0000","last_clean":"2024-05-04T01:02:50.110973+0000","last_became_active":"2024-05-04T00:31:21.186141+0000","last_became_peered":"2024-05-04T00:31:21.186141+0000","last_unstale":"2024-05-04T01:02:50.110973+0000","last_undegraded":"2024-05-04T01:02:50.110973+0000","last_fullsized":"2024-05-04T01:02:50.110973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'49","last_scrub_stamp":"2024-05-04T01:02:50.110865+0000","last_deep_scrub":"28'49","last_deep_scrub_stamp":"2024-05-04T01:02:50.110865+0000","last_clean_scrub_stamp":"2024-05-04T01:02:50.110865+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:21:55.356249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":5921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"28'39","reported_seq":82,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:03:05.042753+0000","last_change":"2024-05-04T01:03:05.042848+0000","last_active":"2024-05-04T01:03:05.042753+0000","last_peered":"2024-05-04T01:03:05.042753+0000","last_clean":"2024-05-04T01:03:05.042753+0000","last_became_active":"2024-05-04T00:31:21.389108+0000","last_became_peered":"2024-05-04T00:31:21.389108+0000","last_unstale":"2024-05-04T01:03:05.042753+0000","last_undegraded":"2024-05-04T01:03:05.042753+0000","last_fullsized":"2024-05-04T01:03:05.042753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'39","last_scrub_stamp":"2024-05-04T01:03:05.042472+0000","last_deep_scrub":"28'39","last_deep_scrub_stamp":"2024-05-04T01:03:05.042472+0000","last_clean_scrub_stamp":"2024-05-04T01:03:05.042472+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:20:42.699517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'50","reported_seq":93,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:57.958091+0000","last_change":"2024-05-04T01:02:57.958169+0000","last_active":"2024-05-04T01:02:57.958091+0000","last_peered":"2024-05-04T01:02:57.958091+0000","last_clean":"2024-05-04T01:02:57.958091+0000","last_became_active":"2024-05-04T00:31:21.417914+0000","last_became_peered":"2024-05-04T00:31:21.417914+0000","last_unstale":"2024-05-04T01:02:57.958091+0000","last_undegraded":"2024-05-04T01:02:57.958091+0000","last_fullsized":"2024-05-04T01:02:57.958091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'50","last_scrub_stamp":"2024-05-04T01:02:57.957836+0000","last_deep_scrub":"28'50","last_deep_scrub_stamp":"2024-05-04T01:02:57.957836+0000","last_clean_scrub_stamp":"2024-05-04T01:02:57.957836+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:21:24.788969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":3403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"28'50","reported_seq":94,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:03:07.006827+0000","last_change":"2024-05-04T01:03:07.006929+0000","last_active":"2024-05-04T01:03:07.006827+0000","last_peered":"2024-05-04T01:03:07.006827+0000","last_clean":"2024-05-04T01:03:07.006827+0000","last_became_active":"2024-05-04T00:31:21.440945+0000","last_became_peered":"2024-05-04T00:31:21.440945+0000","last_unstale":"2024-05-04T01:03:07.006827+0000","last_undegraded":"2024-05-04T01:03:07.006827+0000","last_fullsized":"2024-05-04T01:03:07.006827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'50","last_scrub_stamp":"2024-05-04T01:03:07.006586+0000","last_deep_scrub":"28'50","last_deep_scrub_stamp":"2024-05-04T01:03:07.006586+0000","last_clean_scrub_stamp":"2024-05-04T01:03:07.006586+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:51:02.039444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":6197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"28'63","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:50.342761+0000","last_change":"2024-05-04T01:02:50.342761+0000","last_active":"2024-05-04T01:02:50.342761+0000","last_peered":"2024-05-04T01:02:50.342761+0000","last_clean":"2024-05-04T01:02:50.342761+0000","last_became_active":"2024-05-04T00:31:21.394461+0000","last_became_peered":"2024-05-04T00:31:21.394461+0000","last_unstale":"2024-05-04T01:02:50.342761+0000","last_undegraded":"2024-05-04T01:02:50.342761+0000","last_fullsized":"2024-05-04T01:02:50.342761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'63","last_scrub_stamp":"2024-05-04T01:02:50.342563+0000","last_deep_scrub":"28'63","last_deep_scrub_stamp":"2024-05-04T01:02:50.342563+0000","last_clean_scrub_stamp":"2024-05-04T01:02:50.342563+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:44:57.201352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"28'59","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:58.447905+0000","last_change":"2024-05-04T01:02:58.447975+0000","last_active":"2024-05-04T01:02:58.447905+0000","last_peered":"2024-05-04T01:02:58.447905+0000","last_clean":"2024-05-04T01:02:58.447905+0000","last_became_active":"2024-05-04T00:31:21.446250+0000","last_became_peered":"2024-05-04T00:31:21.446250+0000","last_unstale":"2024-05-04T01:02:58.447905+0000","last_undegraded":"2024-05-04T01:02:58.447905+0000","last_fullsized":"2024-05-04T01:02:58.447905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'59","last_scrub_stamp":"2024-05-04T01:02:58.447692+0000","last_deep_scrub":"28'59","last_deep_scrub_stamp":"2024-05-04T01:02:58.447692+0000","last_clean_scrub_stamp":"2024-05-04T01:02:58.447692+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:20:12.182872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":5743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"28'39","reported_seq":83,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:51.159214+0000","last_change":"2024-05-04T01:02:51.159214+0000","last_active":"2024-05-04T01:02:51.159214+0000","last_peered":"2024-05-04T01:02:51.159214+0000","last_clean":"2024-05-04T01:02:51.159214+0000","last_became_active":"2024-05-04T00:31:21.413073+0000","last_became_peered":"2024-05-04T00:31:21.413073+0000","last_unstale":"2024-05-04T01:02:51.159214+0000","last_undegraded":"2024-05-04T01:02:51.159214+0000","last_fullsized":"2024-05-04T01:02:51.159214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'39","last_scrub_stamp":"2024-05-04T01:02:51.158877+0000","last_deep_scrub":"28'39","last_deep_scrub_stamp":"2024-05-04T01:02:51.158877+0000","last_clean_scrub_stamp":"2024-05-04T01:02:51.158877+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:54:38.178296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"28'57","reported_seq":101,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:57.396504+0000","last_change":"2024-05-04T01:02:57.396576+0000","last_active":"2024-05-04T01:02:57.396504+0000","last_peered":"2024-05-04T01:02:57.396504+0000","last_clean":"2024-05-04T01:02:57.396504+0000","last_became_active":"2024-05-04T00:31:21.402985+0000","last_became_peered":"2024-05-04T00:31:21.402985+0000","last_unstale":"2024-05-04T01:02:57.396504+0000","last_undegraded":"2024-05-04T01:02:57.396504+0000","last_fullsized":"2024-05-04T01:02:57.396504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'57","last_scrub_stamp":"2024-05-04T01:02:57.396270+0000","last_deep_scrub":"28'57","last_deep_scrub_stamp":"2024-05-04T01:02:57.396270+0000","last_clean_scrub_stamp":"2024-05-04T01:02:57.396270+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:45:04.255059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":5055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'40","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:03:01.971870+0000","last_change":"2024-05-04T01:03:01.971944+0000","last_active":"2024-05-04T01:03:01.971870+0000","last_peered":"2024-05-04T01:03:01.971870+0000","last_clean":"2024-05-04T01:03:01.971870+0000","last_became_active":"2024-05-04T00:31:21.392368+0000","last_became_peered":"2024-05-04T00:31:21.392368+0000","last_unstale":"2024-05-04T01:03:01.971870+0000","last_undegraded":"2024-05-04T01:03:01.971870+0000","last_fullsized":"2024-05-04T01:03:01.971870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'40","last_scrub_stamp":"2024-05-04T01:03:01.971635+0000","last_deep_scrub":"28'40","last_deep_scrub_stamp":"2024-05-04T01:03:01.971635+0000","last_clean_scrub_stamp":"2024-05-04T01:03:01.971635+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:05:23.033959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":4444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"28'33","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:03:03.278773+0000","last_change":"2024-05-04T01:03:03.278844+0000","last_active":"2024-05-04T01:03:03.278773+0000","last_peered":"2024-05-04T01:03:03.278773+0000","last_clean":"2024-05-04T01:03:03.278773+0000","last_became_active":"2024-05-04T00:31:21.415540+0000","last_became_peered":"2024-05-04T00:31:21.415540+0000","last_unstale":"2024-05-04T01:03:03.278773+0000","last_undegraded":"2024-05-04T01:03:03.278773+0000","last_fullsized":"2024-05-04T01:03:03.278773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'33","last_scrub_stamp":"2024-05-04T01:03:03.278535+0000","last_deep_scrub":"28'33","last_deep_scrub_stamp":"2024-05-04T01:03:03.278535+0000","last_clean_scrub_stamp":"2024-05-04T01:03:03.278535+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:44:13.565517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"28'72","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:48.421693+0000","last_change":"2024-05-04T01:02:48.421747+0000","last_active":"2024-05-04T01:02:48.421693+0000","last_peered":"2024-05-04T01:02:48.421693+0000","last_clean":"2024-05-04T01:02:48.421693+0000","last_became_active":"2024-05-04T00:31:21.187877+0000","last_became_peered":"2024-05-04T00:31:21.187877+0000","last_unstale":"2024-05-04T01:02:48.421693+0000","last_undegraded":"2024-05-04T01:02:48.421693+0000","last_fullsized":"2024-05-04T01:02:48.421693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'72","last_scrub_stamp":"2024-05-04T01:02:48.421548+0000","last_deep_scrub":"28'72","last_deep_scrub_stamp":"2024-05-04T01:02:48.421548+0000","last_clean_scrub_stamp":"2024-05-04T01:02:48.421548+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:27:46.334395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":3181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"28'39","reported_seq":83,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:57.883853+0000","last_change":"2024-05-04T01:02:57.883928+0000","last_active":"2024-05-04T01:02:57.883853+0000","last_peered":"2024-05-04T01:02:57.883853+0000","last_clean":"2024-05-04T01:02:57.883853+0000","last_became_active":"2024-05-04T00:31:21.392579+0000","last_became_peered":"2024-05-04T00:31:21.392579+0000","last_unstale":"2024-05-04T01:02:57.883853+0000","last_undegraded":"2024-05-04T01:02:57.883853+0000","last_fullsized":"2024-05-04T01:02:57.883853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'39","last_scrub_stamp":"2024-05-04T01:02:57.883619+0000","last_deep_scrub":"28'39","last_deep_scrub_stamp":"2024-05-04T01:02:57.883619+0000","last_clean_scrub_stamp":"2024-05-04T01:02:57.883619+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:13:47.555788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":2828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"28'30","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:58.891936+0000","last_change":"2024-05-04T01:02:58.892076+0000","last_active":"2024-05-04T01:02:58.891936+0000","last_peered":"2024-05-04T01:02:58.891936+0000","last_clean":"2024-05-04T01:02:58.891936+0000","last_became_active":"2024-05-04T00:31:21.394966+0000","last_became_peered":"2024-05-04T00:31:21.394966+0000","last_unstale":"2024-05-04T01:02:58.891936+0000","last_undegraded":"2024-05-04T01:02:58.891936+0000","last_fullsized":"2024-05-04T01:02:58.891936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'30","last_scrub_stamp":"2024-05-04T01:02:58.891572+0000","last_deep_scrub":"28'30","last_deep_scrub_stamp":"2024-05-04T01:02:58.891572+0000","last_clean_scrub_stamp":"2024-05-04T01:02:58.891572+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:28:46.701042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"28'34","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:58.373983+0000","last_change":"2024-05-04T01:02:58.374140+0000","last_active":"2024-05-04T01:02:58.373983+0000","last_peered":"2024-05-04T01:02:58.373983+0000","last_clean":"2024-05-04T01:02:58.373983+0000","last_became_active":"2024-05-04T00:31:21.403779+0000","last_became_peered":"2024-05-04T00:31:21.403779+0000","last_unstale":"2024-05-04T01:02:58.373983+0000","last_undegraded":"2024-05-04T01:02:58.373983+0000","last_fullsized":"2024-05-04T01:02:58.373983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'34","last_scrub_stamp":"2024-05-04T01:02:58.373718+0000","last_deep_scrub":"28'34","last_deep_scrub_stamp":"2024-05-04T01:02:58.373718+0000","last_clean_scrub_stamp":"2024-05-04T01:02:58.373718+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:10:31.298148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":2736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"28'56","reported_seq":101,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:03:02.963665+0000","last_change":"2024-05-04T01:03:02.963741+0000","last_active":"2024-05-04T01:03:02.963665+0000","last_peered":"2024-05-04T01:03:02.963665+0000","last_clean":"2024-05-04T01:03:02.963665+0000","last_became_active":"2024-05-04T00:31:21.398994+0000","last_became_peered":"2024-05-04T00:31:21.398994+0000","last_unstale":"2024-05-04T01:03:02.963665+0000","last_undegraded":"2024-05-04T01:03:02.963665+0000","last_fullsized":"2024-05-04T01:03:02.963665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'56","last_scrub_stamp":"2024-05-04T01:03:02.963405+0000","last_deep_scrub":"28'56","last_deep_scrub_stamp":"2024-05-04T01:03:02.963405+0000","last_clean_scrub_stamp":"2024-05-04T01:03:02.963405+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:37:02.162593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":5289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"28'49","reported_seq":94,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:56.930228+0000","last_change":"2024-05-04T01:02:56.930311+0000","last_active":"2024-05-04T01:02:56.930228+0000","last_peered":"2024-05-04T01:02:56.930228+0000","last_clean":"2024-05-04T01:02:56.930228+0000","last_became_active":"2024-05-04T00:31:21.415395+0000","last_became_peered":"2024-05-04T00:31:21.415395+0000","last_unstale":"2024-05-04T01:02:56.930228+0000","last_undegraded":"2024-05-04T01:02:56.930228+0000","last_fullsized":"2024-05-04T01:02:56.930228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'49","last_scrub_stamp":"2024-05-04T01:02:56.929985+0000","last_deep_scrub":"28'49","last_deep_scrub_stamp":"2024-05-04T01:02:56.929985+0000","last_clean_scrub_stamp":"2024-05-04T01:02:56.929985+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:59:39.135963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":6794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'61","reported_seq":106,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:49.379807+0000","last_change":"2024-05-04T01:02:49.379950+0000","last_active":"2024-05-04T01:02:49.379807+0000","last_peered":"2024-05-04T01:02:49.379807+0000","last_clean":"2024-05-04T01:02:49.379807+0000","last_became_active":"2024-05-04T00:31:21.341333+0000","last_became_peered":"2024-05-04T00:31:21.341333+0000","last_unstale":"2024-05-04T01:02:49.379807+0000","last_undegraded":"2024-05-04T01:02:49.379807+0000","last_fullsized":"2024-05-04T01:02:49.379807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'61","last_scrub_stamp":"2024-05-04T01:02:49.379476+0000","last_deep_scrub":"28'61","last_deep_scrub_stamp":"2024-05-04T01:02:49.379476+0000","last_clean_scrub_stamp":"2024-05-04T01:02:49.379476+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:11:32.647119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":5609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"28'25","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:50.173141+0000","last_change":"2024-05-04T01:02:50.173176+0000","last_active":"2024-05-04T01:02:50.173141+0000","last_peered":"2024-05-04T01:02:50.173141+0000","last_clean":"2024-05-04T01:02:50.173141+0000","last_became_active":"2024-05-04T00:31:21.403998+0000","last_became_peered":"2024-05-04T00:31:21.403998+0000","last_unstale":"2024-05-04T01:02:50.173141+0000","last_undegraded":"2024-05-04T01:02:50.173141+0000","last_fullsized":"2024-05-04T01:02:50.173141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'25","last_scrub_stamp":"2024-05-04T01:02:50.173025+0000","last_deep_scrub":"28'25","last_deep_scrub_stamp":"2024-05-04T01:02:50.173025+0000","last_clean_scrub_stamp":"2024-05-04T01:02:50.173025+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:26:15.930404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"28'497","reported_seq":543,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:50.405280+0000","last_change":"2024-05-04T01:02:50.405314+0000","last_active":"2024-05-04T01:02:50.405280+0000","last_peered":"2024-05-04T01:02:50.405280+0000","last_clean":"2024-05-04T01:02:50.405280+0000","last_became_active":"2024-05-04T00:31:19.181107+0000","last_became_peered":"2024-05-04T00:31:19.181107+0000","last_unstale":"2024-05-04T01:02:50.405280+0000","last_undegraded":"2024-05-04T01:02:50.405280+0000","last_fullsized":"2024-05-04T01:02:50.405280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'497","last_scrub_stamp":"2024-05-04T01:02:50.405183+0000","last_deep_scrub":"28'497","last_deep_scrub_stamp":"2024-05-04T01:02:50.405183+0000","last_clean_scrub_stamp":"2024-05-04T01:02:50.405183+0000","objects_scrubbed":3,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:20:47.779066+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"28'45","reported_seq":87,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:56.439901+0000","last_change":"2024-05-04T01:02:56.439971+0000","last_active":"2024-05-04T01:02:56.439901+0000","last_peered":"2024-05-04T01:02:56.439901+0000","last_clean":"2024-05-04T01:02:56.439901+0000","last_became_active":"2024-05-04T00:31:21.445793+0000","last_became_peered":"2024-05-04T00:31:21.445793+0000","last_unstale":"2024-05-04T01:02:56.439901+0000","last_undegraded":"2024-05-04T01:02:56.439901+0000","last_fullsized":"2024-05-04T01:02:56.439901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'45","last_scrub_stamp":"2024-05-04T01:02:56.439681+0000","last_deep_scrub":"28'45","last_deep_scrub_stamp":"2024-05-04T01:02:56.439681+0000","last_clean_scrub_stamp":"2024-05-04T01:02:56.439681+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:52:10.721400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"28'361","reported_seq":407,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:58.050969+0000","last_change":"2024-05-04T01:02:58.051063+0000","last_active":"2024-05-04T01:02:58.050969+0000","last_peered":"2024-05-04T01:02:58.050969+0000","last_clean":"2024-05-04T01:02:58.050969+0000","last_became_active":"2024-05-04T00:31:19.183394+0000","last_became_peered":"2024-05-04T00:31:19.183394+0000","last_unstale":"2024-05-04T01:02:58.050969+0000","last_undegraded":"2024-05-04T01:02:58.050969+0000","last_fullsized":"2024-05-04T01:02:58.050969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'361","last_scrub_stamp":"2024-05-04T01:02:58.050678+0000","last_deep_scrub":"28'361","last_deep_scrub_stamp":"2024-05-04T01:02:58.050678+0000","last_clean_scrub_stamp":"2024-05-04T01:02:58.050678+0000","objects_scrubbed":2,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:04:19.280217+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":4278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:52.899039+0000","last_change":"2024-05-04T01:02:52.899039+0000","last_active":"2024-05-04T01:02:52.899039+0000","last_peered":"2024-05-04T01:02:52.899039+0000","last_clean":"2024-05-04T01:02:52.899039+0000","last_became_active":"2024-05-04T00:31:19.158152+0000","last_became_peered":"2024-05-04T00:31:19.158152+0000","last_unstale":"2024-05-04T01:02:52.899039+0000","last_undegraded":"2024-05-04T01:02:52.899039+0000","last_fullsized":"2024-05-04T01:02:52.899039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-05-04T01:02:52.898761+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-05-04T01:02:52.898761+0000","last_clean_scrub_stamp":"2024-05-04T01:02:52.898761+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:50:43.211887+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'48","reported_seq":91,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:54.366015+0000","last_change":"2024-05-04T01:02:54.366083+0000","last_active":"2024-05-04T01:02:54.366015+0000","last_peered":"2024-05-04T01:02:54.366015+0000","last_clean":"2024-05-04T01:02:54.366015+0000","last_became_active":"2024-05-04T00:31:21.393014+0000","last_became_peered":"2024-05-04T00:31:21.393014+0000","last_unstale":"2024-05-04T01:02:54.366015+0000","last_undegraded":"2024-05-04T01:02:54.366015+0000","last_fullsized":"2024-05-04T01:02:54.366015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'48","last_scrub_stamp":"2024-05-04T01:02:54.365862+0000","last_deep_scrub":"28'48","last_deep_scrub_stamp":"2024-05-04T01:02:54.365862+0000","last_clean_scrub_stamp":"2024-05-04T01:02:54.365862+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:20:08.101042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":2972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"28'7","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:59.027671+0000","last_change":"2024-05-04T01:02:59.027846+0000","last_active":"2024-05-04T01:02:59.027671+0000","last_peered":"2024-05-04T01:02:59.027671+0000","last_clean":"2024-05-04T01:02:59.027671+0000","last_became_active":"2024-05-04T00:31:19.184526+0000","last_became_peered":"2024-05-04T00:31:19.184526+0000","last_unstale":"2024-05-04T01:02:59.027671+0000","last_undegraded":"2024-05-04T01:02:59.027671+0000","last_fullsized":"2024-05-04T01:02:59.027671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-04T01:02:59.027319+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-04T01:02:59.027319+0000","last_clean_scrub_stamp":"2024-05-04T01:02:59.027319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:26:44.853636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"28'43","reported_seq":86,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:59.475143+0000","last_change":"2024-05-04T01:02:59.475171+0000","last_active":"2024-05-04T01:02:59.475143+0000","last_peered":"2024-05-04T01:02:59.475143+0000","last_clean":"2024-05-04T01:02:59.475143+0000","last_became_active":"2024-05-04T00:31:21.446842+0000","last_became_peered":"2024-05-04T00:31:21.446842+0000","last_unstale":"2024-05-04T01:02:59.475143+0000","last_undegraded":"2024-05-04T01:02:59.475143+0000","last_fullsized":"2024-05-04T01:02:59.475143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'43","last_scrub_stamp":"2024-05-04T01:02:59.475046+0000","last_deep_scrub":"28'43","last_deep_scrub_stamp":"2024-05-04T01:02:59.475046+0000","last_clean_scrub_stamp":"2024-05-04T01:02:59.475046+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:12:00.229645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"28'11","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:46.219596+0000","last_change":"2024-05-04T01:02:46.219596+0000","last_active":"2024-05-04T01:02:46.219596+0000","last_peered":"2024-05-04T01:02:46.219596+0000","last_clean":"2024-05-04T01:02:46.219596+0000","last_became_active":"2024-05-04T00:31:19.189517+0000","last_became_peered":"2024-05-04T00:31:19.189517+0000","last_unstale":"2024-05-04T01:02:46.219596+0000","last_undegraded":"2024-05-04T01:02:46.219596+0000","last_fullsized":"2024-05-04T01:02:46.219596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-05-04T01:02:46.219390+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-05-04T01:02:46.219390+0000","last_clean_scrub_stamp":"2024-05-04T01:02:46.219390+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:00:22.152354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"28'52","reported_seq":95,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:47.401240+0000","last_change":"2024-05-04T01:02:47.401240+0000","last_active":"2024-05-04T01:02:47.401240+0000","last_peered":"2024-05-04T01:02:47.401240+0000","last_clean":"2024-05-04T01:02:47.401240+0000","last_became_active":"2024-05-04T00:31:21.183698+0000","last_became_peered":"2024-05-04T00:31:21.183698+0000","last_unstale":"2024-05-04T01:02:47.401240+0000","last_undegraded":"2024-05-04T01:02:47.401240+0000","last_fullsized":"2024-05-04T01:02:47.401240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'52","last_scrub_stamp":"2024-05-04T01:02:47.401095+0000","last_deep_scrub":"28'52","last_deep_scrub_stamp":"2024-05-04T01:02:47.401095+0000","last_clean_scrub_stamp":"2024-05-04T01:02:47.401095+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:51:44.309632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":3598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"28'6","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:45.374683+0000","last_change":"2024-05-04T01:02:45.374683+0000","last_active":"2024-05-04T01:02:45.374683+0000","last_peered":"2024-05-04T01:02:45.374683+0000","last_clean":"2024-05-04T01:02:45.374683+0000","last_became_active":"2024-05-04T00:31:19.185633+0000","last_became_peered":"2024-05-04T00:31:19.185633+0000","last_unstale":"2024-05-04T01:02:45.374683+0000","last_undegraded":"2024-05-04T01:02:45.374683+0000","last_fullsized":"2024-05-04T01:02:45.374683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-04T01:02:45.374371+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-04T01:02:45.374371+0000","last_clean_scrub_stamp":"2024-05-04T01:02:45.374371+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:51:59.656090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"28'45","reported_seq":88,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:03:00.350983+0000","last_change":"2024-05-04T01:03:00.351055+0000","last_active":"2024-05-04T01:03:00.350983+0000","last_peered":"2024-05-04T01:03:00.350983+0000","last_clean":"2024-05-04T01:03:00.350983+0000","last_became_active":"2024-05-04T00:31:21.409655+0000","last_became_peered":"2024-05-04T00:31:21.409655+0000","last_unstale":"2024-05-04T01:03:00.350983+0000","last_undegraded":"2024-05-04T01:03:00.350983+0000","last_fullsized":"2024-05-04T01:03:00.350983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'45","last_scrub_stamp":"2024-05-04T01:03:00.350765+0000","last_deep_scrub":"28'45","last_deep_scrub_stamp":"2024-05-04T01:03:00.350765+0000","last_clean_scrub_stamp":"2024-05-04T01:03:00.350765+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:04:15.175412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":5409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"28'350","reported_seq":397,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:52.953179+0000","last_change":"2024-05-04T01:02:52.953290+0000","last_active":"2024-05-04T01:02:52.953179+0000","last_peered":"2024-05-04T01:02:52.953179+0000","last_clean":"2024-05-04T01:02:52.953179+0000","last_became_active":"2024-05-04T00:31:19.177283+0000","last_became_peered":"2024-05-04T00:31:19.177283+0000","last_unstale":"2024-05-04T01:02:52.953179+0000","last_undegraded":"2024-05-04T01:02:52.953179+0000","last_fullsized":"2024-05-04T01:02:52.953179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'350","last_scrub_stamp":"2024-05-04T01:02:52.952955+0000","last_deep_scrub":"28'350","last_deep_scrub_stamp":"2024-05-04T01:02:52.952955+0000","last_clean_scrub_stamp":"2024-05-04T01:02:52.952955+0000","objects_scrubbed":3,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:27:50.717448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"28'47","reported_seq":90,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:48.037356+0000","last_change":"2024-05-04T01:02:48.037540+0000","last_active":"2024-05-04T01:02:48.037356+0000","last_peered":"2024-05-04T01:02:48.037356+0000","last_clean":"2024-05-04T01:02:48.037356+0000","last_became_active":"2024-05-04T00:31:21.186167+0000","last_became_peered":"2024-05-04T00:31:21.186167+0000","last_unstale":"2024-05-04T01:02:48.037356+0000","last_undegraded":"2024-05-04T01:02:48.037356+0000","last_fullsized":"2024-05-04T01:02:48.037356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'47","last_scrub_stamp":"2024-05-04T01:02:48.037006+0000","last_deep_scrub":"28'47","last_deep_scrub_stamp":"2024-05-04T01:02:48.037006+0000","last_clean_scrub_stamp":"2024-05-04T01:02:48.037006+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:15:37.175801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"28'816","reported_seq":863,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:46.458801+0000","last_change":"2024-05-04T01:02:46.458836+0000","last_active":"2024-05-04T01:02:46.458801+0000","last_peered":"2024-05-04T01:02:46.458801+0000","last_clean":"2024-05-04T01:02:46.458801+0000","last_became_active":"2024-05-04T00:31:19.250003+0000","last_became_peered":"2024-05-04T00:31:19.250003+0000","last_unstale":"2024-05-04T01:02:46.458801+0000","last_undegraded":"2024-05-04T01:02:46.458801+0000","last_fullsized":"2024-05-04T01:02:46.458801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'816","last_scrub_stamp":"2024-05-04T01:02:46.458694+0000","last_deep_scrub":"28'816","last_deep_scrub_stamp":"2024-05-04T01:02:46.458694+0000","last_clean_scrub_stamp":"2024-05-04T01:02:46.458694+0000","objects_scrubbed":5,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:51:53.860931+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":4562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"28'32","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:52.333781+0000","last_change":"2024-05-04T01:02:52.333851+0000","last_active":"2024-05-04T01:02:52.333781+0000","last_peered":"2024-05-04T01:02:52.333781+0000","last_clean":"2024-05-04T01:02:52.333781+0000","last_became_active":"2024-05-04T00:31:21.397220+0000","last_became_peered":"2024-05-04T00:31:21.397220+0000","last_unstale":"2024-05-04T01:02:52.333781+0000","last_undegraded":"2024-05-04T01:02:52.333781+0000","last_fullsized":"2024-05-04T01:02:52.333781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'32","last_scrub_stamp":"2024-05-04T01:02:52.333572+0000","last_deep_scrub":"28'32","last_deep_scrub_stamp":"2024-05-04T01:02:52.333572+0000","last_clean_scrub_stamp":"2024-05-04T01:02:52.333572+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:00:49.981014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'12","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:53.924664+0000","last_change":"2024-05-04T01:02:53.924837+0000","last_active":"2024-05-04T01:02:53.924664+0000","last_peered":"2024-05-04T01:02:53.924664+0000","last_clean":"2024-05-04T01:02:53.924664+0000","last_became_active":"2024-05-04T00:31:19.183331+0000","last_became_peered":"2024-05-04T00:31:19.183331+0000","last_unstale":"2024-05-04T01:02:53.924664+0000","last_undegraded":"2024-05-04T01:02:53.924664+0000","last_fullsized":"2024-05-04T01:02:53.924664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-05-04T01:02:53.924423+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-05-04T01:02:53.924423+0000","last_clean_scrub_stamp":"2024-05-04T01:02:53.924423+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:29:45.398645+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"28'47","reported_seq":90,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:54.915083+0000","last_change":"2024-05-04T01:02:54.915157+0000","last_active":"2024-05-04T01:02:54.915083+0000","last_peered":"2024-05-04T01:02:54.915083+0000","last_clean":"2024-05-04T01:02:54.915083+0000","last_became_active":"2024-05-04T00:31:21.342064+0000","last_became_peered":"2024-05-04T00:31:21.342064+0000","last_unstale":"2024-05-04T01:02:54.915083+0000","last_undegraded":"2024-05-04T01:02:54.915083+0000","last_fullsized":"2024-05-04T01:02:54.915083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'47","last_scrub_stamp":"2024-05-04T01:02:54.914830+0000","last_deep_scrub":"28'47","last_deep_scrub_stamp":"2024-05-04T01:02:54.914830+0000","last_clean_scrub_stamp":"2024-05-04T01:02:54.914830+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:11:52.581099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"28'11","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:57.012741+0000","last_change":"2024-05-04T01:02:57.012953+0000","last_active":"2024-05-04T01:02:57.012741+0000","last_peered":"2024-05-04T01:02:57.012741+0000","last_clean":"2024-05-04T01:02:57.012741+0000","last_became_active":"2024-05-04T00:31:19.181304+0000","last_became_peered":"2024-05-04T00:31:19.181304+0000","last_unstale":"2024-05-04T01:02:57.012741+0000","last_undegraded":"2024-05-04T01:02:57.012741+0000","last_fullsized":"2024-05-04T01:02:57.012741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-05-04T01:02:57.012471+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-05-04T01:02:57.012471+0000","last_clean_scrub_stamp":"2024-05-04T01:02:57.012471+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:38:01.033960+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'62","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:51.076826+0000","last_change":"2024-05-04T01:02:51.076912+0000","last_active":"2024-05-04T01:02:51.076826+0000","last_peered":"2024-05-04T01:02:51.076826+0000","last_clean":"2024-05-04T01:02:51.076826+0000","last_became_active":"2024-05-04T00:31:21.389360+0000","last_became_peered":"2024-05-04T00:31:21.389360+0000","last_unstale":"2024-05-04T01:02:51.076826+0000","last_undegraded":"2024-05-04T01:02:51.076826+0000","last_fullsized":"2024-05-04T01:02:51.076826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'62","last_scrub_stamp":"2024-05-04T01:02:51.076573+0000","last_deep_scrub":"28'62","last_deep_scrub_stamp":"2024-05-04T01:02:51.076573+0000","last_clean_scrub_stamp":"2024-05-04T01:02:51.076573+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:56:52.754841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":7948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"28'7","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:44.389141+0000","last_change":"2024-05-04T01:02:44.389194+0000","last_active":"2024-05-04T01:02:44.389141+0000","last_peered":"2024-05-04T01:02:44.389141+0000","last_clean":"2024-05-04T01:02:44.389141+0000","last_became_active":"2024-05-04T00:31:19.175779+0000","last_became_peered":"2024-05-04T00:31:19.175779+0000","last_unstale":"2024-05-04T01:02:44.389141+0000","last_undegraded":"2024-05-04T01:02:44.389141+0000","last_fullsized":"2024-05-04T01:02:44.389141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-04T01:02:44.389001+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-04T01:02:44.389001+0000","last_clean_scrub_stamp":"2024-05-04T01:02:44.389001+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:27:00.757872+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'46","reported_seq":89,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:47.208969+0000","last_change":"2024-05-04T01:02:47.208995+0000","last_active":"2024-05-04T01:02:47.208969+0000","last_peered":"2024-05-04T01:02:47.208969+0000","last_clean":"2024-05-04T01:02:47.208969+0000","last_became_active":"2024-05-04T00:31:21.394863+0000","last_became_peered":"2024-05-04T00:31:21.394863+0000","last_unstale":"2024-05-04T01:02:47.208969+0000","last_undegraded":"2024-05-04T01:02:47.208969+0000","last_fullsized":"2024-05-04T01:02:47.208969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'46","last_scrub_stamp":"2024-05-04T01:02:47.208882+0000","last_deep_scrub":"28'46","last_deep_scrub_stamp":"2024-05-04T01:02:47.208882+0000","last_clean_scrub_stamp":"2024-05-04T01:02:47.208882+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:45:38.760763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":4347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"28'25","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:51.394034+0000","last_change":"2024-05-04T01:02:51.394154+0000","last_active":"2024-05-04T01:02:51.394034+0000","last_peered":"2024-05-04T01:02:51.394034+0000","last_clean":"2024-05-04T01:02:51.394034+0000","last_became_active":"2024-05-04T00:31:19.176805+0000","last_became_peered":"2024-05-04T00:31:19.176805+0000","last_unstale":"2024-05-04T01:02:51.394034+0000","last_undegraded":"2024-05-04T01:02:51.394034+0000","last_fullsized":"2024-05-04T01:02:51.394034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'25","last_scrub_stamp":"2024-05-04T01:02:51.393797+0000","last_deep_scrub":"28'25","last_deep_scrub_stamp":"2024-05-04T01:02:51.393797+0000","last_clean_scrub_stamp":"2024-05-04T01:02:51.393797+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:13:41.065966+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'47","reported_seq":90,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:49.081827+0000","last_change":"2024-05-04T01:02:49.081895+0000","last_active":"2024-05-04T01:02:49.081827+0000","last_peered":"2024-05-04T01:02:49.081827+0000","last_clean":"2024-05-04T01:02:49.081827+0000","last_became_active":"2024-05-04T00:31:21.187554+0000","last_became_peered":"2024-05-04T00:31:21.187554+0000","last_unstale":"2024-05-04T01:02:49.081827+0000","last_undegraded":"2024-05-04T01:02:49.081827+0000","last_fullsized":"2024-05-04T01:02:49.081827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'47","last_scrub_stamp":"2024-05-04T01:02:49.081608+0000","last_deep_scrub":"28'47","last_deep_scrub_stamp":"2024-05-04T01:02:49.081608+0000","last_clean_scrub_stamp":"2024-05-04T01:02:49.081608+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:17:28.418502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":6499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"28'8","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:43.399587+0000","last_change":"2024-05-04T01:02:43.399587+0000","last_active":"2024-05-04T01:02:43.399587+0000","last_peered":"2024-05-04T01:02:43.399587+0000","last_clean":"2024-05-04T01:02:43.399587+0000","last_became_active":"2024-05-04T00:31:19.175715+0000","last_became_peered":"2024-05-04T00:31:19.175715+0000","last_unstale":"2024-05-04T01:02:43.399587+0000","last_undegraded":"2024-05-04T01:02:43.399587+0000","last_fullsized":"2024-05-04T01:02:43.399587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-04T01:02:43.399377+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-04T01:02:43.399377+0000","last_clean_scrub_stamp":"2024-05-04T01:02:43.399377+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:20:40.773259+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"28'30","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:51.380796+0000","last_change":"2024-05-04T01:02:51.380796+0000","last_active":"2024-05-04T01:02:51.380796+0000","last_peered":"2024-05-04T01:02:51.380796+0000","last_clean":"2024-05-04T01:02:51.380796+0000","last_became_active":"2024-05-04T00:31:21.403004+0000","last_became_peered":"2024-05-04T00:31:21.403004+0000","last_unstale":"2024-05-04T01:02:51.380796+0000","last_undegraded":"2024-05-04T01:02:51.380796+0000","last_fullsized":"2024-05-04T01:02:51.380796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'30","last_scrub_stamp":"2024-05-04T01:02:51.380300+0000","last_deep_scrub":"28'30","last_deep_scrub_stamp":"2024-05-04T01:02:51.380300+0000","last_clean_scrub_stamp":"2024-05-04T01:02:51.380300+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:50:41.693426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"28'7","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:52.341852+0000","last_change":"2024-05-04T01:02:52.341852+0000","last_active":"2024-05-04T01:02:52.341852+0000","last_peered":"2024-05-04T01:02:52.341852+0000","last_clean":"2024-05-04T01:02:52.341852+0000","last_became_active":"2024-05-04T00:31:19.186540+0000","last_became_peered":"2024-05-04T00:31:19.186540+0000","last_unstale":"2024-05-04T01:02:52.341852+0000","last_undegraded":"2024-05-04T01:02:52.341852+0000","last_fullsized":"2024-05-04T01:02:52.341852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-04T01:02:52.341326+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-04T01:02:52.341326+0000","last_clean_scrub_stamp":"2024-05-04T01:02:52.341326+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:28:40.150796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"28'41","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:55.359148+0000","last_change":"2024-05-04T01:02:55.359148+0000","last_active":"2024-05-04T01:02:55.359148+0000","last_peered":"2024-05-04T01:02:55.359148+0000","last_clean":"2024-05-04T01:02:55.359148+0000","last_became_active":"2024-05-04T00:31:21.404350+0000","last_became_peered":"2024-05-04T00:31:21.404350+0000","last_unstale":"2024-05-04T01:02:55.359148+0000","last_undegraded":"2024-05-04T01:02:55.359148+0000","last_fullsized":"2024-05-04T01:02:55.359148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'41","last_scrub_stamp":"2024-05-04T01:02:55.358845+0000","last_deep_scrub":"28'41","last_deep_scrub_stamp":"2024-05-04T01:02:55.358845+0000","last_clean_scrub_stamp":"2024-05-04T01:02:55.358845+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:02:40.828817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'3","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:53.383091+0000","last_change":"2024-05-04T01:02:53.383157+0000","last_active":"2024-05-04T01:02:53.383091+0000","last_peered":"2024-05-04T01:02:53.383091+0000","last_clean":"2024-05-04T01:02:53.383091+0000","last_became_active":"2024-05-04T00:31:19.189166+0000","last_became_peered":"2024-05-04T00:31:19.189166+0000","last_unstale":"2024-05-04T01:02:53.383091+0000","last_undegraded":"2024-05-04T01:02:53.383091+0000","last_fullsized":"2024-05-04T01:02:53.383091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-05-04T01:02:53.382897+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-05-04T01:02:53.382897+0000","last_clean_scrub_stamp":"2024-05-04T01:02:53.382897+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:31:15.282255+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"28'36","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:53.361841+0000","last_change":"2024-05-04T01:02:53.361908+0000","last_active":"2024-05-04T01:02:53.361841+0000","last_peered":"2024-05-04T01:02:53.361841+0000","last_clean":"2024-05-04T01:02:53.361841+0000","last_became_active":"2024-05-04T00:31:21.401467+0000","last_became_peered":"2024-05-04T00:31:21.401467+0000","last_unstale":"2024-05-04T01:02:53.361841+0000","last_undegraded":"2024-05-04T01:02:53.361841+0000","last_fullsized":"2024-05-04T01:02:53.361841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2024-05-04T01:02:53.361615+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2024-05-04T01:02:53.361615+0000","last_clean_scrub_stamp":"2024-05-04T01:02:53.361615+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:28.254579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"28'8","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:51.853106+0000","last_change":"2024-05-04T01:02:51.853106+0000","last_active":"2024-05-04T01:02:51.853106+0000","last_peered":"2024-05-04T01:02:51.853106+0000","last_clean":"2024-05-04T01:02:51.853106+0000","last_became_active":"2024-05-04T00:31:19.154504+0000","last_became_peered":"2024-05-04T00:31:19.154504+0000","last_unstale":"2024-05-04T01:02:51.853106+0000","last_undegraded":"2024-05-04T01:02:51.853106+0000","last_fullsized":"2024-05-04T01:02:51.853106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-04T01:02:51.852765+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-04T01:02:51.852765+0000","last_clean_scrub_stamp":"2024-05-04T01:02:51.852765+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:30:06.563887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'47","reported_seq":91,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:03:06.031755+0000","last_change":"2024-05-04T01:03:06.031826+0000","last_active":"2024-05-04T01:03:06.031755+0000","last_peered":"2024-05-04T01:03:06.031755+0000","last_clean":"2024-05-04T01:03:06.031755+0000","last_became_active":"2024-05-04T00:31:21.405283+0000","last_became_peered":"2024-05-04T00:31:21.405283+0000","last_unstale":"2024-05-04T01:03:06.031755+0000","last_undegraded":"2024-05-04T01:03:06.031755+0000","last_fullsized":"2024-05-04T01:03:06.031755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'47","last_scrub_stamp":"2024-05-04T01:03:06.031523+0000","last_deep_scrub":"28'47","last_deep_scrub_stamp":"2024-05-04T01:03:06.031523+0000","last_clean_scrub_stamp":"2024-05-04T01:03:06.031523+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:39:27.962176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'74","reported_seq":148,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:45.231375+0000","last_change":"2024-05-04T01:02:45.231375+0000","last_active":"2024-05-04T01:02:45.231375+0000","last_peered":"2024-05-04T01:02:45.231375+0000","last_clean":"2024-05-04T01:02:45.231375+0000","last_became_active":"2024-05-04T00:30:40.838353+0000","last_became_peered":"2024-05-04T00:30:40.838353+0000","last_unstale":"2024-05-04T01:02:45.231375+0000","last_undegraded":"2024-05-04T01:02:45.231375+0000","last_fullsized":"2024-05-04T01:02:45.231375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2024-05-04T01:02:45.231117+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2024-05-04T01:02:45.231117+0000","last_clean_scrub_stamp":"2024-05-04T01:02:45.231117+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:22:34.140682+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"28'10","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:52.079652+0000","last_change":"2024-05-04T01:02:52.079724+0000","last_active":"2024-05-04T01:02:52.079652+0000","last_peered":"2024-05-04T01:02:52.079652+0000","last_clean":"2024-05-04T01:02:52.079652+0000","last_became_active":"2024-05-04T00:31:19.247815+0000","last_became_peered":"2024-05-04T00:31:19.247815+0000","last_unstale":"2024-05-04T01:02:52.079652+0000","last_undegraded":"2024-05-04T01:02:52.079652+0000","last_fullsized":"2024-05-04T01:02:52.079652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-05-04T01:02:52.079449+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-05-04T01:02:52.079449+0000","last_clean_scrub_stamp":"2024-05-04T01:02:52.079449+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:45:00.813548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"28'34","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:57.425809+0000","last_change":"2024-05-04T01:02:57.425889+0000","last_active":"2024-05-04T01:02:57.425809+0000","last_peered":"2024-05-04T01:02:57.425809+0000","last_clean":"2024-05-04T01:02:57.425809+0000","last_became_active":"2024-05-04T00:31:21.446100+0000","last_became_peered":"2024-05-04T00:31:21.446100+0000","last_unstale":"2024-05-04T01:02:57.425809+0000","last_undegraded":"2024-05-04T01:02:57.425809+0000","last_fullsized":"2024-05-04T01:02:57.425809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'34","last_scrub_stamp":"2024-05-04T01:02:57.425534+0000","last_deep_scrub":"28'34","last_deep_scrub_stamp":"2024-05-04T01:02:57.425534+0000","last_clean_scrub_stamp":"2024-05-04T01:02:57.425534+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:07:12.603945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"28'11","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:56.014746+0000","last_change":"2024-05-04T01:02:56.014827+0000","last_active":"2024-05-04T01:02:56.014746+0000","last_peered":"2024-05-04T01:02:56.014746+0000","last_clean":"2024-05-04T01:02:56.014746+0000","last_became_active":"2024-05-04T00:31:19.181956+0000","last_became_peered":"2024-05-04T00:31:19.181956+0000","last_unstale":"2024-05-04T01:02:56.014746+0000","last_undegraded":"2024-05-04T01:02:56.014746+0000","last_fullsized":"2024-05-04T01:02:56.014746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-05-04T01:02:56.014486+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-05-04T01:02:56.014486+0000","last_clean_scrub_stamp":"2024-05-04T01:02:56.014486+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:30:17.460993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"28'23","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:55.945908+0000","last_change":"2024-05-04T01:02:55.945986+0000","last_active":"2024-05-04T01:02:55.945908+0000","last_peered":"2024-05-04T01:02:55.945908+0000","last_clean":"2024-05-04T01:02:55.945908+0000","last_became_active":"2024-05-04T00:31:21.343499+0000","last_became_peered":"2024-05-04T00:31:21.343499+0000","last_unstale":"2024-05-04T01:02:55.945908+0000","last_undegraded":"2024-05-04T01:02:55.945908+0000","last_fullsized":"2024-05-04T01:02:55.945908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'23","last_scrub_stamp":"2024-05-04T01:02:55.945678+0000","last_deep_scrub":"28'23","last_deep_scrub_stamp":"2024-05-04T01:02:55.945678+0000","last_clean_scrub_stamp":"2024-05-04T01:02:55.945678+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:41:54.283433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"28'479","reported_seq":993,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:54.890775+0000","last_change":"2024-05-04T01:02:54.890862+0000","last_active":"2024-05-04T01:02:54.890775+0000","last_peered":"2024-05-04T01:02:54.890775+0000","last_clean":"2024-05-04T01:02:54.890775+0000","last_became_active":"2024-05-04T00:31:19.184606+0000","last_became_peered":"2024-05-04T00:31:19.184606+0000","last_unstale":"2024-05-04T01:02:54.890775+0000","last_undegraded":"2024-05-04T01:02:54.890775+0000","last_fullsized":"2024-05-04T01:02:54.890775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'479","last_scrub_stamp":"2024-05-04T01:02:54.890556+0000","last_deep_scrub":"28'479","last_deep_scrub_stamp":"2024-05-04T01:02:54.890556+0000","last_clean_scrub_stamp":"2024-05-04T01:02:54.890556+0000","objects_scrubbed":3,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:30:04.134135+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109877,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":465,"num_read_kb":490,"num_write":474,"num_write_kb":495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"28'42","reported_seq":87,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:56.383013+0000","last_change":"2024-05-04T01:02:56.383102+0000","last_active":"2024-05-04T01:02:56.383013+0000","last_peered":"2024-05-04T01:02:56.383013+0000","last_clean":"2024-05-04T01:02:56.383013+0000","last_became_active":"2024-05-04T00:31:21.401591+0000","last_became_peered":"2024-05-04T00:31:21.401591+0000","last_unstale":"2024-05-04T01:02:56.383013+0000","last_undegraded":"2024-05-04T01:02:56.383013+0000","last_fullsized":"2024-05-04T01:02:56.383013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'42","last_scrub_stamp":"2024-05-04T01:02:56.382794+0000","last_deep_scrub":"28'42","last_deep_scrub_stamp":"2024-05-04T01:02:56.382794+0000","last_clean_scrub_stamp":"2024-05-04T01:02:56.382794+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:18:27.631669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"28'6","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:54.051075+0000","last_change":"2024-05-04T01:02:54.051144+0000","last_active":"2024-05-04T01:02:54.051075+0000","last_peered":"2024-05-04T01:02:54.051075+0000","last_clean":"2024-05-04T01:02:54.051075+0000","last_became_active":"2024-05-04T00:31:19.180317+0000","last_became_peered":"2024-05-04T00:31:19.180317+0000","last_unstale":"2024-05-04T01:02:54.051075+0000","last_undegraded":"2024-05-04T01:02:54.051075+0000","last_fullsized":"2024-05-04T01:02:54.051075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-04T01:02:54.050840+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-04T01:02:54.050840+0000","last_clean_scrub_stamp":"2024-05-04T01:02:54.050840+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:25:53.909392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"28'41","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:58.910345+0000","last_change":"2024-05-04T01:02:58.910428+0000","last_active":"2024-05-04T01:02:58.910345+0000","last_peered":"2024-05-04T01:02:58.910345+0000","last_clean":"2024-05-04T01:02:58.910345+0000","last_became_active":"2024-05-04T00:32:21.646617+0000","last_became_peered":"2024-05-04T00:32:21.646617+0000","last_unstale":"2024-05-04T01:02:58.910345+0000","last_undegraded":"2024-05-04T01:02:58.910345+0000","last_fullsized":"2024-05-04T01:02:58.910345+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'41","last_scrub_stamp":"2024-05-04T01:02:58.910123+0000","last_deep_scrub":"28'41","last_deep_scrub_stamp":"2024-05-04T01:02:58.910123+0000","last_clean_scrub_stamp":"2024-05-04T01:02:58.910123+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:50:01.951745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"28'2","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:51.403775+0000","last_change":"2024-05-04T01:02:51.403847+0000","last_active":"2024-05-04T01:02:51.403775+0000","last_peered":"2024-05-04T01:02:51.403775+0000","last_clean":"2024-05-04T01:02:51.403775+0000","last_became_active":"2024-05-04T00:31:19.179785+0000","last_became_peered":"2024-05-04T00:31:19.179785+0000","last_unstale":"2024-05-04T01:02:51.403775+0000","last_undegraded":"2024-05-04T01:02:51.403775+0000","last_fullsized":"2024-05-04T01:02:51.403775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-05-04T01:02:51.403536+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-05-04T01:02:51.403536+0000","last_clean_scrub_stamp":"2024-05-04T01:02:51.403536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:27:07.772408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"28'35","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:50.373241+0000","last_change":"2024-05-04T01:02:50.373316+0000","last_active":"2024-05-04T01:02:50.373241+0000","last_peered":"2024-05-04T01:02:50.373241+0000","last_clean":"2024-05-04T01:02:50.373241+0000","last_became_active":"2024-05-04T00:31:21.341702+0000","last_became_peered":"2024-05-04T00:31:21.341702+0000","last_unstale":"2024-05-04T01:02:50.373241+0000","last_undegraded":"2024-05-04T01:02:50.373241+0000","last_fullsized":"2024-05-04T01:02:50.373241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'35","last_scrub_stamp":"2024-05-04T01:02:50.372993+0000","last_deep_scrub":"28'35","last_deep_scrub_stamp":"2024-05-04T01:02:50.372993+0000","last_clean_scrub_stamp":"2024-05-04T01:02:50.372993+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:26:16.130372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":3658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"28'5","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:53.032858+0000","last_change":"2024-05-04T01:02:53.032928+0000","last_active":"2024-05-04T01:02:53.032858+0000","last_peered":"2024-05-04T01:02:53.032858+0000","last_clean":"2024-05-04T01:02:53.032858+0000","last_became_active":"2024-05-04T00:31:19.175616+0000","last_became_peered":"2024-05-04T00:31:19.175616+0000","last_unstale":"2024-05-04T01:02:53.032858+0000","last_undegraded":"2024-05-04T01:02:53.032858+0000","last_fullsized":"2024-05-04T01:02:53.032858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-04T01:02:53.032655+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-04T01:02:53.032655+0000","last_clean_scrub_stamp":"2024-05-04T01:02:53.032655+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:27:53.847105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'38","reported_seq":83,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:03:00.890285+0000","last_change":"2024-05-04T01:03:00.890472+0000","last_active":"2024-05-04T01:03:00.890285+0000","last_peered":"2024-05-04T01:03:00.890285+0000","last_clean":"2024-05-04T01:03:00.890285+0000","last_became_active":"2024-05-04T00:31:21.402248+0000","last_became_peered":"2024-05-04T00:31:21.402248+0000","last_unstale":"2024-05-04T01:03:00.890285+0000","last_undegraded":"2024-05-04T01:03:00.890285+0000","last_fullsized":"2024-05-04T01:03:00.890285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'38","last_scrub_stamp":"2024-05-04T01:03:00.890016+0000","last_deep_scrub":"28'38","last_deep_scrub_stamp":"2024-05-04T01:03:00.890016+0000","last_clean_scrub_stamp":"2024-05-04T01:03:00.890016+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:20:58.263898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":1649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"28'1199","reported_seq":1247,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:48.440803+0000","last_change":"2024-05-04T01:02:48.440859+0000","last_active":"2024-05-04T01:02:48.440803+0000","last_peered":"2024-05-04T01:02:48.440803+0000","last_clean":"2024-05-04T01:02:48.440803+0000","last_became_active":"2024-05-04T00:31:19.154909+0000","last_became_peered":"2024-05-04T00:31:19.154909+0000","last_unstale":"2024-05-04T01:02:48.440803+0000","last_undegraded":"2024-05-04T01:02:48.440803+0000","last_fullsized":"2024-05-04T01:02:48.440803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1199","last_scrub_stamp":"2024-05-04T01:02:48.440692+0000","last_deep_scrub":"28'1199","last_deep_scrub_stamp":"2024-05-04T01:02:48.440692+0000","last_clean_scrub_stamp":"2024-05-04T01:02:48.440692+0000","objects_scrubbed":2,"log_size":1199,"log_dups_size":0,"ondisk_log_size":1199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:49:18.487769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2862,"num_write_kb":974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'37","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:55.450267+0000","last_change":"2024-05-04T01:02:55.450338+0000","last_active":"2024-05-04T01:02:55.450267+0000","last_peered":"2024-05-04T01:02:55.450267+0000","last_clean":"2024-05-04T01:02:55.450267+0000","last_became_active":"2024-05-04T00:31:21.444934+0000","last_became_peered":"2024-05-04T00:31:21.444934+0000","last_unstale":"2024-05-04T01:02:55.450267+0000","last_undegraded":"2024-05-04T01:02:55.450267+0000","last_fullsized":"2024-05-04T01:02:55.450267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2024-05-04T01:02:55.450039+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2024-05-04T01:02:55.450039+0000","last_clean_scrub_stamp":"2024-05-04T01:02:55.450039+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:09:49.732438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'12","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:55.008833+0000","last_change":"2024-05-04T01:02:55.009023+0000","last_active":"2024-05-04T01:02:55.008833+0000","last_peered":"2024-05-04T01:02:55.008833+0000","last_clean":"2024-05-04T01:02:55.008833+0000","last_became_active":"2024-05-04T00:31:19.182050+0000","last_became_peered":"2024-05-04T00:31:19.182050+0000","last_unstale":"2024-05-04T01:02:55.008833+0000","last_undegraded":"2024-05-04T01:02:55.008833+0000","last_fullsized":"2024-05-04T01:02:55.008833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-05-04T01:02:55.008559+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-05-04T01:02:55.008559+0000","last_clean_scrub_stamp":"2024-05-04T01:02:55.008559+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:56:02.196928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'45","reported_seq":89,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:54.401216+0000","last_change":"2024-05-04T01:02:54.401321+0000","last_active":"2024-05-04T01:02:54.401216+0000","last_peered":"2024-05-04T01:02:54.401216+0000","last_clean":"2024-05-04T01:02:54.401216+0000","last_became_active":"2024-05-04T00:31:21.442602+0000","last_became_peered":"2024-05-04T00:31:21.442602+0000","last_unstale":"2024-05-04T01:02:54.401216+0000","last_undegraded":"2024-05-04T01:02:54.401216+0000","last_fullsized":"2024-05-04T01:02:54.401216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'45","last_scrub_stamp":"2024-05-04T01:02:54.400969+0000","last_deep_scrub":"28'45","last_deep_scrub_stamp":"2024-05-04T01:02:54.400969+0000","last_clean_scrub_stamp":"2024-05-04T01:02:54.400969+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:13:15.656492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":5859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'5","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:48.350029+0000","last_change":"2024-05-04T01:02:48.350114+0000","last_active":"2024-05-04T01:02:48.350029+0000","last_peered":"2024-05-04T01:02:48.350029+0000","last_clean":"2024-05-04T01:02:48.350029+0000","last_became_active":"2024-05-04T00:31:19.247822+0000","last_became_peered":"2024-05-04T00:31:19.247822+0000","last_unstale":"2024-05-04T01:02:48.350029+0000","last_undegraded":"2024-05-04T01:02:48.350029+0000","last_fullsized":"2024-05-04T01:02:48.350029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-04T01:02:48.349881+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-04T01:02:48.349881+0000","last_clean_scrub_stamp":"2024-05-04T01:02:48.349881+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:11:49.104480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"28'37","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:03:07.979149+0000","last_change":"2024-05-04T01:03:07.979357+0000","last_active":"2024-05-04T01:03:07.979149+0000","last_peered":"2024-05-04T01:03:07.979149+0000","last_clean":"2024-05-04T01:03:07.979149+0000","last_became_active":"2024-05-04T00:31:21.441015+0000","last_became_peered":"2024-05-04T00:31:21.441015+0000","last_unstale":"2024-05-04T01:03:07.979149+0000","last_undegraded":"2024-05-04T01:03:07.979149+0000","last_fullsized":"2024-05-04T01:03:07.979149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2024-05-04T01:03:07.978878+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2024-05-04T01:03:07.978878+0000","last_clean_scrub_stamp":"2024-05-04T01:03:07.978878+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:50:59.511993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'12","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:49.402982+0000","last_change":"2024-05-04T01:02:49.403066+0000","last_active":"2024-05-04T01:02:49.402982+0000","last_peered":"2024-05-04T01:02:49.402982+0000","last_clean":"2024-05-04T01:02:49.402982+0000","last_became_active":"2024-05-04T00:31:19.158366+0000","last_became_peered":"2024-05-04T00:31:19.158366+0000","last_unstale":"2024-05-04T01:02:49.402982+0000","last_undegraded":"2024-05-04T01:02:49.402982+0000","last_fullsized":"2024-05-04T01:02:49.402982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-05-04T01:02:49.402773+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-05-04T01:02:49.402773+0000","last_clean_scrub_stamp":"2024-05-04T01:02:49.402773+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:28:15.468413+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'51","reported_seq":95,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:53.363703+0000","last_change":"2024-05-04T01:02:53.363782+0000","last_active":"2024-05-04T01:02:53.363703+0000","last_peered":"2024-05-04T01:02:53.363703+0000","last_clean":"2024-05-04T01:02:53.363703+0000","last_became_active":"2024-05-04T00:31:21.441074+0000","last_became_peered":"2024-05-04T00:31:21.441074+0000","last_unstale":"2024-05-04T01:02:53.363703+0000","last_undegraded":"2024-05-04T01:02:53.363703+0000","last_fullsized":"2024-05-04T01:02:53.363703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'51","last_scrub_stamp":"2024-05-04T01:02:53.363516+0000","last_deep_scrub":"28'51","last_deep_scrub_stamp":"2024-05-04T01:02:53.363516+0000","last_clean_scrub_stamp":"2024-05-04T01:02:53.363516+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:24:07.216803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"28'4","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:53.907330+0000","last_change":"2024-05-04T01:02:53.907433+0000","last_active":"2024-05-04T01:02:53.907330+0000","last_peered":"2024-05-04T01:02:53.907330+0000","last_clean":"2024-05-04T01:02:53.907330+0000","last_became_active":"2024-05-04T00:31:19.174113+0000","last_became_peered":"2024-05-04T00:31:19.174113+0000","last_unstale":"2024-05-04T01:02:53.907330+0000","last_undegraded":"2024-05-04T01:02:53.907330+0000","last_fullsized":"2024-05-04T01:02:53.907330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-05-04T01:02:53.907114+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-05-04T01:02:53.907114+0000","last_clean_scrub_stamp":"2024-05-04T01:02:53.907114+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:29:29.517007+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"28'49","reported_seq":93,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:55.926290+0000","last_change":"2024-05-04T01:02:55.926366+0000","last_active":"2024-05-04T01:02:55.926290+0000","last_peered":"2024-05-04T01:02:55.926290+0000","last_clean":"2024-05-04T01:02:55.926290+0000","last_became_active":"2024-05-04T00:31:21.406008+0000","last_became_peered":"2024-05-04T00:31:21.406008+0000","last_unstale":"2024-05-04T01:02:55.926290+0000","last_undegraded":"2024-05-04T01:02:55.926290+0000","last_fullsized":"2024-05-04T01:02:55.926290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'49","last_scrub_stamp":"2024-05-04T01:02:55.926066+0000","last_deep_scrub":"28'49","last_deep_scrub_stamp":"2024-05-04T01:02:55.926066+0000","last_clean_scrub_stamp":"2024-05-04T01:02:55.926066+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:07:14.528234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":5340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"28'577","reported_seq":625,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:03:00.015026+0000","last_change":"2024-05-04T01:03:00.015110+0000","last_active":"2024-05-04T01:03:00.015026+0000","last_peered":"2024-05-04T01:03:00.015026+0000","last_clean":"2024-05-04T01:03:00.015026+0000","last_became_active":"2024-05-04T00:31:19.247736+0000","last_became_peered":"2024-05-04T00:31:19.247736+0000","last_unstale":"2024-05-04T01:03:00.015026+0000","last_undegraded":"2024-05-04T01:03:00.015026+0000","last_fullsized":"2024-05-04T01:03:00.015026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'577","last_scrub_stamp":"2024-05-04T01:03:00.014765+0000","last_deep_scrub":"28'577","last_deep_scrub_stamp":"2024-05-04T01:03:00.014765+0000","last_clean_scrub_stamp":"2024-05-04T01:03:00.014765+0000","objects_scrubbed":3,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:24:13.010739+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":570,"num_write_kb":4382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"28'46","reported_seq":90,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:03:04.012860+0000","last_change":"2024-05-04T01:03:04.012930+0000","last_active":"2024-05-04T01:03:04.012860+0000","last_peered":"2024-05-04T01:03:04.012860+0000","last_clean":"2024-05-04T01:03:04.012860+0000","last_became_active":"2024-05-04T00:31:21.400935+0000","last_became_peered":"2024-05-04T00:31:21.400935+0000","last_unstale":"2024-05-04T01:03:04.012860+0000","last_undegraded":"2024-05-04T01:03:04.012860+0000","last_fullsized":"2024-05-04T01:03:04.012860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'46","last_scrub_stamp":"2024-05-04T01:03:04.012638+0000","last_deep_scrub":"28'46","last_deep_scrub_stamp":"2024-05-04T01:03:04.012638+0000","last_clean_scrub_stamp":"2024-05-04T01:03:04.012638+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:59:34.729506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"28'52","reported_seq":94,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:03:00.955236+0000","last_change":"2024-05-04T01:03:00.955307+0000","last_active":"2024-05-04T01:03:00.955236+0000","last_peered":"2024-05-04T01:03:00.955236+0000","last_clean":"2024-05-04T01:03:00.955236+0000","last_became_active":"2024-05-04T00:31:21.392020+0000","last_became_peered":"2024-05-04T00:31:21.392020+0000","last_unstale":"2024-05-04T01:03:00.955236+0000","last_undegraded":"2024-05-04T01:03:00.955236+0000","last_fullsized":"2024-05-04T01:03:00.955236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'52","last_scrub_stamp":"2024-05-04T01:03:00.955011+0000","last_deep_scrub":"28'52","last_deep_scrub_stamp":"2024-05-04T01:03:00.955011+0000","last_clean_scrub_stamp":"2024-05-04T01:03:00.955011+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:00:48.787440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":3157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"28'6","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:46.374117+0000","last_change":"2024-05-04T01:02:46.374195+0000","last_active":"2024-05-04T01:02:46.374117+0000","last_peered":"2024-05-04T01:02:46.374117+0000","last_clean":"2024-05-04T01:02:46.374117+0000","last_became_active":"2024-05-04T00:31:19.185156+0000","last_became_peered":"2024-05-04T00:31:19.185156+0000","last_unstale":"2024-05-04T01:02:46.374117+0000","last_undegraded":"2024-05-04T01:02:46.374117+0000","last_fullsized":"2024-05-04T01:02:46.374117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-04T01:02:46.373887+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-04T01:02:46.373887+0000","last_clean_scrub_stamp":"2024-05-04T01:02:46.373887+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:07:01.552297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'39","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:48.183125+0000","last_change":"2024-05-04T01:02:48.183205+0000","last_active":"2024-05-04T01:02:48.183125+0000","last_peered":"2024-05-04T01:02:48.183125+0000","last_clean":"2024-05-04T01:02:48.183125+0000","last_became_active":"2024-05-04T00:31:21.396023+0000","last_became_peered":"2024-05-04T00:31:21.396023+0000","last_unstale":"2024-05-04T01:02:48.183125+0000","last_undegraded":"2024-05-04T01:02:48.183125+0000","last_fullsized":"2024-05-04T01:02:48.183125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'39","last_scrub_stamp":"2024-05-04T01:02:48.182857+0000","last_deep_scrub":"28'39","last_deep_scrub_stamp":"2024-05-04T01:02:48.182857+0000","last_clean_scrub_stamp":"2024-05-04T01:02:48.182857+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:27:46.095704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"28'13","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:47.341262+0000","last_change":"2024-05-04T01:02:47.341300+0000","last_active":"2024-05-04T01:02:47.341262+0000","last_peered":"2024-05-04T01:02:47.341262+0000","last_clean":"2024-05-04T01:02:47.341262+0000","last_became_active":"2024-05-04T00:31:19.188359+0000","last_became_peered":"2024-05-04T00:31:19.188359+0000","last_unstale":"2024-05-04T01:02:47.341262+0000","last_undegraded":"2024-05-04T01:02:47.341262+0000","last_fullsized":"2024-05-04T01:02:47.341262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2024-05-04T01:02:47.341169+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2024-05-04T01:02:47.341169+0000","last_clean_scrub_stamp":"2024-05-04T01:02:47.341169+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:20:01.076349+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"28'51","reported_seq":96,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:03:04.270113+0000","last_change":"2024-05-04T01:03:04.270184+0000","last_active":"2024-05-04T01:03:04.270113+0000","last_peered":"2024-05-04T01:03:04.270113+0000","last_clean":"2024-05-04T01:03:04.270113+0000","last_became_active":"2024-05-04T00:31:21.416267+0000","last_became_peered":"2024-05-04T00:31:21.416267+0000","last_unstale":"2024-05-04T01:03:04.270113+0000","last_undegraded":"2024-05-04T01:03:04.270113+0000","last_fullsized":"2024-05-04T01:03:04.270113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'51","last_scrub_stamp":"2024-05-04T01:03:04.269890+0000","last_deep_scrub":"28'51","last_deep_scrub_stamp":"2024-05-04T01:03:04.269890+0000","last_clean_scrub_stamp":"2024-05-04T01:03:04.269890+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:37:19.147010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":6244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"28'119","reported_seq":168,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:52.432059+0000","last_change":"2024-05-04T01:02:52.432131+0000","last_active":"2024-05-04T01:02:52.432059+0000","last_peered":"2024-05-04T01:02:52.432059+0000","last_clean":"2024-05-04T01:02:52.432059+0000","last_became_active":"2024-05-04T00:31:19.186483+0000","last_became_peered":"2024-05-04T00:31:19.186483+0000","last_unstale":"2024-05-04T01:02:52.432059+0000","last_undegraded":"2024-05-04T01:02:52.432059+0000","last_fullsized":"2024-05-04T01:02:52.432059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2024-05-04T01:02:52.431802+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2024-05-04T01:02:52.431802+0000","last_clean_scrub_stamp":"2024-05-04T01:02:52.431802+0000","objects_scrubbed":1,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:39:06.331099+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092188,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":1130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"28'29","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:03:02.312431+0000","last_change":"2024-05-04T01:03:02.312501+0000","last_active":"2024-05-04T01:03:02.312431+0000","last_peered":"2024-05-04T01:03:02.312431+0000","last_clean":"2024-05-04T01:03:02.312431+0000","last_became_active":"2024-05-04T00:31:21.413330+0000","last_became_peered":"2024-05-04T00:31:21.413330+0000","last_unstale":"2024-05-04T01:03:02.312431+0000","last_undegraded":"2024-05-04T01:03:02.312431+0000","last_fullsized":"2024-05-04T01:03:02.312431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'29","last_scrub_stamp":"2024-05-04T01:03:02.312209+0000","last_deep_scrub":"28'29","last_deep_scrub_stamp":"2024-05-04T01:03:02.312209+0000","last_clean_scrub_stamp":"2024-05-04T01:03:02.312209+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:02:25.343176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":2406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"28'625","reported_seq":674,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-04T01:02:50.402400+0000","last_change":"2024-05-04T01:02:50.402468+0000","last_active":"2024-05-04T01:02:50.402400+0000","last_peered":"2024-05-04T01:02:50.402400+0000","last_clean":"2024-05-04T01:02:50.402400+0000","last_became_active":"2024-05-04T00:31:19.175356+0000","last_became_peered":"2024-05-04T00:31:19.175356+0000","last_unstale":"2024-05-04T01:02:50.402400+0000","last_undegraded":"2024-05-04T01:02:50.402400+0000","last_fullsized":"2024-05-04T01:02:50.402400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'625","last_scrub_stamp":"2024-05-04T01:02:50.402253+0000","last_deep_scrub":"28'625","last_deep_scrub_stamp":"2024-05-04T01:02:50.402253+0000","last_clean_scrub_stamp":"2024-05-04T01:02:50.402253+0000","objects_scrubbed":5,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:14:35.595191+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":4428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2165,"num_write_kb":250211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2827,"ondisk_log_size":2827,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22178359,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":465,"num_read_kb":490,"num_write":6723,"num_write_kb":24988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44507136,"data_stored":44356718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5217,"ondisk_log_size":5217,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509836,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":4396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":4501504,"data_stored":4307686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509836,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35536,"kb_used_data":8520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336304,"statfs":{"total":96636764160,"available":96600375296,"internally_reserved":0,"allocated":8724480,"data_stored":8502444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509837,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43828,"kb_used_data":8492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328012,"statfs":{"total":96636764160,"available":96591884288,"internally_reserved":0,"allocated":8695808,"data_stored":8500910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509837,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":897024,"data_stored":702124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509837,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43900,"kb_used_data":4404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327940,"statfs":{"total":96636764160,"available":96591810560,"internally_reserved":0,"allocated":4509696,"data_stored":4307216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542540,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1523712,"data_stored":1314479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542540,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41496,"kb_used_data":6160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330344,"statfs":{"total":96636764160,"available":96594272256,"internally_reserved":0,"allocated":6307840,"data_stored":6099629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542540,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52088,"kb_used_data":12592,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319752,"statfs":{"total":96636764160,"available":96583426048,"internally_reserved":0,"allocated":12894208,"data_stored":12695734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4195620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12599296,"data_stored":12584138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8429568,"data_stored":8390848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5419008,"data_stored":5397665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4196090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1228800,"data_stored":1202883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T01:03:14.273 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-04T01:03:14.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.476+0000 7f48ededc640 1 Processor -- start 2024-05-04T01:03:14.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.476+0000 7f48ededc640 1 -- start start 2024-05-04T01:03:14.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.480+0000 7f48ededc640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f48e8070b60 0x7f48e815c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:14.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.480+0000 7f48ededc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48e8152920 0x7f48e8073fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:14.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.480+0000 7f48ededc640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48e8072f00 con 0x7f48e806f860 2024-05-04T01:03:14.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.480+0000 7f48ededc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f48e8072cb0 con 0x7f48e8152920 2024-05-04T01:03:14.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.480+0000 7f48ededc640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f48e80731e0 con 0x7f48e8070b60 2024-05-04T01:03:14.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.480+0000 7f48deffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48e8152920 0x7f48e8073fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:14.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.480+0000 7f48deffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48e8152920 0x7f48e8073fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59314/0 (socket says 172.21.15.6:59314) 2024-05-04T01:03:14.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.480+0000 7f48deffd640 1 -- 172.21.15.6:0/1400067872 learned_addr learned my addr 172.21.15.6:0/1400067872 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:03:14.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.480+0000 7f48e77fe640 1 --2- 172.21.15.6:0/1400067872 >> v2:172.21.15.163:3300/0 conn(0x7f48e8070b60 0x7f48e815c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:14.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.484+0000 7f48deffd640 1 -- 172.21.15.6:0/1400067872 >> v2:172.21.15.163:3300/0 conn(0x7f48e8070b60 msgr2=0x7f48e815c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:03:14.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.484+0000 7f48deffd640 1 --2- 172.21.15.6:0/1400067872 >> v2:172.21.15.163:3300/0 conn(0x7f48e8070b60 0x7f48e815c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:14.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.484+0000 7f48deffd640 1 -- 172.21.15.6:0/1400067872 >> v1:172.21.15.163:6789/0 conn(0x7f48e806f860 legacy=0x7f48e815f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:14.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.484+0000 7f48deffd640 1 -- 172.21.15.6:0/1400067872 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e80734c0 con 0x7f48e8152920 2024-05-04T01:03:14.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.488+0000 7f48deffd640 1 --2- 172.21.15.6:0/1400067872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e8152920 0x7f48e8073fa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f48e80ca4b0 tx=0x7f48d001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ca9a8237a48e07 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:14.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.492+0000 7f48e6ffd640 1 -- 172.21.15.6:0/1400067872 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d00aa650 con 0x7f48e8152920 2024-05-04T01:03:14.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.492+0000 7f48e6ffd640 1 -- 172.21.15.6:0/1400067872 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d00af070 con 0x7f48e8152920 2024-05-04T01:03:14.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.492+0000 7f48e6ffd640 1 -- 172.21.15.6:0/1400067872 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d00aaa10 con 0x7f48e8152920 2024-05-04T01:03:14.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.492+0000 7f48ededc640 1 -- 172.21.15.6:0/1400067872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e8152920 msgr2=0x7f48e8073fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:14.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.492+0000 7f48ededc640 1 --2- 172.21.15.6:0/1400067872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e8152920 0x7f48e8073fa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f48e80ca4b0 tx=0x7f48d001c4f0 comp rx=0 tx=0).stop 2024-05-04T01:03:14.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.492+0000 7f48ededc640 1 -- 172.21.15.6:0/1400067872 shutdown_connections 2024-05-04T01:03:14.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.492+0000 7f48ededc640 1 --2- 172.21.15.6:0/1400067872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e8152920 0x7f48e8073fa0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:14.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.492+0000 7f48ededc640 1 --2- 172.21.15.6:0/1400067872 >> v2:172.21.15.163:3300/0 conn(0x7f48e8070b60 0x7f48e815c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:14.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.492+0000 7f48ededc640 1 -- 172.21.15.6:0/1400067872 >> 172.21.15.6:0/1400067872 conn(0x7f48e806cf70 msgr2=0x7f48e80c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:03:14.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.492+0000 7f48ededc640 1 -- 172.21.15.6:0/1400067872 shutdown_connections 2024-05-04T01:03:14.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.492+0000 7f48ededc640 1 -- 172.21.15.6:0/1400067872 wait complete. 2024-05-04T01:03:14.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.496+0000 7f48ededc640 1 Processor -- start 2024-05-04T01:03:14.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.496+0000 7f48ededc640 1 -- start start 2024-05-04T01:03:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.496+0000 7f48ededc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e806f860 0x7f48e81f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.496+0000 7f48ededc640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48e8070b60 0x7f48e8159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.496+0000 7f48ededc640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48e8152920 0x7f48e80cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.496+0000 7f48ededc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f48e81565d0 con 0x7f48e806f860 2024-05-04T01:03:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.496+0000 7f48ededc640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f48e8070080 con 0x7f48e8070b60 2024-05-04T01:03:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.496+0000 7f48ededc640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f48e8152d30 con 0x7f48e8152920 2024-05-04T01:03:14.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.500+0000 7f48e77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e806f860 0x7f48e81f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:14.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.500+0000 7f48e77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e806f860 0x7f48e81f5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59330/0 (socket says 172.21.15.6:59330) 2024-05-04T01:03:14.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.500+0000 7f48e77fe640 1 -- 172.21.15.6:0/4212120219 learned_addr learned my addr 172.21.15.6:0/4212120219 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:03:14.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.500+0000 7f48e7fff640 1 --2- 172.21.15.6:0/4212120219 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48e8152920 0x7f48e80cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:14.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.500+0000 7f48deffd640 1 --2- 172.21.15.6:0/4212120219 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48e8070b60 0x7f48e8159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.504+0000 7f48e77fe640 1 -- 172.21.15.6:0/4212120219 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48e8152920 msgr2=0x7f48e80cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.504+0000 7f48e77fe640 1 --2- 172.21.15.6:0/4212120219 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48e8152920 0x7f48e80cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.504+0000 7f48e77fe640 1 -- 172.21.15.6:0/4212120219 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48e8070b60 msgr2=0x7f48e8159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.504+0000 7f48e77fe640 1 --2- 172.21.15.6:0/4212120219 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48e8070b60 0x7f48e8159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.504+0000 7f48e77fe640 1 -- 172.21.15.6:0/4212120219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e81f6070 con 0x7f48e806f860 2024-05-04T01:03:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.504+0000 7f48e77fe640 1 --2- 172.21.15.6:0/4212120219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e806f860 0x7f48e81f5b30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f48d800c7f0 tx=0x7f48d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:14.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.512+0000 7f48e4ff9640 1 -- 172.21.15.6:0/4212120219 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d8015070 con 0x7f48e806f860 2024-05-04T01:03:14.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.512+0000 7f48e4ff9640 1 -- 172.21.15.6:0/4212120219 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d8007820 con 0x7f48e806f860 2024-05-04T01:03:14.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.512+0000 7f48e4ff9640 1 -- 172.21.15.6:0/4212120219 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d8007c10 con 0x7f48e806f860 2024-05-04T01:03:14.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.512+0000 7f48ededc640 1 -- 172.21.15.6:0/4212120219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48e815ef80 con 0x7f48e806f860 2024-05-04T01:03:14.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.512+0000 7f48ededc640 1 -- 172.21.15.6:0/4212120219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48e81f9920 con 0x7f48e806f860 2024-05-04T01:03:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.512+0000 7f48ededc640 1 -- 172.21.15.6:0/4212120219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48e806a390 con 0x7f48e806f860 2024-05-04T01:03:14.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.540+0000 7f48e4ff9640 1 -- 172.21.15.6:0/4212120219 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f48d8018070 con 0x7f48e806f860 2024-05-04T01:03:14.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.540+0000 7f48e4ff9640 1 --2- 172.21.15.6:0/4212120219 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f48c806f450 0x7f48c8071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:14.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.540+0000 7f48deffd640 1 --2- 172.21.15.6:0/4212120219 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f48c806f450 0x7f48c8071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:14.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.540+0000 7f48deffd640 1 --2- 172.21.15.6:0/4212120219 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f48c806f450 0x7f48c8071960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f48d00ae000 tx=0x7f48d00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.848+0000 7f48e4ff9640 1 -- 172.21.15.6:0/4212120219 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f48d8058260 con 0x7f48e806f860 2024-05-04T01:03:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:14.852+0000 7f48e4ff9640 1 -- 172.21.15.6:0/4212120219 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f48d805bfd0 con 0x7f48e806f860 2024-05-04T01:03:15.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.048+0000 7f48ededc640 1 -- 172.21.15.6:0/4212120219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f48e80cc080 con 0x7f48e806f860 2024-05-04T01:03:15.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.504+0000 7f48e4ff9640 1 -- 172.21.15.6:0/4212120219 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f48d80602d0 con 0x7f48e806f860 2024-05-04T01:03:15.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.504+0000 7f48e4ff9640 1 -- 172.21.15.6:0/4212120219 <== mon.0 v2:172.21.15.6:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f48d805bae0 con 0x7f48e806f860 2024-05-04T01:03:15.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.504+0000 7f48ededc640 1 -- 172.21.15.6:0/4212120219 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f48c806f450 msgr2=0x7f48c8071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:15.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.504+0000 7f48ededc640 1 --2- 172.21.15.6:0/4212120219 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f48c806f450 0x7f48c8071960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f48d00ae000 tx=0x7f48d00a7000 comp rx=0 tx=0).stop 2024-05-04T01:03:15.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.504+0000 7f48ededc640 1 -- 172.21.15.6:0/4212120219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e806f860 msgr2=0x7f48e81f5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:15.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.504+0000 7f48ededc640 1 --2- 172.21.15.6:0/4212120219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e806f860 0x7f48e81f5b30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f48d800c7f0 tx=0x7f48d800ccb0 comp rx=0 tx=0).stop 2024-05-04T01:03:15.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.508+0000 7f48ededc640 1 -- 172.21.15.6:0/4212120219 shutdown_connections 2024-05-04T01:03:15.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.508+0000 7f48ededc640 1 --2- 172.21.15.6:0/4212120219 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48e8070b60 0x7f48e8159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:15.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.508+0000 7f48ededc640 1 --2- 172.21.15.6:0/4212120219 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f48c806f450 0x7f48c8071960 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:15.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.508+0000 7f48ededc640 1 --2- 172.21.15.6:0/4212120219 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48e8152920 0x7f48e80cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:15.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.508+0000 7f48ededc640 1 --2- 172.21.15.6:0/4212120219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e806f860 0x7f48e81f5b30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:15.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.508+0000 7f48ededc640 1 -- 172.21.15.6:0/4212120219 >> 172.21.15.6:0/4212120219 conn(0x7f48e806cf70 msgr2=0x7f48e814f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:03:15.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.508+0000 7f48ededc640 1 -- 172.21.15.6:0/4212120219 shutdown_connections 2024-05-04T01:03:15.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.508+0000 7f48ededc640 1 -- 172.21.15.6:0/4212120219 wait complete. 2024-05-04T01:03:15.540 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-04T01:03:15.540 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T01:03:15.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.692+0000 7f1aa6d46640 1 Processor -- start 2024-05-04T01:03:15.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.692+0000 7f1aa6d46640 1 -- start start 2024-05-04T01:03:15.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.692+0000 7f1aa6d46640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1aa01541f0 0x7f1aa0159e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:15.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.692+0000 7f1aa6d46640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1aa00c5800 0x7f1aa00ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:15.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.692+0000 7f1aa6d46640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aa015a6c0 con 0x7f1aa00c5c10 2024-05-04T01:03:15.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.692+0000 7f1aa6d46640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f1aa00c4db0 con 0x7f1aa00c5800 2024-05-04T01:03:15.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.692+0000 7f1aa6d46640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f1aa015a9a0 con 0x7f1aa01541f0 2024-05-04T01:03:15.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.692+0000 7f1a9ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1aa00c5800 0x7f1aa00ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:15.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.696+0000 7f1a9ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1aa00c5800 0x7f1aa00ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59344/0 (socket says 172.21.15.6:59344) 2024-05-04T01:03:15.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.696+0000 7f1a9ffff640 1 -- 172.21.15.6:0/4233780444 learned_addr learned my addr 172.21.15.6:0/4233780444 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:03:15.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.696+0000 7f1a9ffff640 1 -- 172.21.15.6:0/4233780444 >> v2:172.21.15.163:3300/0 conn(0x7f1aa01541f0 msgr2=0x7f1aa0159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:03:15.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.696+0000 7f1a9ffff640 1 --2- 172.21.15.6:0/4233780444 >> v2:172.21.15.163:3300/0 conn(0x7f1aa01541f0 0x7f1aa0159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:15.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.696+0000 7f1a9ffff640 1 -- 172.21.15.6:0/4233780444 >> v1:172.21.15.163:6789/0 conn(0x7f1aa00c5c10 legacy=0x7f1aa015d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:03:15.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.696+0000 7f1a9ffff640 1 -- 172.21.15.6:0/4233780444 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa015ac80 con 0x7f1aa00c5800 2024-05-04T01:03:15.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.700+0000 7f1a9ffff640 1 --2- 172.21.15.6:0/4233780444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa00c5800 0x7f1aa00ca420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00740d0 tx=0x7f1a9401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea87ab3cb7db37b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:15.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.708+0000 7f1a9f7fe640 1 -- 172.21.15.6:0/4233780444 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a940b0070 con 0x7f1aa00c5800 2024-05-04T01:03:15.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.708+0000 7f1a9f7fe640 1 -- 172.21.15.6:0/4233780444 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1a940ab600 con 0x7f1aa00c5800 2024-05-04T01:03:15.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.708+0000 7f1a9f7fe640 1 -- 172.21.15.6:0/4233780444 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a940ab9f0 con 0x7f1aa00c5800 2024-05-04T01:03:15.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.712+0000 7f1aa6d46640 1 -- 172.21.15.6:0/4233780444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa00c5800 msgr2=0x7f1aa00ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:15.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.712+0000 7f1aa6d46640 1 --2- 172.21.15.6:0/4233780444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa00c5800 0x7f1aa00ca420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00740d0 tx=0x7f1a9401c520 comp rx=0 tx=0).stop 2024-05-04T01:03:15.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.712+0000 7f1aa6d46640 1 -- 172.21.15.6:0/4233780444 shutdown_connections 2024-05-04T01:03:15.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.712+0000 7f1aa6d46640 1 --2- 172.21.15.6:0/4233780444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa00c5800 0x7f1aa00ca420 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:15.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.712+0000 7f1aa6d46640 1 --2- 172.21.15.6:0/4233780444 >> v2:172.21.15.163:3300/0 conn(0x7f1aa01541f0 0x7f1aa0159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:15.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.712+0000 7f1aa6d46640 1 -- 172.21.15.6:0/4233780444 >> 172.21.15.6:0/4233780444 conn(0x7f1aa0072ce0 msgr2=0x7f1aa00704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:03:15.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.712+0000 7f1aa6d46640 1 -- 172.21.15.6:0/4233780444 shutdown_connections 2024-05-04T01:03:15.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.712+0000 7f1aa6d46640 1 -- 172.21.15.6:0/4233780444 wait complete. 2024-05-04T01:03:15.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.712+0000 7f1aa6d46640 1 Processor -- start 2024-05-04T01:03:15.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.712+0000 7f1aa6d46640 1 -- start start 2024-05-04T01:03:15.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.716+0000 7f1aa6d46640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa00c5800 0x7f1aa0146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:15.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.716+0000 7f1aa6d46640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1aa00c5c10 0x7f1aa006e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:15.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.716+0000 7f1aa6d46640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1aa01541f0 0x7f1aa006d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:15.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.716+0000 7f1aa6d46640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa0070de0 con 0x7f1aa00c5800 2024-05-04T01:03:15.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.716+0000 7f1aa6d46640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa00cb800 con 0x7f1aa00c5c10 2024-05-04T01:03:15.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.716+0000 7f1aa6d46640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa0070f60 con 0x7f1aa01541f0 2024-05-04T01:03:15.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.716+0000 7f1aa4ae2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa00c5800 0x7f1aa0146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:15.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.716+0000 7f1aa4ae2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa00c5800 0x7f1aa0146e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59346/0 (socket says 172.21.15.6:59346) 2024-05-04T01:03:15.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.716+0000 7f1aa4ae2640 1 -- 172.21.15.6:0/934738252 learned_addr learned my addr 172.21.15.6:0/934738252 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:03:15.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.716+0000 7f1a9ffff640 1 --2- 172.21.15.6:0/934738252 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1aa00c5c10 0x7f1aa006e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:15.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.716+0000 7f1aa52e3640 1 --2- 172.21.15.6:0/934738252 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1aa01541f0 0x7f1aa006d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.720+0000 7f1aa4ae2640 1 -- 172.21.15.6:0/934738252 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1aa01541f0 msgr2=0x7f1aa006d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.720+0000 7f1aa4ae2640 1 --2- 172.21.15.6:0/934738252 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1aa01541f0 0x7f1aa006d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.720+0000 7f1aa4ae2640 1 -- 172.21.15.6:0/934738252 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1aa00c5c10 msgr2=0x7f1aa006e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.720+0000 7f1aa4ae2640 1 --2- 172.21.15.6:0/934738252 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1aa00c5c10 0x7f1aa006e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:15.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.720+0000 7f1aa4ae2640 1 -- 172.21.15.6:0/934738252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa0147360 con 0x7f1aa00c5800 2024-05-04T01:03:15.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.724+0000 7f1aa4ae2640 1 --2- 172.21.15.6:0/934738252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa00c5800 0x7f1aa0146e20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000b410 tx=0x7f1a9000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:15.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.728+0000 7f1a9d7fa640 1 -- 172.21.15.6:0/934738252 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90015020 con 0x7f1aa00c5800 2024-05-04T01:03:15.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.728+0000 7f1a9d7fa640 1 -- 172.21.15.6:0/934738252 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1a90011830 con 0x7f1aa00c5800 2024-05-04T01:03:15.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.728+0000 7f1a9d7fa640 1 -- 172.21.15.6:0/934738252 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90011c40 con 0x7f1aa00c5800 2024-05-04T01:03:15.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.728+0000 7f1aa6d46640 1 -- 172.21.15.6:0/934738252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa00cc990 con 0x7f1aa00c5800 2024-05-04T01:03:15.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.728+0000 7f1aa6d46640 1 -- 172.21.15.6:0/934738252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa0147c40 con 0x7f1aa00c5800 2024-05-04T01:03:15.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:15.728+0000 7f1aa6d46640 1 -- 172.21.15.6:0/934738252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa0069a50 con 0x7f1aa00c5800 2024-05-04T01:03:16.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.056+0000 7f1a9d7fa640 1 -- 172.21.15.6:0/934738252 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1a90018020 con 0x7f1aa00c5800 2024-05-04T01:03:16.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.056+0000 7f1a9d7fa640 1 --2- 172.21.15.6:0/934738252 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1a8c06f480 0x7f1a8c071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:16.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.056+0000 7f1a9ffff640 1 --2- 172.21.15.6:0/934738252 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1a8c06f480 0x7f1a8c071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:16.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.060+0000 7f1a9ffff640 1 --2- 172.21.15.6:0/934738252 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1a8c06f480 0x7f1a8c071990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1a940ad000 tx=0x7f1a940a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:16.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.092+0000 7f1a9d7fa640 1 -- 172.21.15.6:0/934738252 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f1a90011de0 con 0x7f1aa00c5800 2024-05-04T01:03:16.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.092+0000 7f1a9d7fa640 1 -- 172.21.15.6:0/934738252 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f1a9001f020 con 0x7f1aa00c5800 2024-05-04T01:03:16.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.328+0000 7f1aa6d46640 1 -- 172.21.15.6:0/934738252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1aa015d270 con 0x7f1aa00c5800 2024-05-04T01:03:16.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.356+0000 7f1a9d7fa640 1 -- 172.21.15.6:0/934738252 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6850 (secure 0 0 0) 0x7f1a9005bfb0 con 0x7f1aa00c5800 2024-05-04T01:03:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T01:03:16.362 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4185,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/811470677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":811470677},{"type":"v1","addr":"172.21.15.6:6833","nonce":811470677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4194,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/50303985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":50303985},{"type":"v1","addr":"172.21.15.163:6839","nonce":50303985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2015777060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2015777060},{"type":"v1","addr":"172.21.15.6:6835","nonce":2015777060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T00:31:21.468790+0000","modified":"2024-05-04T00:31:36.770046+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.163:6835/428471443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":428471443},{"type":"v1","addr":"172.21.15.163:6835","nonce":428471443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"b","rank":1,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6837/1055589916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1055589916},{"type":"v1","addr":"172.21.15.163:6837","nonce":1055589916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.6:6837/639743836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":639743836},{"type":"v1","addr":"172.21.15.6:6837","nonce":639743836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-04T01:03:16.362 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 12 2024-05-04T01:03:16.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.364+0000 7f1aa6d46640 1 -- 172.21.15.6:0/934738252 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1a8c06f480 msgr2=0x7f1a8c071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:16.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.364+0000 7f1aa6d46640 1 --2- 172.21.15.6:0/934738252 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1a8c06f480 0x7f1a8c071990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1a940ad000 tx=0x7f1a940a6000 comp rx=0 tx=0).stop 2024-05-04T01:03:16.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.364+0000 7f1aa6d46640 1 -- 172.21.15.6:0/934738252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa00c5800 msgr2=0x7f1aa0146e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:16.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.364+0000 7f1aa6d46640 1 --2- 172.21.15.6:0/934738252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa00c5800 0x7f1aa0146e20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000b410 tx=0x7f1a9000b8d0 comp rx=0 tx=0).stop 2024-05-04T01:03:16.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.364+0000 7f1aa6d46640 1 -- 172.21.15.6:0/934738252 shutdown_connections 2024-05-04T01:03:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.364+0000 7f1aa6d46640 1 --2- 172.21.15.6:0/934738252 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1aa00c5c10 0x7f1aa006e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.364+0000 7f1aa6d46640 1 --2- 172.21.15.6:0/934738252 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f1a8c06f480 0x7f1a8c071990 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.364+0000 7f1aa6d46640 1 --2- 172.21.15.6:0/934738252 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1aa01541f0 0x7f1aa006d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.364+0000 7f1aa6d46640 1 --2- 172.21.15.6:0/934738252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa00c5800 0x7f1aa0146e20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.364+0000 7f1aa6d46640 1 -- 172.21.15.6:0/934738252 >> 172.21.15.6:0/934738252 conn(0x7f1aa0072ce0 msgr2=0x7f1aa014f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:03:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.364+0000 7f1aa6d46640 1 -- 172.21.15.6:0/934738252 shutdown_connections 2024-05-04T01:03:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.364+0000 7f1aa6d46640 1 -- 172.21.15.6:0/934738252 wait complete. 2024-05-04T01:03:16.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T01:03:16.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.536+0000 7f47f71fe640 1 Processor -- start 2024-05-04T01:03:16.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.536+0000 7f47f71fe640 1 -- start start 2024-05-04T01:03:16.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.536+0000 7f47f71fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f47f0156370 0x7f47f00ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:16.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.536+0000 7f47f71fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47f00ceaa0 0x7f47f0166a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:16.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.536+0000 7f47f71fe640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f00ceeb0 con 0x7f47f015cb60 2024-05-04T01:03:16.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.536+0000 7f47f71fe640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f47f00d22e0 con 0x7f47f00ceaa0 2024-05-04T01:03:16.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.536+0000 7f47f71fe640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f47f00d1d40 con 0x7f47f0156370 2024-05-04T01:03:16.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.536+0000 7f47f579b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47f00ceaa0 0x7f47f0166a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:16.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.540+0000 7f47f579b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47f00ceaa0 0x7f47f0166a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59362/0 (socket says 172.21.15.6:59362) 2024-05-04T01:03:16.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.540+0000 7f47f579b640 1 -- 172.21.15.6:0/3987645624 learned_addr learned my addr 172.21.15.6:0/3987645624 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:03:16.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.540+0000 7f47effff640 1 --2- 172.21.15.6:0/3987645624 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f47f0156370 0x7f47f00ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:16.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.544+0000 7f47f579b640 1 -- 172.21.15.6:0/3987645624 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f47f0156370 msgr2=0x7f47f00ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:03:16.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.544+0000 7f47f579b640 1 --2- 172.21.15.6:0/3987645624 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f47f0156370 0x7f47f00ce560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:16.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.544+0000 7f47f579b640 1 -- 172.21.15.6:0/3987645624 >> v1:172.21.15.6:6789/0 conn(0x7f47f015cb60 legacy=0x7f47f00ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:16.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.544+0000 7f47f579b640 1 -- 172.21.15.6:0/3987645624 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f00d2000 con 0x7f47f00ceaa0 2024-05-04T01:03:16.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.548+0000 7f47f579b640 1 --2- 172.21.15.6:0/3987645624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47f00ceaa0 0x7f47f0166a60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f47e8009870 tx=0x7f47e801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378d4738da497dc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.552+0000 7f47ef7fe640 1 -- 172.21.15.6:0/3987645624 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e80b2070 con 0x7f47f00ceaa0 2024-05-04T01:03:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.552+0000 7f47ef7fe640 1 -- 172.21.15.6:0/3987645624 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f47e80a9070 con 0x7f47f00ceaa0 2024-05-04T01:03:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.552+0000 7f47ef7fe640 1 -- 172.21.15.6:0/3987645624 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e80ad8a0 con 0x7f47f00ceaa0 2024-05-04T01:03:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.552+0000 7f47f71fe640 1 -- 172.21.15.6:0/3987645624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47f00ceaa0 msgr2=0x7f47f0166a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.552+0000 7f47f71fe640 1 --2- 172.21.15.6:0/3987645624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47f00ceaa0 0x7f47f0166a60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f47e8009870 tx=0x7f47e801c560 comp rx=0 tx=0).stop 2024-05-04T01:03:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.552+0000 7f47f71fe640 1 -- 172.21.15.6:0/3987645624 shutdown_connections 2024-05-04T01:03:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.552+0000 7f47f71fe640 1 --2- 172.21.15.6:0/3987645624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47f00ceaa0 0x7f47f0166a60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.552+0000 7f47f71fe640 1 --2- 172.21.15.6:0/3987645624 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f47f0156370 0x7f47f00ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.552+0000 7f47f71fe640 1 -- 172.21.15.6:0/3987645624 >> 172.21.15.6:0/3987645624 conn(0x7f47f006da40 msgr2=0x7f47f006de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:03:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.552+0000 7f47f71fe640 1 -- 172.21.15.6:0/3987645624 shutdown_connections 2024-05-04T01:03:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.552+0000 7f47f71fe640 1 -- 172.21.15.6:0/3987645624 wait complete. 2024-05-04T01:03:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.556+0000 7f47f71fe640 1 Processor -- start 2024-05-04T01:03:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.556+0000 7f47f71fe640 1 -- start start 2024-05-04T01:03:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.556+0000 7f47f71fe640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f00ceaa0 0x7f47f015b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.556+0000 7f47f71fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47f0156370 0x7f47f014e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.556+0000 7f47f71fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f47f015cb60 0x7f47f014e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.556+0000 7f47f71fe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f47f0156780 con 0x7f47f0156370 2024-05-04T01:03:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.556+0000 7f47f71fe640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f47f015cf70 con 0x7f47f00ceaa0 2024-05-04T01:03:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.556+0000 7f47f71fe640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f47f00cd320 con 0x7f47f015cb60 2024-05-04T01:03:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.556+0000 7f47effff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47f0156370 0x7f47f014e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.556+0000 7f47effff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47f0156370 0x7f47f014e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59376/0 (socket says 172.21.15.6:59376) 2024-05-04T01:03:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.556+0000 7f47effff640 1 -- 172.21.15.6:0/1320848000 learned_addr learned my addr 172.21.15.6:0/1320848000 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:03:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.556+0000 7f47f579b640 1 --2- 172.21.15.6:0/1320848000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f47f015cb60 0x7f47f014e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.556+0000 7f47f4f9a640 1 --2- 172.21.15.6:0/1320848000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f00ceaa0 0x7f47f015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.560+0000 7f47effff640 1 -- 172.21.15.6:0/1320848000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f47f015cb60 msgr2=0x7f47f014e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.560+0000 7f47effff640 1 --2- 172.21.15.6:0/1320848000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f47f015cb60 0x7f47f014e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.560+0000 7f47effff640 1 -- 172.21.15.6:0/1320848000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f00ceaa0 msgr2=0x7f47f015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.560+0000 7f47effff640 1 --2- 172.21.15.6:0/1320848000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f00ceaa0 0x7f47f015b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.560+0000 7f47effff640 1 -- 172.21.15.6:0/1320848000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f0150120 con 0x7f47f0156370 2024-05-04T01:03:16.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.564+0000 7f47effff640 1 --2- 172.21.15.6:0/1320848000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47f0156370 0x7f47f014e200 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f47d800e8a0 tx=0x7f47d800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:16.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.568+0000 7f47ed7fa640 1 -- 172.21.15.6:0/1320848000 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8017070 con 0x7f47f0156370 2024-05-04T01:03:16.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.568+0000 7f47ed7fa640 1 -- 172.21.15.6:0/1320848000 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f47d800c940 con 0x7f47f0156370 2024-05-04T01:03:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.568+0000 7f47ed7fa640 1 -- 172.21.15.6:0/1320848000 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d800cd10 con 0x7f47f0156370 2024-05-04T01:03:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.568+0000 7f47f71fe640 1 -- 172.21.15.6:0/1320848000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f0069cd0 con 0x7f47f0156370 2024-05-04T01:03:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.568+0000 7f47f71fe640 1 -- 172.21.15.6:0/1320848000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f014f080 con 0x7f47f0156370 2024-05-04T01:03:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.568+0000 7f47f71fe640 1 -- 172.21.15.6:0/1320848000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f014ede0 con 0x7f47f0156370 2024-05-04T01:03:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.908+0000 7f47ed7fa640 1 -- 172.21.15.6:0/1320848000 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f47d801a070 con 0x7f47f0156370 2024-05-04T01:03:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.912+0000 7f47ed7fa640 1 --2- 172.21.15.6:0/1320848000 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f47d006f450 0x7f47d0071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:16.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.912+0000 7f47f4f9a640 1 --2- 172.21.15.6:0/1320848000 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f47d006f450 0x7f47d0071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:16.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.912+0000 7f47f4f9a640 1 --2- 172.21.15.6:0/1320848000 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f47d006f450 0x7f47d0071960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f47e0001e40 tx=0x7f47e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:16.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.952+0000 7f47ed7fa640 1 -- 172.21.15.6:0/1320848000 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f47d8058490 con 0x7f47f0156370 2024-05-04T01:03:16.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:16.972+0000 7f47ed7fa640 1 -- 172.21.15.6:0/1320848000 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f47f014ede0 con 0x7f47f0156370 2024-05-04T01:03:17.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.188+0000 7f47f71fe640 1 -- 172.21.15.6:0/1320848000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47f006a390 con 0x7f47f0156370 2024-05-04T01:03:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.236+0000 7f47ed7fa640 1 -- 172.21.15.6:0/1320848000 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6850 (secure 0 0 0) 0x7f47d805c200 con 0x7f47f0156370 2024-05-04T01:03:17.241 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T01:03:17.241 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4185,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/811470677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":811470677},{"type":"v1","addr":"172.21.15.6:6833","nonce":811470677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4194,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/50303985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":50303985},{"type":"v1","addr":"172.21.15.163:6839","nonce":50303985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2015777060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2015777060},{"type":"v1","addr":"172.21.15.6:6835","nonce":2015777060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T00:31:21.468790+0000","modified":"2024-05-04T00:31:36.770046+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.163:6835/428471443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":428471443},{"type":"v1","addr":"172.21.15.163:6835","nonce":428471443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"b","rank":1,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6837/1055589916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1055589916},{"type":"v1","addr":"172.21.15.163:6837","nonce":1055589916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.6:6837/639743836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":639743836},{"type":"v1","addr":"172.21.15.6:6837","nonce":639743836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-04T01:03:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 12 2024-05-04T01:03:17.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.240+0000 7f47f71fe640 1 -- 172.21.15.6:0/1320848000 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f47d006f450 msgr2=0x7f47d0071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:17.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.240+0000 7f47f71fe640 1 --2- 172.21.15.6:0/1320848000 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f47d006f450 0x7f47d0071960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f47e0001e40 tx=0x7f47e0009040 comp rx=0 tx=0).stop 2024-05-04T01:03:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.240+0000 7f47f71fe640 1 -- 172.21.15.6:0/1320848000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47f0156370 msgr2=0x7f47f014e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.240+0000 7f47f71fe640 1 --2- 172.21.15.6:0/1320848000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47f0156370 0x7f47f014e200 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f47d800e8a0 tx=0x7f47d800eca0 comp rx=0 tx=0).stop 2024-05-04T01:03:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.240+0000 7f47f71fe640 1 -- 172.21.15.6:0/1320848000 shutdown_connections 2024-05-04T01:03:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.240+0000 7f47f71fe640 1 --2- 172.21.15.6:0/1320848000 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f47d006f450 0x7f47d0071960 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.240+0000 7f47f71fe640 1 --2- 172.21.15.6:0/1320848000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f47f015cb60 0x7f47f014e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.240+0000 7f47f71fe640 1 --2- 172.21.15.6:0/1320848000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47f0156370 0x7f47f014e200 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.240+0000 7f47f71fe640 1 --2- 172.21.15.6:0/1320848000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f00ceaa0 0x7f47f015b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.240+0000 7f47f71fe640 1 -- 172.21.15.6:0/1320848000 >> 172.21.15.6:0/1320848000 conn(0x7f47f006da40 msgr2=0x7f47f0154500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:03:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.240+0000 7f47f71fe640 1 -- 172.21.15.6:0/1320848000 shutdown_connections 2024-05-04T01:03:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.240+0000 7f47f71fe640 1 -- 172.21.15.6:0/1320848000 wait complete. 2024-05-04T01:03:17.267 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T01:03:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.412+0000 7f476a7f3640 1 Processor -- start 2024-05-04T01:03:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.412+0000 7f476a7f3640 1 -- start start 2024-05-04T01:03:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.416+0000 7f476a7f3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47640c7b20 0x7f47640c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.416+0000 7f476a7f3640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f476415a2f0 0x7f476415a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.416+0000 7f476a7f3640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4764074690 con 0x7f4764154010 2024-05-04T01:03:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.416+0000 7f476a7f3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f4764074930 con 0x7f47640c7b20 2024-05-04T01:03:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.416+0000 7f476a7f3640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f47640ca1d0 con 0x7f476415a2f0 2024-05-04T01:03:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.420+0000 7f4768d90640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f476415a2f0 0x7f476415a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.420+0000 7f4763fff640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f4764154010 0x7f4764073f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.6:48684/0 (socket says 172.21.15.6:48684) 2024-05-04T01:03:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.420+0000 7f4763fff640 1 -- 172.21.15.6:0/4201567256 learned_addr learned my addr 172.21.15.6:0/4201567256 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T01:03:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.420+0000 7f47637fe640 1 --2- 172.21.15.6:0/4201567256 >> v2:172.21.15.6:3300/0 conn(0x7f47640c7b20 0x7f47640c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:17.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.424+0000 7f47637fe640 1 -- 172.21.15.6:0/4201567256 >> v2:172.21.15.163:3300/0 conn(0x7f476415a2f0 msgr2=0x7f476415a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:03:17.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.424+0000 7f47637fe640 1 --2- 172.21.15.6:0/4201567256 >> v2:172.21.15.163:3300/0 conn(0x7f476415a2f0 0x7f476415a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:17.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.424+0000 7f47637fe640 1 -- 172.21.15.6:0/4201567256 >> v1:172.21.15.163:6789/0 conn(0x7f4764154010 legacy=0x7f4764073f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:03:17.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.424+0000 7f47637fe640 1 -- 172.21.15.6:0/4201567256 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47640c9b30 con 0x7f47640c7b20 2024-05-04T01:03:17.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.428+0000 7f47637fe640 1 --2- 172.21.15.6:0/4201567256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47640c7b20 0x7f47640c7f30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f47640cf210 tx=0x7f475801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e0bc3c414b6d15 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:17.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.540+0000 7f4762ffd640 1 -- 172.21.15.6:0/4201567256 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47580b0070 con 0x7f47640c7b20 2024-05-04T01:03:17.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.540+0000 7f4762ffd640 1 -- 172.21.15.6:0/4201567256 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f47580ab600 con 0x7f47640c7b20 2024-05-04T01:03:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.540+0000 7f4762ffd640 1 -- 172.21.15.6:0/4201567256 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47580ab9f0 con 0x7f47640c7b20 2024-05-04T01:03:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.540+0000 7f476a7f3640 1 -- 172.21.15.6:0/4201567256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47640c7b20 msgr2=0x7f47640c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.540+0000 7f476a7f3640 1 --2- 172.21.15.6:0/4201567256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47640c7b20 0x7f47640c7f30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f47640cf210 tx=0x7f475801c3b0 comp rx=0 tx=0).stop 2024-05-04T01:03:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.540+0000 7f476a7f3640 1 -- 172.21.15.6:0/4201567256 shutdown_connections 2024-05-04T01:03:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.540+0000 7f476a7f3640 1 --2- 172.21.15.6:0/4201567256 >> v2:172.21.15.163:3300/0 conn(0x7f476415a2f0 0x7f476415a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.540+0000 7f476a7f3640 1 --2- 172.21.15.6:0/4201567256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47640c7b20 0x7f47640c7f30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.540+0000 7f476a7f3640 1 -- 172.21.15.6:0/4201567256 >> 172.21.15.6:0/4201567256 conn(0x7f47640ce410 msgr2=0x7f47640ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:03:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.540+0000 7f476a7f3640 1 -- 172.21.15.6:0/4201567256 shutdown_connections 2024-05-04T01:03:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.540+0000 7f476a7f3640 1 -- 172.21.15.6:0/4201567256 wait complete. 2024-05-04T01:03:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.544+0000 7f476a7f3640 1 Processor -- start 2024-05-04T01:03:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.544+0000 7f476a7f3640 1 -- start start 2024-05-04T01:03:17.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.548+0000 7f476a7f3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47640c7b20 0x7f47640c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:17.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.548+0000 7f476a7f3640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4764154010 0x7f476414ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:17.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.548+0000 7f476a7f3640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f476415a2f0 0x7f4764140b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:17.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.548+0000 7f476a7f3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4764154420 con 0x7f47640c7b20 2024-05-04T01:03:17.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.548+0000 7f476a7f3640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f47640c97c0 con 0x7f4764154010 2024-05-04T01:03:17.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.548+0000 7f476a7f3640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f476415ac40 con 0x7f476415a2f0 2024-05-04T01:03:17.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.552+0000 7f4763fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47640c7b20 0x7f47640c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:17.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.552+0000 7f4763fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47640c7b20 0x7f47640c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59404/0 (socket says 172.21.15.6:59404) 2024-05-04T01:03:17.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.552+0000 7f4763fff640 1 -- 172.21.15.6:0/4042258098 learned_addr learned my addr 172.21.15.6:0/4042258098 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:03:17.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.560+0000 7f4763fff640 1 -- 172.21.15.6:0/4042258098 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f476415a2f0 msgr2=0x7f4764140b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:17.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.560+0000 7f4763fff640 1 --2- 172.21.15.6:0/4042258098 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f476415a2f0 0x7f4764140b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:17.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.560+0000 7f4763fff640 1 -- 172.21.15.6:0/4042258098 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4764154010 msgr2=0x7f476414ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:17.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.560+0000 7f4763fff640 1 --2- 172.21.15.6:0/4042258098 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4764154010 0x7f476414ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:17.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.560+0000 7f4763fff640 1 -- 172.21.15.6:0/4042258098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4764159d80 con 0x7f47640c7b20 2024-05-04T01:03:17.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.568+0000 7f4763fff640 1 --2- 172.21.15.6:0/4042258098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47640c7b20 0x7f47640c7460 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f475400b460 tx=0x7f475400b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:17.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.572+0000 7f4760ff9640 1 -- 172.21.15.6:0/4042258098 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4754015020 con 0x7f47640c7b20 2024-05-04T01:03:17.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.572+0000 7f4760ff9640 1 -- 172.21.15.6:0/4042258098 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4754011850 con 0x7f47640c7b20 2024-05-04T01:03:17.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.572+0000 7f476a7f3640 1 -- 172.21.15.6:0/4042258098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4764159aa0 con 0x7f47640c7b20 2024-05-04T01:03:17.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.572+0000 7f4760ff9640 1 -- 172.21.15.6:0/4042258098 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4754011c60 con 0x7f47640c7b20 2024-05-04T01:03:17.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.572+0000 7f476a7f3640 1 -- 172.21.15.6:0/4042258098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47640c63c0 con 0x7f47640c7b20 2024-05-04T01:03:17.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.576+0000 7f476a7f3640 1 -- 172.21.15.6:0/4042258098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4764069a50 con 0x7f47640c7b20 2024-05-04T01:03:17.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.896+0000 7f4760ff9640 1 -- 172.21.15.6:0/4042258098 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4754018020 con 0x7f47640c7b20 2024-05-04T01:03:17.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.896+0000 7f4760ff9640 1 --2- 172.21.15.6:0/4042258098 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f475006f480 0x7f4750071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:17.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.896+0000 7f47637fe640 1 --2- 172.21.15.6:0/4042258098 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f475006f480 0x7f4750071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:17.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.900+0000 7f47637fe640 1 --2- 172.21.15.6:0/4042258098 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f475006f480 0x7f4750071990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f47580ad000 tx=0x7f4758004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:17.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.936+0000 7f4760ff9640 1 -- 172.21.15.6:0/4042258098 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f4754058240 con 0x7f47640c7b20 2024-05-04T01:03:17.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:17.936+0000 7f4760ff9640 1 -- 172.21.15.6:0/4042258098 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f475401f020 con 0x7f47640c7b20 2024-05-04T01:03:18.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.132+0000 7f476a7f3640 1 -- 172.21.15.6:0/4042258098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f476414e230 con 0x7f47640c7b20 2024-05-04T01:03:18.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.256+0000 7f4760ff9640 1 -- 172.21.15.6:0/4042258098 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+16585 (secure 0 0 0) 0x7f475405c6b0 con 0x7f47640c7b20 2024-05-04T01:03:18.261 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-04T01:03:18.261 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":28,"fsid":"ad5951ed-0d5e-4770-b5d9-995e08a00213","created":"2024-05-04T00:30:11.236352+0000","modified":"2024-05-04T00:32:21.477287+0000","last_up_change":"2024-05-04T00:30:35.679943+0000","last_in_change":"2024-05-04T00:30:24.926330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T00:30:36.311072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T00:31:17.278288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T00:31:18.957819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a907d753-b7cf-499c-ae36-81e44ed933a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6805","nonce":489144503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6810","nonce":489144503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6824","nonce":489144503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6813","nonce":489144503},{"type":"v1","addr":"172.21.15.6:6817","nonce":489144503}]},"public_addr":"172.21.15.6:6805/489144503","cluster_addr":"172.21.15.6:6810/489144503","heartbeat_back_addr":"172.21.15.6:6824/489144503","heartbeat_front_addr":"172.21.15.6:6817/489144503","state":["exists","up"]},{"osd":1,"uuid":"eab41a32-d5f1-43b8-8835-f2d4bffc9cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6802","nonce":3099957279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6807","nonce":3099957279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6819","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6823","nonce":3099957279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":3099957279},{"type":"v1","addr":"172.21.15.6:6815","nonce":3099957279}]},"public_addr":"172.21.15.6:6802/3099957279","cluster_addr":"172.21.15.6:6807/3099957279","heartbeat_back_addr":"172.21.15.6:6823/3099957279","heartbeat_front_addr":"172.21.15.6:6815/3099957279","state":["exists","up"]},{"osd":2,"uuid":"f2540144-b533-4ffc-a9cf-24f0e4910a9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6801","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6806","nonce":2770857903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6809","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6812","nonce":2770857903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6827","nonce":2770857903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2770857903},{"type":"v1","addr":"172.21.15.6:6821","nonce":2770857903}]},"public_addr":"172.21.15.6:6806/2770857903","cluster_addr":"172.21.15.6:6812/2770857903","heartbeat_back_addr":"172.21.15.6:6827/2770857903","heartbeat_front_addr":"172.21.15.6:6821/2770857903","state":["exists","up"]},{"osd":3,"uuid":"982b7ace-fd02-4f03-aef2-0428468f8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6818","nonce":3149875909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6826","nonce":3149875909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6831","nonce":3149875909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3149875909},{"type":"v1","addr":"172.21.15.6:6829","nonce":3149875909}]},"public_addr":"172.21.15.6:6818/3149875909","cluster_addr":"172.21.15.6:6826/3149875909","heartbeat_back_addr":"172.21.15.6:6831/3149875909","heartbeat_front_addr":"172.21.15.6:6829/3149875909","state":["exists","up"]},{"osd":4,"uuid":"ecf94166-cfdf-4ac8-a659-6ae907686e8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6818","nonce":2508264225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6821","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6824","nonce":2508264225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6833","nonce":2508264225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2508264225},{"type":"v1","addr":"172.21.15.163:6831","nonce":2508264225}]},"public_addr":"172.21.15.163:6818/2508264225","cluster_addr":"172.21.15.163:6824/2508264225","heartbeat_back_addr":"172.21.15.163:6833/2508264225","heartbeat_front_addr":"172.21.15.163:6831/2508264225","state":["exists","up"]},{"osd":5,"uuid":"fc5cfa90-0e3a-4fc2-829c-5ff57d7a5953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6815","nonce":167619435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6820","nonce":167619435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6827","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6829","nonce":167619435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":167619435},{"type":"v1","addr":"172.21.15.163:6825","nonce":167619435}]},"public_addr":"172.21.15.163:6815/167619435","cluster_addr":"172.21.15.163:6820/167619435","heartbeat_back_addr":"172.21.15.163:6829/167619435","heartbeat_front_addr":"172.21.15.163:6825/167619435","state":["exists","up"]},{"osd":6,"uuid":"ed95f0cf-f309-4861-b47c-4a5a6b44ffdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6811","nonce":1460767610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6813","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6814","nonce":1460767610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6830","nonce":1460767610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6819","nonce":1460767610},{"type":"v1","addr":"172.21.15.163:6822","nonce":1460767610}]},"public_addr":"172.21.15.163:6811/1460767610","cluster_addr":"172.21.15.163:6814/1460767610","heartbeat_back_addr":"172.21.15.163:6830/1460767610","heartbeat_front_addr":"172.21.15.163:6822/1460767610","state":["exists","up"]},{"osd":7,"uuid":"2f57afcd-567f-44f6-9db7-df0342c8c4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6803","nonce":239650691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6805","nonce":239650691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6809","nonce":239650691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239650691},{"type":"v1","addr":"172.21.15.163:6807","nonce":239650691}]},"public_addr":"172.21.15.163:6803/239650691","cluster_addr":"172.21.15.163:6805/239650691","heartbeat_back_addr":"172.21.15.163:6809/239650691","heartbeat_front_addr":"172.21.15.163:6807/239650691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.818870+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.749094+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.805522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.576430+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.740084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.755726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.797961+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T00:30:30.577731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T01:03:18.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.260+0000 7f476a7f3640 1 -- 172.21.15.6:0/4042258098 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f475006f480 msgr2=0x7f4750071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:18.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.260+0000 7f476a7f3640 1 --2- 172.21.15.6:0/4042258098 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f475006f480 0x7f4750071990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f47580ad000 tx=0x7f4758004740 comp rx=0 tx=0).stop 2024-05-04T01:03:18.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.260+0000 7f476a7f3640 1 -- 172.21.15.6:0/4042258098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47640c7b20 msgr2=0x7f47640c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:18.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.260+0000 7f476a7f3640 1 --2- 172.21.15.6:0/4042258098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47640c7b20 0x7f47640c7460 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f475400b460 tx=0x7f475400b920 comp rx=0 tx=0).stop 2024-05-04T01:03:18.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.260+0000 7f476a7f3640 1 -- 172.21.15.6:0/4042258098 shutdown_connections 2024-05-04T01:03:18.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.260+0000 7f476a7f3640 1 --2- 172.21.15.6:0/4042258098 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4764154010 0x7f476414ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:18.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.260+0000 7f476a7f3640 1 --2- 172.21.15.6:0/4042258098 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f475006f480 0x7f4750071990 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:18.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.260+0000 7f476a7f3640 1 --2- 172.21.15.6:0/4042258098 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f476415a2f0 0x7f4764140b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:18.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.260+0000 7f476a7f3640 1 --2- 172.21.15.6:0/4042258098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47640c7b20 0x7f47640c7460 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:18.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.260+0000 7f476a7f3640 1 -- 172.21.15.6:0/4042258098 >> 172.21.15.6:0/4042258098 conn(0x7f47640ce410 msgr2=0x7f47641440b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:03:18.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.260+0000 7f476a7f3640 1 -- 172.21.15.6:0/4042258098 shutdown_connections 2024-05-04T01:03:18.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.260+0000 7f476a7f3640 1 -- 172.21.15.6:0/4042258098 wait complete. 2024-05-04T01:03:18.295 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-04T01:03:18.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.452+0000 7f77e2ecd640 1 Processor -- start 2024-05-04T01:03:18.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.452+0000 7f77e2ecd640 1 -- start start 2024-05-04T01:03:18.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.456+0000 7f77e2ecd640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f77dc06c8a0 0x7f77dc15ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:18.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.456+0000 7f77e2ecd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f77dc06d670 0x7f77dc1561a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:18.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.456+0000 7f77e2ecd640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77dc15d1f0 con 0x7f77dc0c91d0 2024-05-04T01:03:18.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.456+0000 7f77e2ecd640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f77dc15f820 con 0x7f77dc06c8a0 2024-05-04T01:03:18.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.456+0000 7f77e2ecd640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f77dc1600c0 con 0x7f77dc06d670 2024-05-04T01:03:18.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.456+0000 7f77dbfff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f77dc06d670 0x7f77dc1561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:18.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.456+0000 7f77dbfff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f77dc06d670 0x7f77dc1561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.6:35706/0 (socket says 172.21.15.6:35706) 2024-05-04T01:03:18.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.456+0000 7f77dbfff640 1 -- 172.21.15.6:0/3871079427 learned_addr learned my addr 172.21.15.6:0/3871079427 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:03:18.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.456+0000 7f77e0c69640 1 --2- 172.21.15.6:0/3871079427 >> v2:172.21.15.163:3300/0 conn(0x7f77dc06c8a0 0x7f77dc15ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:18.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.464+0000 7f77dbfff640 1 -- 172.21.15.6:0/3871079427 >> v2:172.21.15.163:3300/0 conn(0x7f77dc06c8a0 msgr2=0x7f77dc15ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:03:18.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.464+0000 7f77dbfff640 1 --2- 172.21.15.6:0/3871079427 >> v2:172.21.15.163:3300/0 conn(0x7f77dc06c8a0 0x7f77dc15ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:18.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.464+0000 7f77dbfff640 1 -- 172.21.15.6:0/3871079427 >> v1:172.21.15.163:6789/0 conn(0x7f77dc0c91d0 legacy=0x7f77dc0631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:18.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.464+0000 7f77dbfff640 1 -- 172.21.15.6:0/3871079427 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77dc1566e0 con 0x7f77dc06d670 2024-05-04T01:03:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.468+0000 7f77dbfff640 1 --2- 172.21.15.6:0/3871079427 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f77dc06d670 0x7f77dc1561a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f77cc009870 tx=0x7f77cc01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44ee709a708ce977 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.480+0000 7f77db7fe640 1 -- 172.21.15.6:0/3871079427 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc0b5070 con 0x7f77dc06d670 2024-05-04T01:03:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.480+0000 7f77db7fe640 1 -- 172.21.15.6:0/3871079427 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f77cc0a8a50 con 0x7f77dc06d670 2024-05-04T01:03:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.480+0000 7f77db7fe640 1 -- 172.21.15.6:0/3871079427 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc0a8e40 con 0x7f77dc06d670 2024-05-04T01:03:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.484+0000 7f77e2ecd640 1 -- 172.21.15.6:0/3871079427 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f77dc06d670 msgr2=0x7f77dc1561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.484+0000 7f77e2ecd640 1 --2- 172.21.15.6:0/3871079427 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f77dc06d670 0x7f77dc1561a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f77cc009870 tx=0x7f77cc01ed50 comp rx=0 tx=0).stop 2024-05-04T01:03:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.484+0000 7f77e2ecd640 1 -- 172.21.15.6:0/3871079427 shutdown_connections 2024-05-04T01:03:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.484+0000 7f77e2ecd640 1 --2- 172.21.15.6:0/3871079427 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f77dc06d670 0x7f77dc1561a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.484+0000 7f77e2ecd640 1 --2- 172.21.15.6:0/3871079427 >> v2:172.21.15.163:3300/0 conn(0x7f77dc06c8a0 0x7f77dc15ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.484+0000 7f77e2ecd640 1 -- 172.21.15.6:0/3871079427 >> 172.21.15.6:0/3871079427 conn(0x7f77dc0ce410 msgr2=0x7f77dc0ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:03:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.484+0000 7f77e2ecd640 1 -- 172.21.15.6:0/3871079427 shutdown_connections 2024-05-04T01:03:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.484+0000 7f77e2ecd640 1 -- 172.21.15.6:0/3871079427 wait complete. 2024-05-04T01:03:18.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.484+0000 7f77e2ecd640 1 Processor -- start 2024-05-04T01:03:18.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.484+0000 7f77e2ecd640 1 -- start start 2024-05-04T01:03:18.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.488+0000 7f77e2ecd640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77dc06c8a0 0x7f77dc152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:18.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.488+0000 7f77e2ecd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77dc06d670 0x7f77dc154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:18.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.488+0000 7f77e2ecd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f77dc0c91d0 0x7f77dc154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:18.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.488+0000 7f77e2ecd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc15fa70 con 0x7f77dc06d670 2024-05-04T01:03:18.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.488+0000 7f77e2ecd640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc06d080 con 0x7f77dc06c8a0 2024-05-04T01:03:18.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.488+0000 7f77e2ecd640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f77dc15fd50 con 0x7f77dc0c91d0 2024-05-04T01:03:18.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.488+0000 7f77dbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77dc06d670 0x7f77dc154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:18.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.488+0000 7f77e0c69640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77dc06c8a0 0x7f77dc152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:18.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.488+0000 7f77e146a640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f77dc0c91d0 0x7f77dc154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:18.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.488+0000 7f77dbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77dc06d670 0x7f77dc154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59406/0 (socket says 172.21.15.6:59406) 2024-05-04T01:03:18.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.488+0000 7f77dbfff640 1 -- 172.21.15.6:0/3561555080 learned_addr learned my addr 172.21.15.6:0/3561555080 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:03:18.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.496+0000 7f77dbfff640 1 -- 172.21.15.6:0/3561555080 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f77dc0c91d0 msgr2=0x7f77dc154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:18.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.496+0000 7f77dbfff640 1 --2- 172.21.15.6:0/3561555080 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f77dc0c91d0 0x7f77dc154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:18.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.496+0000 7f77dbfff640 1 -- 172.21.15.6:0/3561555080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77dc06c8a0 msgr2=0x7f77dc152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:18.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.496+0000 7f77dbfff640 1 --2- 172.21.15.6:0/3561555080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77dc06c8a0 0x7f77dc152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:18.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.496+0000 7f77dbfff640 1 -- 172.21.15.6:0/3561555080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77dc1f21e0 con 0x7f77dc06d670 2024-05-04T01:03:18.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.496+0000 7f77dbfff640 1 --2- 172.21.15.6:0/3561555080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77dc06d670 0x7f77dc154a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f77cc01d400 tx=0x7f77cc01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:18.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.504+0000 7f77d97fa640 1 -- 172.21.15.6:0/3561555080 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc0b5040 con 0x7f77dc06d670 2024-05-04T01:03:18.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.504+0000 7f77d97fa640 1 -- 172.21.15.6:0/3561555080 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f77cc0be070 con 0x7f77dc06d670 2024-05-04T01:03:18.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.504+0000 7f77e2ecd640 1 -- 172.21.15.6:0/3561555080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77dc15bbb0 con 0x7f77dc06d670 2024-05-04T01:03:18.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.504+0000 7f77d97fa640 1 -- 172.21.15.6:0/3561555080 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc0b1d20 con 0x7f77dc06d670 2024-05-04T01:03:18.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.504+0000 7f77e2ecd640 1 -- 172.21.15.6:0/3561555080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77dc0c8630 con 0x7f77dc06d670 2024-05-04T01:03:18.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.504+0000 7f77e2ecd640 1 -- 172.21.15.6:0/3561555080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77dc069a50 con 0x7f77dc06d670 2024-05-04T01:03:18.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.840+0000 7f77d97fa640 1 -- 172.21.15.6:0/3561555080 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f77cc0c3460 con 0x7f77dc06d670 2024-05-04T01:03:18.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.840+0000 7f77d97fa640 1 --2- 172.21.15.6:0/3561555080 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f77c806f480 0x7f77c8071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.840+0000 7f77e0c69640 1 --2- 172.21.15.6:0/3561555080 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f77c806f480 0x7f77c8071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:18.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.840+0000 7f77e0c69640 1 --2- 172.21.15.6:0/3561555080 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f77c806f480 0x7f77c8071990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009ac0 tx=0x7f77d0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.880+0000 7f77d97fa640 1 -- 172.21.15.6:0/3561555080 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5738+0+0 (secure 0 0 0) 0x7f77cc0c4e20 con 0x7f77dc06d670 2024-05-04T01:03:18.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:18.880+0000 7f77d97fa640 1 -- 172.21.15.6:0/3561555080 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f77cc0c8020 con 0x7f77dc06d670 2024-05-04T01:03:19.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.104+0000 7f77e2ecd640 1 -- 172.21.15.6:0/3561555080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f77dc06d3e0 con 0x7f77dc06d670 2024-05-04T01:03:19.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.524+0000 7f77d97fa640 1 -- 172.21.15.6:0/3561555080 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v13) ==== 161+0+0 (secure 0 0 0) 0x7f77cc0188b0 con 0x7f77dc06d670 2024-05-04T01:03:19.530 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-04T01:03:19.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.528+0000 7f77e2ecd640 1 -- 172.21.15.6:0/3561555080 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f77c806f480 msgr2=0x7f77c8071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:19.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.528+0000 7f77e2ecd640 1 --2- 172.21.15.6:0/3561555080 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f77c806f480 0x7f77c8071990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009ac0 tx=0x7f77d0009190 comp rx=0 tx=0).stop 2024-05-04T01:03:19.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.528+0000 7f77e2ecd640 1 -- 172.21.15.6:0/3561555080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77dc06d670 msgr2=0x7f77dc154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:19.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.528+0000 7f77e2ecd640 1 --2- 172.21.15.6:0/3561555080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77dc06d670 0x7f77dc154a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f77cc01d400 tx=0x7f77cc01baf0 comp rx=0 tx=0).stop 2024-05-04T01:03:19.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.528+0000 7f77e2ecd640 1 -- 172.21.15.6:0/3561555080 shutdown_connections 2024-05-04T01:03:19.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.528+0000 7f77e2ecd640 1 --2- 172.21.15.6:0/3561555080 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f77c806f480 0x7f77c8071990 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:19.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.528+0000 7f77e2ecd640 1 --2- 172.21.15.6:0/3561555080 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f77dc0c91d0 0x7f77dc154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:19.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.528+0000 7f77e2ecd640 1 --2- 172.21.15.6:0/3561555080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77dc06d670 0x7f77dc154a20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:19.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.528+0000 7f77e2ecd640 1 --2- 172.21.15.6:0/3561555080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77dc06c8a0 0x7f77dc152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:19.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.528+0000 7f77e2ecd640 1 -- 172.21.15.6:0/3561555080 >> 172.21.15.6:0/3561555080 conn(0x7f77dc0ce410 msgr2=0x7f77dc0c95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:03:19.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.528+0000 7f77e2ecd640 1 -- 172.21.15.6:0/3561555080 shutdown_connections 2024-05-04T01:03:19.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.528+0000 7f77e2ecd640 1 -- 172.21.15.6:0/3561555080 wait complete. 2024-05-04T01:03:19.565 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-04T01:03:19.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.732+0000 7f40621ef640 1 Processor -- start 2024-05-04T01:03:19.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.732+0000 7f40621ef640 1 -- start start 2024-05-04T01:03:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.732+0000 7f40621ef640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c15aae0 0x7f405c0708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.732+0000 7f40621ef640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f405c0cbd90 con 0x7f405c0704a0 2024-05-04T01:03:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.732+0000 7f40621ef640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f405c0cc030 con 0x7f405c0cca70 2024-05-04T01:03:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.732+0000 7f40621ef640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f405c0caf50 con 0x7f405c15aae0 2024-05-04T01:03:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.732+0000 7f405affd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f405c0704a0 0x7f405c15a3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51008/0 (socket says 172.21.15.6:51008) 2024-05-04T01:03:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.732+0000 7f405affd640 1 -- 172.21.15.6:0/1759800453 learned_addr learned my addr 172.21.15.6:0/1759800453 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-04T01:03:19.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.736+0000 7f405bfff640 1 --2- 172.21.15.6:0/1759800453 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c15aae0 0x7f405c0708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:19.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.736+0000 7f405a7fc640 1 -- 172.21.15.6:0/1759800453 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4249587922 0 0) 0x7f405c0cbd90 con 0x7f405c0704a0 2024-05-04T01:03:19.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.736+0000 7f405a7fc640 1 -- 172.21.15.6:0/1759800453 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4044003530 con 0x7f405c0704a0 2024-05-04T01:03:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.744+0000 7f405a7fc640 1 -- 172.21.15.6:0/1759800453 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 440884220 0 0) 0x7f4044003530 con 0x7f405c0704a0 2024-05-04T01:03:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.744+0000 7f405a7fc640 1 -- 172.21.15.6:0/1759800453 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c15aae0 msgr2=0x7f405c0708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:03:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.744+0000 7f405a7fc640 1 --2- 172.21.15.6:0/1759800453 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c15aae0 0x7f405c0708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.744+0000 7f405a7fc640 1 -- 172.21.15.6:0/1759800453 >> v1:172.21.15.163:6789/0 conn(0x7f405c0cca70 legacy=0x7f405c1540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.744+0000 7f405a7fc640 1 -- 172.21.15.6:0/1759800453 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405c0c45d0 con 0x7f405c0704a0 2024-05-04T01:03:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.744+0000 7f405a7fc640 1 -- 172.21.15.6:0/1759800453 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 557976392 0 0) 0x7f404c001720 con 0x7f405c0704a0 2024-05-04T01:03:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.744+0000 7f405a7fc640 1 -- 172.21.15.6:0/1759800453 >> v1:172.21.15.6:6789/0 conn(0x7f405c0704a0 legacy=0x7f405c15a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.744+0000 7f405a7fc640 1 --2- 172.21.15.6:0/1759800453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4044003a90 0x7f4044003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.744+0000 7f405a7fc640 1 --2- 172.21.15.6:0/1759800453 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c15aae0 0x7f4044004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.744+0000 7f405a7fc640 1 --2- 172.21.15.6:0/1759800453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4044004da0 0x7f4044005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.744+0000 7f405a7fc640 1 -- 172.21.15.6:0/1759800453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f405c0caf50 con 0x7f4044004da0 2024-05-04T01:03:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.744+0000 7f405a7fc640 1 -- 172.21.15.6:0/1759800453 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f404400bbe0 con 0x7f4044003a90 2024-05-04T01:03:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.744+0000 7f405a7fc640 1 -- 172.21.15.6:0/1759800453 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f404400bde0 con 0x7f405c15aae0 2024-05-04T01:03:19.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.748+0000 7f405bfff640 1 --2- 172.21.15.6:0/1759800453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4044004da0 0x7f4044005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:19.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.748+0000 7f405b7fe640 1 --2- 172.21.15.6:0/1759800453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4044003a90 0x7f4044003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:19.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.748+0000 7f405bfff640 1 -- 172.21.15.6:0/1759800453 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c15aae0 msgr2=0x7f4044004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:03:19.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.748+0000 7f405bfff640 1 --2- 172.21.15.6:0/1759800453 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c15aae0 0x7f4044004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:19.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.748+0000 7f405bfff640 1 -- 172.21.15.6:0/1759800453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4044003a90 msgr2=0x7f4044003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:03:19.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.748+0000 7f405bfff640 1 --2- 172.21.15.6:0/1759800453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4044003a90 0x7f4044003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:19.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.748+0000 7f405bfff640 1 -- 172.21.15.6:0/1759800453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4044003530 con 0x7f4044004da0 2024-05-04T01:03:19.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.756+0000 7f405bfff640 1 --2- 172.21.15.6:0/1759800453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4044004da0 0x7f4044005250 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4054009f90 tx=0x7f405401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92166c9bb44318b server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:19.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.760+0000 7f405a7fc640 1 -- 172.21.15.6:0/1759800453 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40540b2070 con 0x7f4044004da0 2024-05-04T01:03:19.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.760+0000 7f405a7fc640 1 -- 172.21.15.6:0/1759800453 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f40540a5c90 con 0x7f4044004da0 2024-05-04T01:03:19.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.760+0000 7f405a7fc640 1 -- 172.21.15.6:0/1759800453 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4054009c10 con 0x7f4044004da0 2024-05-04T01:03:19.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.760+0000 7f40621ef640 1 -- 172.21.15.6:0/1759800453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4044004da0 msgr2=0x7f4044005250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:19.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.760+0000 7f40621ef640 1 --2- 172.21.15.6:0/1759800453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4044004da0 0x7f4044005250 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4054009f90 tx=0x7f405401cc80 comp rx=0 tx=0).stop 2024-05-04T01:03:19.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.760+0000 7f405bfff640 1 -- 172.21.15.6:0/1759800453 reap_dead start 2024-05-04T01:03:19.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.760+0000 7f40621ef640 1 -- 172.21.15.6:0/1759800453 shutdown_connections 2024-05-04T01:03:19.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.760+0000 7f40621ef640 1 -- 172.21.15.6:0/1759800453 >> 172.21.15.6:0/1759800453 conn(0x7f405c06e990 msgr2=0x7f405c06eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:03:19.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.760+0000 7f40621ef640 1 -- 172.21.15.6:0/1759800453 shutdown_connections 2024-05-04T01:03:19.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.760+0000 7f40621ef640 1 -- 172.21.15.6:0/1759800453 wait complete. 2024-05-04T01:03:19.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.764+0000 7f40621ef640 1 Processor -- start 2024-05-04T01:03:19.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.764+0000 7f40621ef640 1 -- start start 2024-05-04T01:03:19.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.764+0000 7f40621ef640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f405c1f38a0 0x7f405c1f0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:19.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.764+0000 7f40621ef640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f405c1e5aa0 0x7f405c155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:19.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.764+0000 7f40621ef640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c155840 0x7f405c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:19.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.764+0000 7f40621ef640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f405c0c4e50 con 0x7f405c1f38a0 2024-05-04T01:03:19.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.764+0000 7f40621ef640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f405c0c4b70 con 0x7f405c1e5aa0 2024-05-04T01:03:19.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.764+0000 7f40621ef640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f405c0c5130 con 0x7f405c155840 2024-05-04T01:03:19.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.764+0000 7f405b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f405c1f38a0 0x7f405c1f0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:19.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.764+0000 7f405b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f405c1f38a0 0x7f405c1f0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59424/0 (socket says 172.21.15.6:59424) 2024-05-04T01:03:19.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.764+0000 7f405b7fe640 1 -- 172.21.15.6:0/3599095552 learned_addr learned my addr 172.21.15.6:0/3599095552 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:03:19.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.764+0000 7f405bfff640 1 --2- 172.21.15.6:0/3599095552 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c155840 0x7f405c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:19.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.764+0000 7f405affd640 1 --2- 172.21.15.6:0/3599095552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f405c1e5aa0 0x7f405c155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:19.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.768+0000 7f405b7fe640 1 -- 172.21.15.6:0/3599095552 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c155840 msgr2=0x7f405c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:19.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.768+0000 7f405b7fe640 1 --2- 172.21.15.6:0/3599095552 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c155840 0x7f405c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:19.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.768+0000 7f405b7fe640 1 -- 172.21.15.6:0/3599095552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f405c1e5aa0 msgr2=0x7f405c155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:19.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.768+0000 7f405b7fe640 1 --2- 172.21.15.6:0/3599095552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f405c1e5aa0 0x7f405c155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:19.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.768+0000 7f405b7fe640 1 -- 172.21.15.6:0/3599095552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405c159d60 con 0x7f405c1f38a0 2024-05-04T01:03:19.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.772+0000 7f405b7fe640 1 --2- 172.21.15.6:0/3599095552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f405c1f38a0 0x7f405c1f0300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f405000e580 tx=0x7f405000ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:19.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.776+0000 7f4043fff640 1 -- 172.21.15.6:0/3599095552 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40500052e0 con 0x7f405c1f38a0 2024-05-04T01:03:19.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.776+0000 7f4043fff640 1 -- 172.21.15.6:0/3599095552 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4050005480 con 0x7f405c1f38a0 2024-05-04T01:03:19.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.776+0000 7f4043fff640 1 -- 172.21.15.6:0/3599095552 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050007020 con 0x7f405c1f38a0 2024-05-04T01:03:19.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.776+0000 7f40621ef640 1 -- 172.21.15.6:0/3599095552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405c1f3dc0 con 0x7f405c1f38a0 2024-05-04T01:03:19.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.776+0000 7f40621ef640 1 -- 172.21.15.6:0/3599095552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f405c1f4380 con 0x7f405c1f38a0 2024-05-04T01:03:19.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:19.776+0000 7f40621ef640 1 -- 172.21.15.6:0/3599095552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f405c069a50 con 0x7f405c1f38a0 2024-05-04T01:03:20.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:20.072+0000 7f4043fff640 1 -- 172.21.15.6:0/3599095552 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f405001a020 con 0x7f405c1f38a0 2024-05-04T01:03:20.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:20.072+0000 7f4043fff640 1 --2- 172.21.15.6:0/3599095552 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f404806f430 0x7f4048071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:20.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:20.072+0000 7f405affd640 1 --2- 172.21.15.6:0/3599095552 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f404806f430 0x7f4048071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:20.076+0000 7f405affd640 1 --2- 172.21.15.6:0/3599095552 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f404806f430 0x7f4048071940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f404c007fd0 tx=0x7f404c007a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:20.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:20.088+0000 7f4043fff640 1 -- 172.21.15.6:0/3599095552 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5996+0+0 (secure 0 0 0) 0x7f405008da00 con 0x7f405c1f38a0 2024-05-04T01:03:20.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:20.088+0000 7f4043fff640 1 -- 172.21.15.6:0/3599095552 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f405005bc60 con 0x7f405c1f38a0 2024-05-04T01:03:20.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:20.304+0000 7f40621ef640 1 -- 172.21.15.6:0/3599095552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f405c151780 con 0x7f405c1f38a0 2024-05-04T01:03:21.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.464+0000 7f4043fff640 1 -- 172.21.15.6:0/3599095552 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v14) ==== 104+0+0 (secure 0 0 0) 0x7f405005ff60 con 0x7f405c1f38a0 2024-05-04T01:03:21.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.464+0000 7f40621ef640 1 -- 172.21.15.6:0/3599095552 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f404806f430 msgr2=0x7f4048071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:21.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.464+0000 7f40621ef640 1 --2- 172.21.15.6:0/3599095552 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f404806f430 0x7f4048071940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f404c007fd0 tx=0x7f404c007a20 comp rx=0 tx=0).stop 2024-05-04T01:03:21.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.464+0000 7f40621ef640 1 -- 172.21.15.6:0/3599095552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f405c1f38a0 msgr2=0x7f405c1f0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:21.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.464+0000 7f40621ef640 1 --2- 172.21.15.6:0/3599095552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f405c1f38a0 0x7f405c1f0300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f405000e580 tx=0x7f405000ea40 comp rx=0 tx=0).stop 2024-05-04T01:03:21.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.464+0000 7f40621ef640 1 -- 172.21.15.6:0/3599095552 shutdown_connections 2024-05-04T01:03:21.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.464+0000 7f40621ef640 1 --2- 172.21.15.6:0/3599095552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f405c1e5aa0 0x7f405c155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:21.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.464+0000 7f40621ef640 1 --2- 172.21.15.6:0/3599095552 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f404806f430 0x7f4048071940 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:21.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.464+0000 7f40621ef640 1 --2- 172.21.15.6:0/3599095552 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c155840 0x7f405c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:21.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.464+0000 7f40621ef640 1 --2- 172.21.15.6:0/3599095552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f405c1f38a0 0x7f405c1f0300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:21.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.464+0000 7f40621ef640 1 -- 172.21.15.6:0/3599095552 >> 172.21.15.6:0/3599095552 conn(0x7f405c06e990 msgr2=0x7f405c152bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:03:21.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.468+0000 7f40621ef640 1 -- 172.21.15.6:0/3599095552 shutdown_connections 2024-05-04T01:03:21.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.468+0000 7f40621ef640 1 -- 172.21.15.6:0/3599095552 wait complete. 2024-05-04T01:03:21.496 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-04T01:03:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.656+0000 7fcd6cf78640 1 Processor -- start 2024-05-04T01:03:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.656+0000 7fcd6cf78640 1 -- start start 2024-05-04T01:03:21.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.660+0000 7fcd6cf78640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd68156580 0x7fcd680631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:21.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.660+0000 7fcd6cf78640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcd6806c830 0x7fcd6806cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:21.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.660+0000 7fcd6cf78640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd680637e0 con 0x7fcd6815cac0 2024-05-04T01:03:21.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.660+0000 7fcd6cf78640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fcd680c97c0 con 0x7fcd6806c830 2024-05-04T01:03:21.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.660+0000 7fcd6cf78640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fcd6815f630 con 0x7fcd68156580 2024-05-04T01:03:21.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.660+0000 7fcd66d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcd6806c830 0x7fcd6806cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:21.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.660+0000 7fcd6659c640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd68156580 0x7fcd680631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:21.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.660+0000 7fcd66d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcd6806c830 0x7fcd6806cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59432/0 (socket says 172.21.15.6:59432) 2024-05-04T01:03:21.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.660+0000 7fcd66d9d640 1 -- 172.21.15.6:0/2646112087 learned_addr learned my addr 172.21.15.6:0/2646112087 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:03:21.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.664+0000 7fcd66d9d640 1 -- 172.21.15.6:0/2646112087 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd68156580 msgr2=0x7fcd680631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:03:21.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.664+0000 7fcd66d9d640 1 --2- 172.21.15.6:0/2646112087 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd68156580 0x7fcd680631c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:21.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.664+0000 7fcd66d9d640 1 -- 172.21.15.6:0/2646112087 >> v1:172.21.15.163:6789/0 conn(0x7fcd6815cac0 legacy=0x7fcd680c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:21.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.664+0000 7fcd66d9d640 1 -- 172.21.15.6:0/2646112087 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd68063aa0 con 0x7fcd6806c830 2024-05-04T01:03:21.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.664+0000 7fcd66d9d640 1 --2- 172.21.15.6:0/2646112087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd6806c830 0x7fcd6806cc40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009e50 tx=0x7fcd6001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2edc61a3d1abd8c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:21.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.672+0000 7fcd6559a640 1 -- 172.21.15.6:0/2646112087 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd600a5780 con 0x7fcd6806c830 2024-05-04T01:03:21.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.672+0000 7fcd6559a640 1 -- 172.21.15.6:0/2646112087 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcd600a5920 con 0x7fcd6806c830 2024-05-04T01:03:21.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.672+0000 7fcd6559a640 1 -- 172.21.15.6:0/2646112087 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd600a5d10 con 0x7fcd6806c830 2024-05-04T01:03:21.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.672+0000 7fcd6cf78640 1 -- 172.21.15.6:0/2646112087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd6806c830 msgr2=0x7fcd6806cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.672+0000 7fcd6cf78640 1 --2- 172.21.15.6:0/2646112087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd6806c830 0x7fcd6806cc40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009e50 tx=0x7fcd6001c9d0 comp rx=0 tx=0).stop 2024-05-04T01:03:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.672+0000 7fcd6cf78640 1 -- 172.21.15.6:0/2646112087 shutdown_connections 2024-05-04T01:03:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.672+0000 7fcd6cf78640 1 --2- 172.21.15.6:0/2646112087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd6806c830 0x7fcd6806cc40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.672+0000 7fcd6cf78640 1 --2- 172.21.15.6:0/2646112087 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd68156580 0x7fcd680631c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.672+0000 7fcd6cf78640 1 -- 172.21.15.6:0/2646112087 >> 172.21.15.6:0/2646112087 conn(0x7fcd680ce310 msgr2=0x7fcd680ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:03:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.672+0000 7fcd6cf78640 1 -- 172.21.15.6:0/2646112087 shutdown_connections 2024-05-04T01:03:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.672+0000 7fcd6cf78640 1 -- 172.21.15.6:0/2646112087 wait complete. 2024-05-04T01:03:21.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.672+0000 7fcd6cf78640 1 Processor -- start 2024-05-04T01:03:21.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.672+0000 7fcd6cf78640 1 -- start start 2024-05-04T01:03:21.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.676+0000 7fcd6cf78640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd6806c830 0x7fcd6815a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:21.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.676+0000 7fcd6cf78640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd68156580 0x7fcd681f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:21.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.676+0000 7fcd6cf78640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcd6815cac0 0x7fcd681482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:21.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.676+0000 7fcd6cf78640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcd68160360 con 0x7fcd68156580 2024-05-04T01:03:21.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.676+0000 7fcd6cf78640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6815ced0 con 0x7fcd6815cac0 2024-05-04T01:03:21.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.676+0000 7fcd6cf78640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fcd681f6470 con 0x7fcd6806c830 2024-05-04T01:03:21.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.676+0000 7fcd65d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd68156580 0x7fcd681f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:21.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.676+0000 7fcd6659c640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd6806c830 0x7fcd6815a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:21.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.676+0000 7fcd65d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd68156580 0x7fcd681f5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59448/0 (socket says 172.21.15.6:59448) 2024-05-04T01:03:21.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.676+0000 7fcd65d9b640 1 -- 172.21.15.6:0/4283248331 learned_addr learned my addr 172.21.15.6:0/4283248331 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:03:21.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.676+0000 7fcd66d9d640 1 --2- 172.21.15.6:0/4283248331 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcd6815cac0 0x7fcd681482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:21.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.680+0000 7fcd65d9b640 1 -- 172.21.15.6:0/4283248331 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd6806c830 msgr2=0x7fcd6815a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:21.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.680+0000 7fcd65d9b640 1 --2- 172.21.15.6:0/4283248331 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd6806c830 0x7fcd6815a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:21.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.680+0000 7fcd65d9b640 1 -- 172.21.15.6:0/4283248331 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcd6815cac0 msgr2=0x7fcd681482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:21.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.680+0000 7fcd65d9b640 1 --2- 172.21.15.6:0/4283248331 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcd6815cac0 0x7fcd681482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:21.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.680+0000 7fcd65d9b640 1 -- 172.21.15.6:0/4283248331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd681f5fa0 con 0x7fcd68156580 2024-05-04T01:03:21.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.684+0000 7fcd65d9b640 1 --2- 172.21.15.6:0/4283248331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd68156580 0x7fcd681f5a60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00c3f0 tx=0x7fcd5c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.688+0000 7fcd56ffd640 1 -- 172.21.15.6:0/4283248331 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c0052d0 con 0x7fcd68156580 2024-05-04T01:03:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.688+0000 7fcd56ffd640 1 -- 172.21.15.6:0/4283248331 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcd5c005490 con 0x7fcd68156580 2024-05-04T01:03:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.688+0000 7fcd6cf78640 1 -- 172.21.15.6:0/4283248331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd680ccdb0 con 0x7fcd68156580 2024-05-04T01:03:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.688+0000 7fcd56ffd640 1 -- 172.21.15.6:0/4283248331 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c007260 con 0x7fcd68156580 2024-05-04T01:03:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.688+0000 7fcd6cf78640 1 -- 172.21.15.6:0/4283248331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd680cd330 con 0x7fcd68156580 2024-05-04T01:03:21.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.688+0000 7fcd6cf78640 1 -- 172.21.15.6:0/4283248331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd68069a50 con 0x7fcd68156580 2024-05-04T01:03:21.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.712+0000 7fcd56ffd640 1 -- 172.21.15.6:0/4283248331 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcd5c007400 con 0x7fcd68156580 2024-05-04T01:03:21.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.712+0000 7fcd56ffd640 1 --2- 172.21.15.6:0/4283248331 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fcd4806f450 0x7fcd48071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:21.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.712+0000 7fcd6659c640 1 --2- 172.21.15.6:0/4283248331 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fcd4806f450 0x7fcd48071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:21.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.712+0000 7fcd6659c640 1 --2- 172.21.15.6:0/4283248331 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fcd4806f450 0x7fcd48071960 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcd58009ac0 tx=0x7fcd58009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:21.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:21.716+0000 7fcd56ffd640 1 -- 172.21.15.6:0/4283248331 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5996+0+0 (secure 0 0 0) 0x7fcd5c004df0 con 0x7fcd68156580 2024-05-04T01:03:22.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.060+0000 7fcd56ffd640 1 -- 172.21.15.6:0/4283248331 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fcd5c001090 con 0x7fcd68156580 2024-05-04T01:03:22.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.248+0000 7fcd6cf78640 1 -- 172.21.15.6:0/4283248331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcd681551b0 con 0x7fcd68156580 2024-05-04T01:03:22.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.756+0000 7fcd56ffd640 1 -- 172.21.15.6:0/4283248331 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) ==== 181+0+0 (secure 0 0 0) 0x7fcd5c05b4b0 con 0x7fcd68156580 2024-05-04T01:03:22.759 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-05-04T01:03:22.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.760+0000 7fcd6cf78640 1 -- 172.21.15.6:0/4283248331 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fcd4806f450 msgr2=0x7fcd48071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:22.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.760+0000 7fcd6cf78640 1 --2- 172.21.15.6:0/4283248331 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fcd4806f450 0x7fcd48071960 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcd58009ac0 tx=0x7fcd58009190 comp rx=0 tx=0).stop 2024-05-04T01:03:22.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.760+0000 7fcd6cf78640 1 -- 172.21.15.6:0/4283248331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd68156580 msgr2=0x7fcd681f5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:22.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.760+0000 7fcd6cf78640 1 --2- 172.21.15.6:0/4283248331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd68156580 0x7fcd681f5a60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00c3f0 tx=0x7fcd5c00c8b0 comp rx=0 tx=0).stop 2024-05-04T01:03:22.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.760+0000 7fcd6cf78640 1 -- 172.21.15.6:0/4283248331 shutdown_connections 2024-05-04T01:03:22.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.760+0000 7fcd6cf78640 1 --2- 172.21.15.6:0/4283248331 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcd6815cac0 0x7fcd681482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:22.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.760+0000 7fcd6cf78640 1 --2- 172.21.15.6:0/4283248331 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7fcd4806f450 0x7fcd48071960 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:22.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.760+0000 7fcd6cf78640 1 --2- 172.21.15.6:0/4283248331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd68156580 0x7fcd681f5a60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:22.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.760+0000 7fcd6cf78640 1 --2- 172.21.15.6:0/4283248331 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd6806c830 0x7fcd6815a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:22.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.760+0000 7fcd6cf78640 1 -- 172.21.15.6:0/4283248331 >> 172.21.15.6:0/4283248331 conn(0x7fcd680ce310 msgr2=0x7fcd68153d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:03:22.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.760+0000 7fcd6cf78640 1 -- 172.21.15.6:0/4283248331 shutdown_connections 2024-05-04T01:03:22.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.760+0000 7fcd6cf78640 1 -- 172.21.15.6:0/4283248331 wait complete. 2024-05-04T01:03:22.788 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-04T01:03:22.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.944+0000 7f7bc3a51640 1 Processor -- start 2024-05-04T01:03:22.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.944+0000 7f7bc3a51640 1 -- start start 2024-05-04T01:03:22.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.948+0000 7f7bc3a51640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7bbc0cd780 0x7f7bbc0ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.948+0000 7f7bc3a51640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7bbc0c7560 0x7f7bbc150930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.948+0000 7f7bc3a51640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bbc0c8820 con 0x7f7bbc0c7970 2024-05-04T01:03:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.948+0000 7f7bc3a51640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f7bbc0c8b00 con 0x7f7bbc0cd780 2024-05-04T01:03:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.948+0000 7f7bc3a51640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f7bbc0c8de0 con 0x7f7bbc0c7560 2024-05-04T01:03:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.948+0000 7f7bc17ed640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7bbc0cd780 0x7f7bbc0ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.948+0000 7f7bc17ed640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7bbc0cd780 0x7f7bbc0ce640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59462/0 (socket says 172.21.15.6:59462) 2024-05-04T01:03:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.948+0000 7f7bc17ed640 1 -- 172.21.15.6:0/3841378958 learned_addr learned my addr 172.21.15.6:0/3841378958 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:03:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.948+0000 7f7bc0fec640 1 --2- 172.21.15.6:0/3841378958 >> v2:172.21.15.163:3300/0 conn(0x7f7bbc0c7560 0x7f7bbc150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.952+0000 7f7bc17ed640 1 -- 172.21.15.6:0/3841378958 >> v2:172.21.15.163:3300/0 conn(0x7f7bbc0c7560 msgr2=0x7f7bbc150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:03:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.952+0000 7f7bc17ed640 1 --2- 172.21.15.6:0/3841378958 >> v2:172.21.15.163:3300/0 conn(0x7f7bbc0c7560 0x7f7bbc150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.952+0000 7f7bc17ed640 1 -- 172.21.15.6:0/3841378958 >> v1:172.21.15.163:6789/0 conn(0x7f7bbc0c7970 legacy=0x7f7bbc15da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T01:03:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.952+0000 7f7bc17ed640 1 -- 172.21.15.6:0/3841378958 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bbc0c90c0 con 0x7f7bbc0cd780 2024-05-04T01:03:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.952+0000 7f7bc0fec640 1 --2- 172.21.15.6:0/3841378958 >> v2:172.21.15.163:3300/0 conn(0x7f7bbc0c7560 0x7f7bbc150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T01:03:22.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.956+0000 7f7bc17ed640 1 --2- 172.21.15.6:0/3841378958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bbc0cd780 0x7f7bbc0ce640 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc06ff60 tx=0x7f7bb801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a1c8bc927dce1d server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:22.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.960+0000 7f7bb3fff640 1 -- 172.21.15.6:0/3841378958 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb80b5070 con 0x7f7bbc0cd780 2024-05-04T01:03:22.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.960+0000 7f7bb3fff640 1 -- 172.21.15.6:0/3841378958 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7bb80a89d0 con 0x7f7bbc0cd780 2024-05-04T01:03:22.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.960+0000 7f7bb3fff640 1 -- 172.21.15.6:0/3841378958 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb80a8dc0 con 0x7f7bbc0cd780 2024-05-04T01:03:22.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.960+0000 7f7bc3a51640 1 -- 172.21.15.6:0/3841378958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bbc0cd780 msgr2=0x7f7bbc0ce640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:22.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.960+0000 7f7bc3a51640 1 --2- 172.21.15.6:0/3841378958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bbc0cd780 0x7f7bbc0ce640 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc06ff60 tx=0x7f7bb801ed10 comp rx=0 tx=0).stop 2024-05-04T01:03:22.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.960+0000 7f7bc3a51640 1 -- 172.21.15.6:0/3841378958 shutdown_connections 2024-05-04T01:03:22.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.960+0000 7f7bc3a51640 1 --2- 172.21.15.6:0/3841378958 >> v2:172.21.15.163:3300/0 conn(0x7f7bbc0c7560 0x7f7bbc150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:22.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.960+0000 7f7bc3a51640 1 --2- 172.21.15.6:0/3841378958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bbc0cd780 0x7f7bbc0ce640 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:22.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.960+0000 7f7bc3a51640 1 -- 172.21.15.6:0/3841378958 >> 172.21.15.6:0/3841378958 conn(0x7f7bbc06ce60 msgr2=0x7f7bbc0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:03:22.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.960+0000 7f7bc3a51640 1 -- 172.21.15.6:0/3841378958 shutdown_connections 2024-05-04T01:03:22.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.960+0000 7f7bc3a51640 1 -- 172.21.15.6:0/3841378958 wait complete. 2024-05-04T01:03:22.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.964+0000 7f7bc3a51640 1 Processor -- start 2024-05-04T01:03:22.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.964+0000 7f7bc3a51640 1 -- start start 2024-05-04T01:03:22.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.964+0000 7f7bc3a51640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bbc0c7560 0x7f7bbc1f1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:22.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.964+0000 7f7bc3a51640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7bbc0c7970 0x7f7bbc14b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:22.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.964+0000 7f7bc3a51640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bbc0cd780 0x7f7bbc14b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:22.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.964+0000 7f7bc3a51640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc150e70 con 0x7f7bbc0c7560 2024-05-04T01:03:22.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.964+0000 7f7bc3a51640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc15e360 con 0x7f7bbc0cd780 2024-05-04T01:03:22.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.964+0000 7f7bc3a51640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f7bbc150ff0 con 0x7f7bbc0c7970 2024-05-04T01:03:22.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.964+0000 7f7bc1fee640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bbc0cd780 0x7f7bbc14b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:22.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.964+0000 7f7bc0fec640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7bbc0c7970 0x7f7bbc14b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:22.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.968+0000 7f7bc17ed640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bbc0c7560 0x7f7bbc1f1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:22.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.968+0000 7f7bc17ed640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bbc0c7560 0x7f7bbc1f1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59472/0 (socket says 172.21.15.6:59472) 2024-05-04T01:03:22.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.968+0000 7f7bc17ed640 1 -- 172.21.15.6:0/3387712491 learned_addr learned my addr 172.21.15.6:0/3387712491 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-04T01:03:22.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.972+0000 7f7bc17ed640 1 -- 172.21.15.6:0/3387712491 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7bbc0c7970 msgr2=0x7f7bbc14b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:22.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.972+0000 7f7bc17ed640 1 --2- 172.21.15.6:0/3387712491 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7bbc0c7970 0x7f7bbc14b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:22.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.972+0000 7f7bc17ed640 1 -- 172.21.15.6:0/3387712491 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bbc0cd780 msgr2=0x7f7bbc14b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:22.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.972+0000 7f7bc17ed640 1 --2- 172.21.15.6:0/3387712491 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bbc0cd780 0x7f7bbc14b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:22.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.972+0000 7f7bc17ed640 1 -- 172.21.15.6:0/3387712491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bbc150460 con 0x7f7bbc0c7560 2024-05-04T01:03:22.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.976+0000 7f7bc17ed640 1 --2- 172.21.15.6:0/3387712491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bbc0c7560 0x7f7bbc1f1100 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7bb801d3c0 tx=0x7f7bb801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:22.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.980+0000 7f7bb1ffb640 1 -- 172.21.15.6:0/3387712491 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb80b5040 con 0x7f7bbc0c7560 2024-05-04T01:03:22.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.980+0000 7f7bb1ffb640 1 -- 172.21.15.6:0/3387712491 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7bb80be070 con 0x7f7bbc0c7560 2024-05-04T01:03:22.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.980+0000 7f7bb1ffb640 1 -- 172.21.15.6:0/3387712491 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb80b1990 con 0x7f7bbc0c7560 2024-05-04T01:03:22.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.980+0000 7f7bc3a51640 1 -- 172.21.15.6:0/3387712491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bbc15b220 con 0x7f7bbc0c7560 2024-05-04T01:03:22.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.980+0000 7f7bc3a51640 1 -- 172.21.15.6:0/3387712491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bbc14fac0 con 0x7f7bbc0c7560 2024-05-04T01:03:22.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:22.980+0000 7f7bc3a51640 1 -- 172.21.15.6:0/3387712491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bbc06a400 con 0x7f7bbc0c7560 2024-05-04T01:03:23.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:23.316+0000 7f7bb1ffb640 1 -- 172.21.15.6:0/3387712491 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7bb80b1b30 con 0x7f7bbc0c7560 2024-05-04T01:03:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:23.316+0000 7f7bb1ffb640 1 --2- 172.21.15.6:0/3387712491 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f7ba006f480 0x7f7ba0071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T01:03:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:23.316+0000 7f7bc0fec640 1 --2- 172.21.15.6:0/3387712491 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f7ba006f480 0x7f7ba0071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T01:03:23.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:23.316+0000 7f7bc0fec640 1 --2- 172.21.15.6:0/3387712491 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f7ba006f480 0x7f7ba0071990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc14db70 tx=0x7f7bac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T01:03:23.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:23.356+0000 7f7bb1ffb640 1 -- 172.21.15.6:0/3387712491 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5558+0+0 (secure 0 0 0) 0x7f7bb80f6020 con 0x7f7bbc0c7560 2024-05-04T01:03:23.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:23.356+0000 7f7bb1ffb640 1 -- 172.21.15.6:0/3387712491 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7bb80c8020 con 0x7f7bbc0c7560 2024-05-04T01:03:23.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:23.532+0000 7f7bc3a51640 1 -- 172.21.15.6:0/3387712491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7bbc0cd350 con 0x7f7bbc0c7560 2024-05-04T01:03:24.436 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:03:24.439 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:03:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:24.516+0000 7f7bb1ffb640 1 -- 172.21.15.6:0/3387712491 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) ==== 169+0+0 (secure 0 0 0) 0x7f7bb8018870 con 0x7f7bbc0c7560 2024-05-04T01:03:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-05-04T01:03:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:24.520+0000 7f7bc3a51640 1 -- 172.21.15.6:0/3387712491 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f7ba006f480 msgr2=0x7f7ba0071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:24.520+0000 7f7bc3a51640 1 --2- 172.21.15.6:0/3387712491 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f7ba006f480 0x7f7ba0071990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc14db70 tx=0x7f7bac008040 comp rx=0 tx=0).stop 2024-05-04T01:03:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:24.520+0000 7f7bc3a51640 1 -- 172.21.15.6:0/3387712491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bbc0c7560 msgr2=0x7f7bbc1f1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T01:03:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:24.520+0000 7f7bc3a51640 1 --2- 172.21.15.6:0/3387712491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bbc0c7560 0x7f7bbc1f1100 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7bb801d3c0 tx=0x7f7bb801bab0 comp rx=0 tx=0).stop 2024-05-04T01:03:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:24.520+0000 7f7bc3a51640 1 -- 172.21.15.6:0/3387712491 shutdown_connections 2024-05-04T01:03:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:24.520+0000 7f7bc3a51640 1 --2- 172.21.15.6:0/3387712491 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bbc0cd780 0x7f7bbc14b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:24.520+0000 7f7bc3a51640 1 --2- 172.21.15.6:0/3387712491 >> [v2:172.21.15.163:6800/2152694980,v1:172.21.15.163:6801/2152694980] conn(0x7f7ba006f480 0x7f7ba0071990 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:24.520+0000 7f7bc3a51640 1 --2- 172.21.15.6:0/3387712491 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7bbc0c7970 0x7f7bbc14b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:24.520+0000 7f7bc3a51640 1 --2- 172.21.15.6:0/3387712491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bbc0c7560 0x7f7bbc1f1100 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T01:03:24.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:24.520+0000 7f7bc3a51640 1 -- 172.21.15.6:0/3387712491 >> 172.21.15.6:0/3387712491 conn(0x7f7bbc06ce60 msgr2=0x7f7bbc06edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T01:03:24.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:24.520+0000 7f7bc3a51640 1 -- 172.21.15.6:0/3387712491 shutdown_connections 2024-05-04T01:03:24.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-04T01:03:24.520+0000 7f7bc3a51640 1 -- 172.21.15.6:0/3387712491 wait complete. 2024-05-04T01:03:24.555 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-04T01:03:24.555 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-04T01:03:24.555 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:03:24.623 INFO:tasks.ceph.mds.a.smithi006.stderr:2024-05-04T01:03:24.604+0000 fb62640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a (PID: 32993) UID: 0 2024-05-04T01:03:24.624 INFO:tasks.ceph.mds.a.smithi006.stderr:2024-05-04T01:03:24.604+0000 fb62640 -1 mds.a *** got signal Terminated *** 2024-05-04T01:03:27.176 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2024-05-04T01:03:27.177 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-05-04T01:03:27.177 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-05-04T01:03:30.657 INFO:tasks.ceph.mds.a:Stopped 2024-05-04T01:03:30.658 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-04T01:03:30.658 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:03:30.702 INFO:tasks.ceph.mds.c.smithi006.stderr:2024-05-04T01:03:30.664+0000 fb62640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i c (PID: 32995) UID: 0 2024-05-04T01:03:30.703 INFO:tasks.ceph.mds.c.smithi006.stderr:2024-05-04T01:03:30.668+0000 fb62640 -1 mds.c *** got signal Terminated *** 2024-05-04T01:03:33.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~7s 2024-05-04T01:03:33.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2024-05-04T01:03:33.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2024-05-04T01:03:36.760 INFO:tasks.ceph.mds.c:Stopped 2024-05-04T01:03:36.760 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-05-04T01:03:36.760 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:03:36.760 INFO:tasks.ceph.mds.e:Stopped 2024-05-04T01:03:36.760 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-04T01:03:36.760 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:03:36.761 INFO:tasks.ceph.mds.b:Stopped 2024-05-04T01:03:36.761 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-04T01:03:36.761 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:03:36.761 INFO:tasks.ceph.mds.d:Stopped 2024-05-04T01:03:36.761 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-05-04T01:03:36.761 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:03:36.807 INFO:tasks.ceph.mds.f.smithi163.stderr:2024-05-04T01:03:36.769+0000 fb62640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i f (PID: 33323) UID: 0 2024-05-04T01:03:36.808 INFO:tasks.ceph.mds.f.smithi163.stderr:2024-05-04T01:03:36.773+0000 fb62640 -1 mds.f *** got signal Terminated *** 2024-05-04T01:03:40.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2024-05-04T01:03:40.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-05-04T01:03:40.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-05-04T01:03:42.863 INFO:tasks.ceph.mds.f:Stopped 2024-05-04T01:03:42.864 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-04T01:03:42.864 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-04T01:03:42.864 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:03:42.865 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-05-04T01:03:42.860+0000 7ff76b56b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 27837) UID: 0 2024-05-04T01:03:42.865 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-05-04T01:03:42.860+0000 7ff76b56b640 -1 osd.0 34 *** Got signal Terminated *** 2024-05-04T01:03:46.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-05-04T01:03:48.966 INFO:tasks.ceph.osd.0:Stopped 2024-05-04T01:03:48.966 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-04T01:03:48.966 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:03:48.967 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-05-04T01:03:48.964+0000 7f63888a7640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 27839) UID: 0 2024-05-04T01:03:48.967 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-05-04T01:03:48.964+0000 7f63888a7640 -1 osd.1 35 *** Got signal Terminated *** 2024-05-04T01:03:52.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-05-04T01:03:52.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-05-04T01:03:54.551 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:03:54.555 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:03:55.068 INFO:tasks.ceph.osd.1:Stopped 2024-05-04T01:03:55.068 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-04T01:03:55.068 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:03:55.069 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-05-04T01:03:55.064+0000 7fdd5c60e640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 27841) UID: 0 2024-05-04T01:03:55.069 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-05-04T01:03:55.064+0000 7fdd5c60e640 -1 osd.2 37 *** Got signal Terminated *** 2024-05-04T01:03:58.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-05-04T01:03:58.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-05-04T01:04:01.170 INFO:tasks.ceph.osd.2:Stopped 2024-05-04T01:04:01.170 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-04T01:04:01.171 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:04:01.172 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-05-04T01:04:01.168+0000 7f07a0ad0640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 27843) UID: 0 2024-05-04T01:04:01.172 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-05-04T01:04:01.168+0000 7f07a0ad0640 -1 osd.3 38 *** Got signal Terminated *** 2024-05-04T01:04:04.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-05-04T01:04:04.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-05-04T01:04:07.272 INFO:tasks.ceph.osd.3:Stopped 2024-05-04T01:04:07.273 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-04T01:04:07.273 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:04:07.274 INFO:tasks.ceph.osd.4.smithi163.stderr:2024-05-04T01:04:07.276+0000 7fa6fd5be640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 28248) UID: 0 2024-05-04T01:04:07.274 INFO:tasks.ceph.osd.4.smithi163.stderr:2024-05-04T01:04:07.276+0000 7fa6fd5be640 -1 osd.4 39 *** Got signal Terminated *** 2024-05-04T01:04:10.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-05-04T01:04:13.375 INFO:tasks.ceph.osd.4:Stopped 2024-05-04T01:04:13.375 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-04T01:04:13.375 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:04:13.377 INFO:tasks.ceph.osd.5.smithi163.stderr:2024-05-04T01:04:13.376+0000 7f3ae7157640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 28251) UID: 0 2024-05-04T01:04:13.377 INFO:tasks.ceph.osd.5.smithi163.stderr:2024-05-04T01:04:13.376+0000 7f3ae7157640 -1 osd.5 40 *** Got signal Terminated *** 2024-05-04T01:04:15.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-04T01:04:19.478 INFO:tasks.ceph.osd.5:Stopped 2024-05-04T01:04:19.478 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-04T01:04:19.478 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:04:19.479 INFO:tasks.ceph.osd.6.smithi163.stderr:2024-05-04T01:04:19.480+0000 7f0b4fa32640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 28250) UID: 0 2024-05-04T01:04:19.480 INFO:tasks.ceph.osd.6.smithi163.stderr:2024-05-04T01:04:19.480+0000 7f0b4fa32640 -1 osd.6 41 *** Got signal Terminated *** 2024-05-04T01:04:21.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-05-04T01:04:21.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-05-04T01:04:24.690 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:04:24.693 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:04:25.580 INFO:tasks.ceph.osd.6:Stopped 2024-05-04T01:04:25.581 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-04T01:04:25.581 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:04:25.582 INFO:tasks.ceph.osd.7.smithi163.stderr:2024-05-04T01:04:25.584+0000 7f9bab40c640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 28254) UID: 0 2024-05-04T01:04:25.582 INFO:tasks.ceph.osd.7.smithi163.stderr:2024-05-04T01:04:25.584+0000 7f9bab40c640 -1 osd.7 41 *** Got signal Terminated *** 2024-05-04T01:04:27.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-05-04T01:04:27.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-05-04T01:04:31.682 INFO:tasks.ceph.osd.7:Stopped 2024-05-04T01:04:31.683 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-04T01:04:31.683 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-04T01:04:31.683 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:04:31.715 INFO:tasks.ceph.mgr.y:Stopped 2024-05-04T01:04:31.716 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-04T01:04:31.716 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:04:31.751 INFO:tasks.ceph.mgr.x:Stopped 2024-05-04T01:04:31.752 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-04T01:04:31.752 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-04T01:04:31.752 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:04:31.781 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-05-04T01:04:31.759+0000 e537640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 27719) UID: 0 2024-05-04T01:04:31.781 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-05-04T01:04:31.759+0000 e537640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-04T01:04:32.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-05-04T01:04:37.574 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-05-04T01:04:37.854 INFO:tasks.ceph.mon.a:Stopped 2024-05-04T01:04:37.854 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-04T01:04:37.855 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:04:37.903 INFO:tasks.ceph.mon.b.smithi163.stderr:2024-05-04T01:04:37.863+0000 e537640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 27841) UID: 0 2024-05-04T01:04:37.904 INFO:tasks.ceph.mon.b.smithi163.stderr:2024-05-04T01:04:37.867+0000 e537640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-05-04T01:04:42.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-05-04T01:04:42.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-05-04T01:04:43.956 INFO:tasks.ceph.mon.b:Stopped 2024-05-04T01:04:43.957 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-04T01:04:43.957 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T01:04:44.022 INFO:tasks.ceph.mon.c.smithi163.stderr:2024-05-04T01:04:43.967+0000 e537640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 27844) UID: 0 2024-05-04T01:04:44.023 INFO:tasks.ceph.mon.c.smithi163.stderr:2024-05-04T01:04:43.971+0000 e537640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2024-05-04T01:04:47.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-05-04T01:04:47.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-05-04T01:04:50.058 INFO:tasks.ceph.mon.c:Stopped 2024-05-04T01:04:50.058 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-04T01:04:50.059 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-05-04T01:04:50.080 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com 2024-05-04T01:04:50.080 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-04T01:04:50.259 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi006.front.sepia.ceph.com 2024-05-04T01:04:50.260 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-04T01:04:50.441 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi006.front.sepia.ceph.com 2024-05-04T01:04:50.441 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-04T01:04:50.592 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi006.front.sepia.ceph.com 2024-05-04T01:04:50.592 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-04T01:04:50.751 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi163.front.sepia.ceph.com 2024-05-04T01:04:50.751 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-04T01:04:51.113 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi163.front.sepia.ceph.com 2024-05-04T01:04:51.113 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-04T01:04:51.285 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi163.front.sepia.ceph.com 2024-05-04T01:04:51.285 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-04T01:04:51.461 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi163.front.sepia.ceph.com 2024-05-04T01:04:51.461 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-04T01:04:51.627 INFO:tasks.ceph:Archiving mon data... 2024-05-04T01:04:51.629 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688442/data/mon.a.tgz 2024-05-04T01:04:51.629 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2024-05-04T01:04:51.635 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.ucSeWt5VeK 2024-05-04T01:04:51.636 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ucSeWt5VeK 2024-05-04T01:04:51.765 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.ucSeWt5VeK 2024-05-04T01:04:51.830 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.ucSeWt5VeK is 334KB 2024-05-04T01:04:51.892 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.ucSeWt5VeK 2024-05-04T01:04:51.897 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688442/data/mon.b.tgz 2024-05-04T01:04:51.897 DEBUG:teuthology.orchestra.run.smithi163:> mktemp 2024-05-04T01:04:51.903 INFO:teuthology.orchestra.run.smithi163.stdout:/tmp/tmp.QXL2yudcnf 2024-05-04T01:04:51.903 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.QXL2yudcnf 2024-05-04T01:04:52.027 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0666 /tmp/tmp.QXL2yudcnf 2024-05-04T01:04:52.090 DEBUG:teuthology.orchestra.remote:smithi163:/tmp/tmp.QXL2yudcnf is 347KB 2024-05-04T01:04:52.152 DEBUG:teuthology.orchestra.run.smithi163:> rm -fr /tmp/tmp.QXL2yudcnf 2024-05-04T01:04:52.157 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688442/data/mon.c.tgz 2024-05-04T01:04:52.157 DEBUG:teuthology.orchestra.run.smithi163:> mktemp 2024-05-04T01:04:52.202 INFO:teuthology.orchestra.run.smithi163.stdout:/tmp/tmp.9a8elobKl8 2024-05-04T01:04:52.203 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.9a8elobKl8 2024-05-04T01:04:52.333 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0666 /tmp/tmp.9a8elobKl8 2024-05-04T01:04:52.394 DEBUG:teuthology.orchestra.remote:smithi163:/tmp/tmp.9a8elobKl8 is 347KB 2024-05-04T01:04:52.456 DEBUG:teuthology.orchestra.run.smithi163:> rm -fr /tmp/tmp.9a8elobKl8 2024-05-04T01:04:52.461 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-04T01:04:52.461 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-04T01:04:52.464 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-04T01:04:52.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-05-04T01:04:52.755 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2024-05-04T01:04:53.048 INFO:tasks.ceph:Archiving crash dumps... 2024-05-04T01:04:53.050 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688442/remote/smithi006/crash 2024-05-04T01:04:53.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-04T01:04:53.066 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688442/remote/smithi163/crash 2024-05-04T01:04:53.067 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-04T01:04:53.081 INFO:tasks.ceph:Shutting down logrotate 2024-05-04T01:04:53.081 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:04:53.115 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T01:04:53.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-04T01:04:53.209 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-04T01:04:53.223 INFO:tasks.ceph:Compressing logs... 2024-05-04T01:04:53.223 DEBUG:teuthology.orchestra.run.smithi006:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-04T01:04:53.255 DEBUG:teuthology.orchestra.run.smithi163:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-04T01:04:53.278 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35441.log 2024-05-04T01:04:53.278 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33587.log 2024-05-04T01:04:53.279 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-04T01:04:53.279 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35441.log: /var/log/ceph/ceph-client.admin.33587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34404.log 2024-05-04T01:04:53.280 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mgr.y.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35441.log.gz 2024-05-04T01:04:53.280 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33596.log 2024-05-04T01:04:53.280 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33587.log.gz 2024-05-04T01:04:53.280 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.34404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35181.log 2024-05-04T01:04:53.281 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34064.log 2024-05-04T01:04:53.281 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35181.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33596.log.gz 2024-05-04T01:04:53.281 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-04T01:04:53.281 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35181.log.gz 2024-05-04T01:04:53.282 INFO:teuthology.orchestra.run.smithi006.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.34404.log.gz 2024-05-04T01:04:53.283 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33760.log 2024-05-04T01:04:53.283 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.34064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34302.log 2024-05-04T01:04:53.283 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.0.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34064.log.gz 2024-05-04T01:04:53.283 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35389.log 2024-05-04T01:04:53.283 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33760.log.gz 2024-05-04T01:04:53.285 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.34302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33771.log 2024-05-04T01:04:53.285 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34302.log.gz 2024-05-04T01:04:53.285 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35493.log 2024-05-04T01:04:53.285 INFO:teuthology.orchestra.run.smithi006.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35389.log.gz 2024-05-04T01:04:53.285 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33141.log 2024-05-04T01:04:53.285 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33771.log.gz 2024-05-04T01:04:53.285 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33115.log 2024-05-04T01:04:53.285 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35493.log: /var/log/ceph/ceph-client.admin.33141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35701.log 2024-05-04T01:04:53.287 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33141.log.gz 2024-05-04T01:04:53.288 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35493.log.gz 2024-05-04T01:04:53.288 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33256.log 2024-05-04T01:04:53.288 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35519.log 2024-05-04T01:04:53.288 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35701.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33115.log.gz 2024-05-04T01:04:53.288 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33256.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35701.log.gz -5 2024-05-04T01:04:53.288 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33002.log 2024-05-04T01:04:53.288 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33256.log.gz 2024-05-04T01:04:53.288 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35623.log 2024-05-04T01:04:53.288 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35285.log 2024-05-04T01:04:53.288 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33002.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35519.log.gz 2024-05-04T01:04:53.288 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35623.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.35623.log.gz -5 2024-05-04T01:04:53.288 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35337.log 2024-05-04T01:04:53.288 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33002.log.gz 2024-05-04T01:04:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35415.log 2024-05-04T01:04:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35233.log 2024-05-04T01:04:53.291 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35285.log.gz 2024-05-04T01:04:53.292 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35337.log.gz 2024-05-04T01:04:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35415.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-04T01:04:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35233.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35415.log.gz 2024-05-04T01:04:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33089.log 2024-05-04T01:04:53.292 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35233.log.gz 2024-05-04T01:04:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34248.log 2024-05-04T01:04:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33089.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.33089.log.gz 2024-05-04T01:04:53.292 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.27848.log 2024-05-04T01:04:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33823.log 2024-05-04T01:04:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.34248.log: /var/log/ceph/ceph-client.admin.27848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33494.log 2024-05-04T01:04:53.292 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27848.log.gz 2024-05-04T01:04:53.292 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34248.log.gz 2024-05-04T01:04:53.300 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27994.log 2024-05-04T01:04:53.301 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28169.log 2024-05-04T01:04:53.301 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.27994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28067.log 2024-05-04T01:04:53.301 INFO:teuthology.orchestra.run.smithi163.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27994.log.gz 2024-05-04T01:04:53.301 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.28169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28221.log 2024-05-04T01:04:53.301 INFO:teuthology.orchestra.run.smithi163.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.28169.log.gz 2024-05-04T01:04:53.301 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.28067.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-04T01:04:53.301 INFO:teuthology.orchestra.run.smithi163.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28067.log.gz 2024-05-04T01:04:53.301 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.28221.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-04T01:04:53.301 INFO:teuthology.orchestra.run.smithi163.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28221.log.gz 2024-05-04T01:04:53.301 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28018.log 2024-05-04T01:04:53.301 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-04T01:04:53.301 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.28018.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-04T01:04:53.302 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-osd.5.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.28018.log.gz 2024-05-04T01:04:53.302 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-05-04T01:04:53.302 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-04T01:04:53.302 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-04T01:04:53.302 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-mds.f.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28043.log 2024-05-04T01:04:53.302 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-04T01:04:53.302 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.28043.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.28043.log.gz 2024-05-04T01:04:53.302 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-04T01:04:53.302 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph.audit.log: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-04T01:04:53.302 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-05-04T01:04:53.310 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-mds.d.log: 93.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-04T01:04:53.310 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2024-05-04T01:04:53.310 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/valgrind/mon.c.log: 91.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-05-04T01:04:53.310 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2024-05-04T01:04:53.310 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/valgrind/mds.f.log: 57.7% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2024-05-04T01:04:53.310 INFO:teuthology.orchestra.run.smithi163.stderr: 92.6%gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2024-05-04T01:04:53.311 INFO:teuthology.orchestra.run.smithi163.stderr: -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-05-04T01:04:53.311 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/valgrind/mds.b.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-05-04T01:04:53.314 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/valgrind/mds.d.log: 95.5% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2024-05-04T01:04:53.314 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-04T01:04:53.314 INFO:teuthology.orchestra.run.smithi163.stderr: 95.4% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2024-05-04T01:04:53.314 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-04T01:04:53.314 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-mds.b.log: 91.6% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-05-04T01:04:53.314 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27963.log 2024-05-04T01:04:53.318 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33223.log 2024-05-04T01:04:53.318 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33823.log.gz 2024-05-04T01:04:53.318 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34509.log 2024-05-04T01:04:53.318 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33494.log: /var/log/ceph/ceph-client.admin.33223.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-04T01:04:53.318 INFO:teuthology.orchestra.run.smithi006.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33494.log.gz 2024-05-04T01:04:53.318 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33223.log.gz 2024-05-04T01:04:53.318 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.34509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34136.log 2024-05-04T01:04:53.318 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mon.a.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34509.log.gz 2024-05-04T01:04:53.318 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33600.log 2024-05-04T01:04:53.318 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34222.log/var/log/ceph/ceph-client.admin.34136.log: 2024-05-04T01:04:53.318 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35649.log 2024-05-04T01:04:53.319 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34136.log.gz 2024-05-04T01:04:53.319 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33600.log.gz 2024-05-04T01:04:53.319 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.34222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33790.log 2024-05-04T01:04:53.319 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34222.log.gz 2024-05-04T01:04:53.319 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33468.log 2024-05-04T01:04:53.319 INFO:teuthology.orchestra.run.smithi006.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35649.log.gz 2024-05-04T01:04:53.319 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35728.log 2024-05-04T01:04:53.319 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33790.log: /var/log/ceph/ceph-client.admin.33468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33810.log 2024-05-04T01:04:53.319 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33790.log.gz 2024-05-04T01:04:53.319 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2%/var/log/ceph/ceph-client.admin.35728.log: -- replaced with /var/log/ceph/ceph-client.admin.33468.log.gz 2024-05-04T01:04:53.319 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35129.log 2024-05-04T01:04:53.319 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35728.log.gz 2024-05-04T01:04:53.319 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33592.log 2024-05-04T01:04:53.319 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33810.log.gz 2024-05-04T01:04:53.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32904.log 2024-05-04T01:04:53.320 INFO:teuthology.orchestra.run.smithi006.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35129.log.gz 2024-05-04T01:04:53.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34050.log 2024-05-04T01:04:53.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.32904.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33592.log.gz 2024-05-04T01:04:53.320 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-04T01:04:53.320 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32904.log.gz 2024-05-04T01:04:53.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.34050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35058.log 2024-05-04T01:04:53.320 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34050.log.gz 2024-05-04T01:04:53.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33594.log 2024-05-04T01:04:53.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32955.log 2024-05-04T01:04:53.320 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35058.log.gz 2024-05-04T01:04:53.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35545.log 2024-05-04T01:04:53.320 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33594.log.gz 2024-05-04T01:04:53.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.32955.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.32955.log.gz 2024-05-04T01:04:53.321 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33589.log 2024-05-04T01:04:53.321 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35311.log 2024-05-04T01:04:53.321 INFO:teuthology.orchestra.run.smithi006.stderr: 95.0%/var/log/ceph/ceph-client.admin.33589.log: 87.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-04T01:04:53.321 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33282.log 2024-05-04T01:04:53.321 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35545.log.gz 2024-05-04T01:04:53.321 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33589.log.gz 2024-05-04T01:04:53.321 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33338.log 2024-05-04T01:04:53.321 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35311.log: /var/log/ceph/ceph-client.admin.33282.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33442.log 2024-05-04T01:04:53.321 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35311.log.gz 2024-05-04T01:04:53.321 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33282.log.gz 2024-05-04T01:04:53.321 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35207.log 2024-05-04T01:04:53.321 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33312.log 2024-05-04T01:04:53.321 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33338.log.gz 2024-05-04T01:04:53.321 INFO:teuthology.orchestra.run.smithi006.stderr: 87.2%/var/log/ceph/ceph-client.admin.35207.log: -- replaced with /var/log/ceph/ceph-client.admin.33442.log.gz 2024-05-04T01:04:53.322 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34328.log 2024-05-04T01:04:53.322 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35207.log.gz 2024-05-04T01:04:53.322 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35571.log 2024-05-04T01:04:53.322 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33990.log 2024-05-04T01:04:53.322 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.34328.log: -- replaced with /var/log/ceph/ceph-client.admin.33312.log.gz 2024-05-04T01:04:53.322 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35571.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-04T01:04:53.322 INFO:teuthology.orchestra.run.smithi006.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34328.log.gz 2024-05-04T01:04:53.322 INFO:teuthology.orchestra.run.smithi006.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35571.log.gz 2024-05-04T01:04:53.322 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34170.log 2024-05-04T01:04:53.322 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33990.log.gz 2024-05-04T01:04:53.322 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22922.log 2024-05-04T01:04:53.322 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.34170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33590.log 2024-05-04T01:04:53.322 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.tmp-client.admin.22922.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35597.log 2024-05-04T01:04:53.323 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34170.log.gz 2024-05-04T01:04:53.323 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.22922.log.gz 2024-05-04T01:04:53.323 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33590.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33590.log.gz 2024-05-04T01:04:53.323 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34354.log 2024-05-04T01:04:53.323 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33390.log 2024-05-04T01:04:53.323 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2%/var/log/ceph/ceph-client.admin.34354.log: -- replaced with /var/log/ceph/ceph-client.admin.35597.log.gz 2024-05-04T01:04:53.323 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33597.log 2024-05-04T01:04:53.323 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35467.log 2024-05-04T01:04:53.323 INFO:teuthology.orchestra.run.smithi006.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.34354.log.gz 2024-05-04T01:04:53.323 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33597.log: /var/log/ceph/ceph-client.admin.33390.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33597.log.gz 2024-05-04T01:04:53.323 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33390.log.gz 2024-05-04T01:04:53.323 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-04T01:04:53.323 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33986.log 2024-05-04T01:04:53.323 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.35467.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33785.log 2024-05-04T01:04:53.323 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-04T01:04:53.323 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33986.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33986.log.gz 2024-05-04T01:04:53.324 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34274.log 2024-05-04T01:04:53.324 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33786.log 2024-05-04T01:04:53.324 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33785.log.gz 2024-05-04T01:04:53.324 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.34274.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34274.log.gz 2024-05-04T01:04:53.324 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33364.log 2024-05-04T01:04:53.324 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34068.log 2024-05-04T01:04:53.324 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33786.log: /var/log/ceph/ceph-client.admin.33364.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33786.log.gz 2024-05-04T01:04:53.324 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27726.log 2024-05-04T01:04:53.324 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-04T01:04:53.324 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33364.log.gz 2024-05-04T01:04:53.324 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.34068.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34068.log.gz 2024-05-04T01:04:53.330 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34196.log 2024-05-04T01:04:53.330 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.27726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35155.log 2024-05-04T01:04:53.330 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.34196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33167.log 2024-05-04T01:04:53.330 INFO:teuthology.orchestra.run.smithi006.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.27726.log.gz 2024-05-04T01:04:53.330 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4%/var/log/ceph/ceph-client.admin.35155.log: -- replaced with /var/log/ceph/ceph-client.admin.34196.log.gz 2024-05-04T01:04:53.330 INFO:teuthology.orchestra.run.smithi006.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35155.log.gz 2024-05-04T01:04:53.330 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35780.log 2024-05-04T01:04:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35363.log 2024-05-04T01:04:53.331 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5%/var/log/ceph/ceph-client.admin.35780.log: -- replaced with /var/log/ceph/ceph-client.admin.33167.log.gz 2024-05-04T01:04:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-04T01:04:53.331 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35780.log.gz 2024-05-04T01:04:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34454.log 2024-05-04T01:04:53.331 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35363.log.gz 2024-05-04T01:04:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35677.log 2024-05-04T01:04:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.34454.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-04T01:04:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35677.log: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-04T01:04:53.331 INFO:teuthology.orchestra.run.smithi006.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.34454.log.gz 2024-05-04T01:04:53.331 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35677.log.gz 2024-05-04T01:04:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35259.log 2024-05-04T01:04:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27967.log 2024-05-04T01:04:53.332 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35259.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-04T01:04:53.332 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35259.log.gz 2024-05-04T01:04:53.332 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.27967.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.27967.log.gz 2024-05-04T01:04:53.332 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34016.log 2024-05-04T01:04:53.332 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35858.log 2024-05-04T01:04:53.332 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.34016.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34016.log.gz 2024-05-04T01:04:53.332 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2024-05-04T01:04:53.332 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35858.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35858.log.gz 2024-05-04T01:04:53.332 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2024-05-04T01:04:53.332 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/valgrind/client.0.log: 77.8% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2024-05-04T01:04:53.332 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-05-04T01:04:53.333 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-04T01:04:53.333 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.27963.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.27963.log.gz 2024-05-04T01:04:53.334 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/valgrind/mds.a.log: 57.7% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2024-05-04T01:04:53.335 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2024-05-04T01:04:53.335 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/valgrind/mon.a.log: 91.6% 92.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-04T01:04:53.335 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-04T01:04:53.335 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2024-05-04T01:04:53.335 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/valgrind/mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33416.log 2024-05-04T01:04:53.335 INFO:teuthology.orchestra.run.smithi006.stderr: 57.7% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2024-05-04T01:04:53.335 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/valgrind/mds.e.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-04T01:04:53.338 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33520.log 2024-05-04T01:04:53.338 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35085.log 2024-05-04T01:04:53.341 INFO:teuthology.orchestra.run.smithi006.stderr: 95.4% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 89.4% 2024-05-04T01:04:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33520.log: -- replaced with /var/log/ceph/ceph-client.admin.33416.log.gz 2024-05-04T01:04:53.341 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33520.log.gz 2024-05-04T01:04:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35754.log 2024-05-04T01:04:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33546.log 2024-05-04T01:04:53.341 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7%/var/log/ceph/ceph-client.admin.35754.log: -- replaced with /var/log/ceph/ceph-client.admin.35085.log.gz 2024-05-04T01:04:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34637.log 2024-05-04T01:04:53.341 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35754.log.gz 2024-05-04T01:04:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33195.log 2024-05-04T01:04:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.34637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35884.log 2024-05-04T01:04:53.342 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28197.log 2024-05-04T01:04:53.344 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3%/var/log/ceph/ceph-client.admin.33195.log: -- replaced with /var/log/ceph/ceph-client.admin.33546.log.gz 2024-05-04T01:04:53.344 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33195.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33840.log 2024-05-04T01:04:53.344 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-04T01:04:53.344 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35884.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-05-04T01:04:53.344 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33840.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35884.log.gz 2024-05-04T01:04:53.344 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33840.log.gz 2024-05-04T01:04:53.344 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35832.log 2024-05-04T01:04:53.345 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35806.log 2024-05-04T01:04:53.345 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35832.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35832.log.gz 2024-05-04T01:04:53.346 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35806.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35806.log.gz 2024-05-04T01:04:53.354 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.28197.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28197.log.gz 2024-05-04T01:04:53.398 INFO:teuthology.orchestra.run.smithi163.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-04T01:04:53.413 INFO:teuthology.orchestra.run.smithi163.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-04T01:04:53.634 INFO:teuthology.orchestra.run.smithi163.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-04T01:04:53.786 INFO:teuthology.orchestra.run.smithi163.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-04T01:04:53.917 INFO:teuthology.orchestra.run.smithi163.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-04T01:04:54.017 INFO:teuthology.orchestra.run.smithi163.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-04T01:04:54.020 INFO:teuthology.orchestra.run.smithi163.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-04T01:04:54.043 INFO:teuthology.orchestra.run.smithi006.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-04T01:04:54.061 INFO:teuthology.orchestra.run.smithi006.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-04T01:04:54.212 INFO:teuthology.orchestra.run.smithi163.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-04T01:04:54.337 INFO:teuthology.orchestra.run.smithi006.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-04T01:04:54.452 INFO:teuthology.orchestra.run.smithi163.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-04T01:04:54.453 INFO:teuthology.orchestra.run.smithi163.stderr: 2024-05-04T01:04:54.453 INFO:teuthology.orchestra.run.smithi163.stderr:real 0m1.185s 2024-05-04T01:04:54.453 INFO:teuthology.orchestra.run.smithi163.stderr:user 0m4.949s 2024-05-04T01:04:54.454 INFO:teuthology.orchestra.run.smithi163.stderr:sys 0m0.173s 2024-05-04T01:04:54.517 INFO:teuthology.orchestra.run.smithi006.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-04T01:04:54.585 INFO:teuthology.orchestra.run.smithi006.stderr: 89.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-04T01:04:58.070 INFO:teuthology.orchestra.run.smithi006.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.34637.log.gz 2024-05-04T01:05:02.890 INFO:teuthology.orchestra.run.smithi006.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-05-04T01:05:02.891 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-04T01:05:02.891 INFO:teuthology.orchestra.run.smithi006.stderr:real 0m9.634s 2024-05-04T01:05:02.891 INFO:teuthology.orchestra.run.smithi006.stderr:user 0m18.938s 2024-05-04T01:05:02.891 INFO:teuthology.orchestra.run.smithi006.stderr:sys 0m0.618s 2024-05-04T01:05:02.892 INFO:tasks.ceph:Archiving logs... 2024-05-04T01:05:02.892 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688442/remote/smithi006/log 2024-05-04T01:05:02.893 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-04T01:05:05.334 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688442/remote/smithi163/log 2024-05-04T01:05:05.334 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-04T01:05:05.912 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2024-05-04T01:05:05.913 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-04T01:05:05.922 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2024-05-04T01:05:05.922 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-04T01:05:05.922 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-04T01:05:05.925 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-04T01:05:05.996 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-04T01:05:06.014 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-04T01:05:06.015 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-04T01:05:06.017 DEBUG:teuthology.orchestra.run.smithi163:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-04T01:05:06.027 INFO:teuthology.orchestra.run.smithi006.stdout: remote refid st t when poll reach delay offset jitter 2024-05-04T01:05:06.027 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================== 2024-05-04T01:05:06.027 INFO:teuthology.orchestra.run.smithi006.stdout:+hv01.front.sepi 67.205.162.81 3 u 57 64 377 0.102 -0.790 0.043 2024-05-04T01:05:06.028 INFO:teuthology.orchestra.run.smithi006.stdout:+hv02.front.sepi 63.231.80.2 3 u 48 64 377 0.094 +0.254 0.091 2024-05-04T01:05:06.028 INFO:teuthology.orchestra.run.smithi006.stdout:*hv03.front.sepi 74.6.168.72 3 u 53 64 377 0.090 -0.240 0.074 2024-05-04T01:05:06.028 INFO:teuthology.orchestra.run.smithi006.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-05-04T01:05:06.031 INFO:teuthology.orchestra.run.smithi163.stdout: remote refid st t when poll reach delay offset jitter 2024-05-04T01:05:06.031 INFO:teuthology.orchestra.run.smithi163.stdout:============================================================================== 2024-05-04T01:05:06.031 INFO:teuthology.orchestra.run.smithi163.stdout:+hv01.front.sepi 67.205.162.81 3 u 48 64 377 0.088 -3.577 0.418 2024-05-04T01:05:06.032 INFO:teuthology.orchestra.run.smithi163.stdout:+hv02.front.sepi 63.231.80.2 3 u 52 64 377 0.108 -2.407 0.418 2024-05-04T01:05:06.032 INFO:teuthology.orchestra.run.smithi163.stdout:*hv03.front.sepi 74.6.168.72 3 u 53 64 377 0.095 -3.367 0.548 2024-05-04T01:05:06.032 INFO:teuthology.orchestra.run.smithi163.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-05-04T01:05:06.032 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-04T01:05:06.048 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-04T01:05:06.049 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-04T01:05:06.081 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-04T01:05:06.115 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-04T01:05:06.148 INFO:teuthology.task.internal:Duration was 3045.323821 seconds 2024-05-04T01:05:06.149 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-04T01:05:06.182 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-04T01:05:06.182 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-04T01:05:06.185 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-04T01:05:06.222 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-04T01:05:06.223 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2024-05-04T01:05:06.223 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-04T01:05:06.279 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi163.front.sepia.ceph.com 2024-05-04T01:05:06.280 DEBUG:teuthology.orchestra.run.smithi163:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-04T01:05:06.293 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-04T01:05:06.293 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-04T01:05:06.323 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-04T01:05:06.360 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-04T01:05:06.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-04T01:05:06.399 DEBUG:teuthology.orchestra.run.smithi163:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-04T01:05:06.464 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-04T01:05:06.477 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-04T01:05:06.477 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-04T01:05:06.489 DEBUG:teuthology.orchestra.run.smithi163:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-04T01:05:06.502 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-04T01:05:06.519 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-04T01:05:06.539 DEBUG:teuthology.orchestra.run.smithi163:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-04T01:05:06.547 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2024-05-04T01:05:06.555 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = core 2024-05-04T01:05:06.648 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-04T01:05:06.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T01:05:06.655 DEBUG:teuthology.orchestra.run.smithi163:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-04T01:05:06.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T01:05:06.694 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-04T01:05:06.705 INFO:teuthology.task.internal:Transferring archived files... 2024-05-04T01:05:06.706 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688442/remote/smithi006 2024-05-04T01:05:06.706 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-04T01:05:06.729 DEBUG:teuthology.misc:Transferring archived files from smithi163:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688442/remote/smithi163 2024-05-04T01:05:06.730 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-04T01:05:06.758 INFO:teuthology.task.internal:Removing archive directory... 2024-05-04T01:05:06.758 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-04T01:05:06.767 DEBUG:teuthology.orchestra.run.smithi163:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-04T01:05:06.803 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-04T01:05:06.814 INFO:teuthology.task.internal:Not uploading archives. 2024-05-04T01:05:06.814 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-04T01:05:06.841 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-04T01:05:06.841 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-04T01:05:06.844 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-04T01:05:06.849 INFO:teuthology.orchestra.run.smithi006.stdout: 658468 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 4 01:05 /home/ubuntu/cephtest 2024-05-04T01:05:06.850 INFO:teuthology.orchestra.run.smithi163.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 4 01:05 /home/ubuntu/cephtest 2024-05-04T01:05:06.852 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-04T01:05:06.875 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-04T01:05:06.909 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2024-05-04T01:05:06.909 INFO:teuthology.nuke:Checking targets against current locks 2024-05-04T01:05:06.936 DEBUG:teuthology.nuke:shortname: smithi006 2024-05-04T01:05:06.936 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-04T01:05:06.958 DEBUG:teuthology.nuke:shortname: smithi163 2024-05-04T01:05:06.958 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-04T01:05:06.962 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688442', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-04 00:04:13.446252', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBlXbvxO9wd8rg/B/Ewb2Aj1cLbnGU5sypoN9DaAk4VAtGFnf5vFxeXo2b/X1iGGLS6Bw7QpIET6R8Sxpajh8ow='} 2024-05-04T01:05:06.985 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688442', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-04 00:04:13.444519', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLNx3VE/CsM7gbIrU8+X66ZSHmKacnMUasflpx9Iw11Yq7mQBYvn0KTNjBTJKyGGMWnq/4HQHu8S/zySxloGmsE='} 2024-05-04T01:05:07.013 INFO:teuthology.orchestra.console.smithi006:Power off 2024-05-04T01:05:07.013 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-04T01:05:07.035 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2024-05-04T01:05:07.036 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-04T01:05:07.054 INFO:teuthology.orchestra.console.smithi163:Power off 2024-05-04T01:05:07.054 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-04T01:05:07.066 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-05-04T01:05:07.080 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2024-05-04T01:05:07.080 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-04T01:05:07.122 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-05-04T01:05:11.068 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-04T01:05:11.123 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-04T01:05:11.180 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-05-04T01:05:11.234 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-05-04T01:05:15.182 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-04T01:05:15.235 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-04T01:05:15.293 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-05-04T01:05:15.345 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-05-04T01:05:15.395 INFO:teuthology.orchestra.console.smithi006:Power off completed 2024-05-04T01:05:15.446 INFO:teuthology.orchestra.console.smithi163:Power off completed 2024-05-04T01:05:15.551 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/3 tasks/dbench validater/valgrind} duration: 3045.32382106781 failure_reason: 'valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions' flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2024-05-04T01:05:15.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-04T01:05:15.672 INFO:teuthology.run:FAIL